cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
Microsoft
Microsoft

Using a Loop to Get All Paginated Results in a Non-ODATA Rest API

I am a newbie in the API space, and I am trying to pull all the paginated data from UserVoice.  They have a limit of 100 results per page, and I can't use the ?limit syntax to increase the limit.  I am trying to do a loop in PowerQuery but seem to keep getting the same list over and over again.  Here is the query I have so far:

let

url = "https://SUBSITE.userrvoice.com/",

Header=[Authorization="Bearer TOKEN"],

RelativePathing = "api/v2/admin/suggestions",

Source1 = Json.Document(Web.Contents(url, [RelativePath=RelativePathing, Headers=Header])),

iterations = Source1[pagination][total_pages],

FullURL = url & RelativePathing,

 

FnGetOnePage =

(FullURL) as record =>

let

Source2 = Json.Document(Web.Contents(url, [RelativePath=RelativePathing, Headers=Header])),

data = try Source2[suggestions] otherwise null,

next = try Source2[pagination][cursor] otherwise null,

res = [Data=data, Next=FullURL & "?cursor=" & next]

in

res,

 

GeneratedList =

List.Generate(

()=>[i=0, res = FnGetOnePage(FullURL)],

each [i]<iterations and [res][Data]<>null,

each [i=[i]+1, res = FnGetOnePage([res][Next])],

each [res][Data])

in

   GeneratedList

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted
Community Support
Community Support

Re: Using a Loop to Get All Paginated Results in a Non-ODATA Rest API

@glove80 

 

You may take a look at the post below.

https://community.powerbi.com/t5/Desktop/Stopping-when-looping-through-a-paginated-API-feed/m-p/3103...

Community Support Team _ Sam Zha
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

1 REPLY 1
Highlighted
Community Support
Community Support

Re: Using a Loop to Get All Paginated Results in a Non-ODATA Rest API

@glove80 

 

You may take a look at the post below.

https://community.powerbi.com/t5/Desktop/Stopping-when-looping-through-a-paginated-API-feed/m-p/3103...

Community Support Team _ Sam Zha
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

Helpful resources

Announcements
Super Users of the Quarter - Q2 2020

Super Users of the Quarter - Q2 2020

Who are our Super User Superstars? Who made it to the top of the leaderboards? Get the answers!

June 2020 Community Highlights

June 2020 Community Highlights

Featured community members, changes to the Community, and more! Read up on recent Power BI community news.

Community Summit North America

Community Summit North America

Innovate, Collaborate, Grow. The top training and networking event across the globe for Microsoft Business Applications

Power Platform 2020 release wave 2 plan

Power Platform 2020 release wave 2 plan

Features releasing from October 2020 through March 2021

Top Kudoed Authors