Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!
Hi All,
I have an api call that only returns 50 results at a time, and I need to run it multiple times to build my result table.
Example: myapi/getlist?limit=50&page=1 where page 1 is results 1-50, page 2 is results 51-100, etc.
How can make multiuple calls, updating page to page+1 each time, ultimately building one result table? The reading I've done on looping hasn't gotten me very far. Thanks! Dave
Solved! Go to Solution.
Hi @Asynchronism ,
pagination/paginate is the keyword you have to use: https://community.powerbi.com/t5/Desktop/how-to-create-a-query-that-paginates/td-p/20047/page/20
or:
https://www.youtube.com/watch?v=vhr4w5G8bRA
Imke Feldmann (The BIccountant)
If you liked my solution, please give it a thumbs up. And if I did answer your question, please mark this post as a solution. Thanks!
How to integrate M-code into your solution -- How to get your questions answered quickly -- How to provide sample data -- Check out more PBI- learning resources here -- Performance Tipps for M-queries
Hi @Asynchronism ,
pagination/paginate is the keyword you have to use: https://community.powerbi.com/t5/Desktop/how-to-create-a-query-that-paginates/td-p/20047/page/20
or:
https://www.youtube.com/watch?v=vhr4w5G8bRA
Imke Feldmann (The BIccountant)
If you liked my solution, please give it a thumbs up. And if I did answer your question, please mark this post as a solution. Thanks!
How to integrate M-code into your solution -- How to get your questions answered quickly -- How to provide sample data -- Check out more PBI- learning resources here -- Performance Tipps for M-queries
@ImkeF - got it working, thank you. Ended up doing it by records, not pages, but basically the same result
Here's what I ended up with:
url = "myapi/getlist?&limit=50&offset=0",
Source = ((Web.Contents(url, [Headers=[#"Content-Type"="application/json"]]))),
#"Imported JSON" = Json.Document(Source,65001),
Custom1 = List.Generate( () =>
[Result = #"Imported JSON", Offset = 0],
each [Result][response][count] > ([Offset]), //api returns a total record count as "count" in the response section
each [
Result = Json.Document(Web.Contents(url & "&offset=" & Text.From([Offset] + 50) )),
Offset = [Offset] + 50
]
),
Hi @ImkeF,
I've noticed you seem to be the go to person for looping API calls, was hoping you could go over my code and see where I'm going wrong.
This is what I've currently have -
let
ProjectID = "135353", // Type Dalux ProjectID
iterations = 20,
Bookmark1 = "0",
url = "https://field.dalux.com/service/APIv2/FieldRestService.svc/v2.2/Projects/" &
ProjectID &
"/Approvals?key=[API KEY]&bookmark=",
FnGetOnePage=
(url, Bookmark1) as record =>
let
Source = Json.Document(Web.Contents(url & Bookmark1)),
data = try Source[ApprovalsList] otherwise null,
next = try Source[NextBookmark] otherwise null,
res = [Data = data, Next = next]
in
res,
GeneratedList =
List.Generate(
() => [i=0, res = FnGetOnePage(url, Bookmark1)],
each [i] < iterations and [res][Data] <> null,
each [i=[i]+1, res = try FnGetOnePage(url & [res][Next]) otherwise null],
each [res]
)
in
GeneratedList
The image below is the result of the query:
The function is working and is able to call the first batch of results but then it fails to replace Bookmark1 for the Next cursor and terminates the list.
Any suggestions?
Thank you in advanced.
Best regards,
Ricardo.
That sure looks like what I'm after, thank you. Might have some follow up questions as I get into it!
I know I have seen @ImkeF solve this before.