Pagination from rest API - how to retrieve all the data

[Anonymous]

Hi,

We have been working with a support team from Successfactors to create an API key to PowerBi. 

There is a lot of data in the report so they added in pagination at the end as there were only 1,000 records appearing before that, now I am getting 100 records as that is my specified parameter in the rest API. 

How to I get the rest of the data to feed into my visuals from the pagination ?

Any help would be greatly appreciated!

"https://api012.successfactors.eu/odata/v2/EmpJob?&$expand=emplStatusNav,businessUnitNav,divisionNav,..."

[v-xicai]

Hi @Anonymous ,

Assuming you have connect codes below, you may change your rest API like "https://api.recruiterbox.com/v2/candidates?limit=1000&offset=0. "

let

Source = Json.Document(Web.Contents("https://api.recruiterbox.com/v2/candidates?limit=100&offset=0")),

objects = Source[objects],

expandrecords = Table.FromRecords(objects),

You can refer to the similar case: https://community.powerbi.com/t5/Desktop/API-calls-with-Pagination/td-p/569785.

Best Regards,

Amy

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Anonymous]

Hi Amy, 

We have changed the rest API to various parameters, it is limited at 1,000 records. When I increase in parameter from below to 2,500 - only 1,000 records show in the report. (I've taken out the middle part of the API where we select the columns), there are probably over 25,000 records in the report. 

http://api012.successfactors.eu/odata/v2/EmpJob?&xpand=/name&$format=json&fromstartDate=2019-08-25&c...