Incremental data load for API limit

[vincentnoot]

Hi,

I have an API that limits my calls to 100 per minute. Because of this, I need to load historical data in 7 parts.

If I could load data part 1, then part 2 a minute later, part 3 a minute later, etc. There'd be no problem.

But I don't know how to do this in Power BI.

Is there any way to perform this task?

Thanks!

[amitchandak]

@vincentnoot , refer if this approach can help

https://www.myonlinetraininghub.com/scrape-data-multiple-web-pages-power-query

[vincentnoot]

Hi @amitchandak 

Thanks for the quick reply as always!

I used this method to call the API multiple times, as the limit is 100 records per call.

However, the problem is that the  10 calls per minute limit is exceeded when I now try to load the data.

What my query should do is:

Query 1: Make 10 calls

Wait 1 minute

Query 2: Make 10 calls

Query 1: Append Query 2

Wait 1 minute

Etc.

[amitchandak · Accepted solution]

@vincentnoot , very old article, but see if this can help

https://blog.crossjoin.co.uk/2015/04/30/using-function-invokeafter-in-power-query/