cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
vincentnoot
Resolver I
Resolver I

Incremental data load for API limit

Hi,

 

I have an API that limits my calls to 100 per minute. Because of this, I need to load historical data in 7 parts.

If I could load data part 1, then part 2 a minute later, part 3 a minute later, etc. There'd be no problem.

But I don't know how to do this in Power BI.

Is there any way to perform this task?

 

Thanks!

1 ACCEPTED SOLUTION

@vincentnoot , very old article, but see if this can help

https://blog.crossjoin.co.uk/2015/04/30/using-function-invokeafter-in-power-query/



Did I answer your question? Mark my post as a solution! Appreciate your Kudos!!
Dashboard of My Blogs !! YouTube Channel !! Connect on Linkedin

Proud to be a Super User!

View solution in original post

3 REPLIES 3
amitchandak
Super User IV
Super User IV

@vincentnoot , refer if this approach can help

https://www.myonlinetraininghub.com/scrape-data-multiple-web-pages-power-query



Did I answer your question? Mark my post as a solution! Appreciate your Kudos!!
Dashboard of My Blogs !! YouTube Channel !! Connect on Linkedin

Proud to be a Super User!

Hi @amitchandak 

 

Thanks for the quick reply as always!

I used this method to call the API multiple times, as the limit is 100 records per call.

However, the problem is that the  10 calls per minute limit is exceeded when I now try to load the data.

What my query should do is:

Query 1: Make 10 calls

Wait 1 minute

Query 2: Make 10 calls

Query 1: Append Query 2

Wait 1 minute

Etc.

@vincentnoot , very old article, but see if this can help

https://blog.crossjoin.co.uk/2015/04/30/using-function-invokeafter-in-power-query/



Did I answer your question? Mark my post as a solution! Appreciate your Kudos!!
Dashboard of My Blogs !! YouTube Channel !! Connect on Linkedin

Proud to be a Super User!

View solution in original post

Helpful resources

Announcements
PBI User Groups

Welcome to the User Group Public Preview

Check out new user group experience and if you are a leader please create your group!

MBAS on Demand

Microsoft Business Applications Summit sessions

On-demand access to all the great content presented by the product teams and community members! #MSBizAppsSummit #CommunityRocks

MBAS Attendee Badge

Claim Your Badge & Digital Swag!

Check out how to claim yours today!

secondImage

Are You Ready?

Test your skills now with the Cloud Skills Challenge.

Top Solution Authors