Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
walid140891
Helper III
Helper III

Incremental Refresh of data coming from Rest API or Json file

Hello,

We are totally new to power bi and we are struggling to set the incremental refresh in order to save historical data coming from a rest API and incrementally refresh the new recent changes.

 

The question is: Is the incremental refresh not highly recommended for data coming from web feed (rest API) and json files due to the query folding? if yes, is there any alternative?

 

Thank you in advance.

1 ACCEPTED SOLUTION

Finally we could make the incremental refresh for data coming from rest API by following the tips in this link:

 

https://sqldusty.com/2020/05/20/power-bi-incremental-refresh-with-web-api-data-source/

 

Thank you @ibarrau .

View solution in original post

4 REPLIES 4
ibarrau
Super User
Super User

Hi. I wouldn't recommend using incremental refresh with api. I don't even think you can do it. Incremental Refresh is not for every data source and must contain query folding in order to do it properly.

The best idea of having historic api data is building a script or using datafactory to populate a database, data lake or warehouse with the data. You can use Azure services to make it simple and keep in cloud. For example azure funcions calling the api and inserting the file of the day in azure data lake gen2. You can also use services like data factory requesting the api and saving data in database.

Hope this helps,


If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Happy to help!

LaDataWeb Blog

Hello @ibarrau,

 

I really appreciate your answer, but for the moment we don't have that capabilities and time frame to apply the Azure workaround that you have mentioned, Do you have any other solution?

 

Thank you.

Well, you can always go ahead and do it on premise in a VM. If you don't have an azure subscription to make this easier you can write a code and run it in a local machine. Then with a Data Gateway keep Power Bi up to date.

Regards,


If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Happy to help!

LaDataWeb Blog

Finally we could make the incremental refresh for data coming from rest API by following the tips in this link:

 

https://sqldusty.com/2020/05/20/power-bi-incremental-refresh-with-web-api-data-source/

 

Thank you @ibarrau .

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors