Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
Anonymous
Not applicable

Update PowerBi via API

Hi!

 

How can I update a powerbi dataset gen2 differencing between full and incremental refresh. Every time that I have a dataset the first time is a full refresh and the others are incremental, I updated the dataset with API but is always refreshing incremental.

 

can I have a way to have the choice between an incremental or full refresh?. Also, I'm using gen2 and when I refresh the dataset at night took (23:00 hrs) 2 hours but in the morning at 7:00 a.m took 4 hours. Why exist a difference of time refreshing same dataset in different times? ( we have dedicate capacity)

 

thanks

 

 

1 ACCEPTED SOLUTION
v-eqin-msft
Community Support
Community Support

Hi @Anonymous ,

 

  • About Full load & Incremental refresh:

When you load data from the source into the destination (Power BI), there are two methods: Full Load, or Incremental Refresh. Full Load means fetching the entire dataset each time and wiping out the previous data.

 

If the dataset is small, or the refresh process is not taking a long time, then the full load is not a problem at all. The problem happens when either the dataset is big, or the refresh process takes longer than an acceptable timeframe.

 

Incremental Refresh is the process of loading only part of the data that might change, and adding it to the previous dataset which is not changing anymore.

 

  • About refresh time

Schedule your refreshes for less busy times, especially if your datasets are on Power BI Premium. If you distribute the refresh cycles for your datasets across a broader time window, you can help to avoid peaks that might otherwise overtax available resources. Delays starting a refresh cycle are an indicator of resource overload. If a Premium capacity is completely exhausted, Power BI might even skip a refresh cycle.

 

Refer to:

https://radacad.com/all-you-need-to-know-about-the-incremental-refresh-in-power-bi-load-changes-only

https://docs.microsoft.com/en-us/power-bi/connect-data/refresh-data

https://sqldusty.com/2020/05/20/power-bi-incremental-refresh-with-web-api-data-source/

 

Best Regards,
Eyelyn Qin
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

1 REPLY 1
v-eqin-msft
Community Support
Community Support

Hi @Anonymous ,

 

  • About Full load & Incremental refresh:

When you load data from the source into the destination (Power BI), there are two methods: Full Load, or Incremental Refresh. Full Load means fetching the entire dataset each time and wiping out the previous data.

 

If the dataset is small, or the refresh process is not taking a long time, then the full load is not a problem at all. The problem happens when either the dataset is big, or the refresh process takes longer than an acceptable timeframe.

 

Incremental Refresh is the process of loading only part of the data that might change, and adding it to the previous dataset which is not changing anymore.

 

  • About refresh time

Schedule your refreshes for less busy times, especially if your datasets are on Power BI Premium. If you distribute the refresh cycles for your datasets across a broader time window, you can help to avoid peaks that might otherwise overtax available resources. Delays starting a refresh cycle are an indicator of resource overload. If a Premium capacity is completely exhausted, Power BI might even skip a refresh cycle.

 

Refer to:

https://radacad.com/all-you-need-to-know-about-the-incremental-refresh-in-power-bi-load-changes-only

https://docs.microsoft.com/en-us/power-bi/connect-data/refresh-data

https://sqldusty.com/2020/05/20/power-bi-incremental-refresh-with-web-api-data-source/

 

Best Regards,
Eyelyn Qin
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors