cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Johann_32
Helper I
Helper I

Incremental Refresh - Reducing "Load" on Datasource

Hello,

I wanted to understand the concept of incremental refresh and already did a test implementation and uploaded a dataset that has it configured, in our Power BI service.

 

The benefit of incremental refresh is, that,

 

- only data is loaded that is changing frequently

- only data is considered to be refreshed in a time interval that you are defining (RangeStart, RangeEnd).

 

But from a technical perspective, what does actually happen in the source system where the data is coming from?

Let's assume the data is coming from a SQL Database, is the stress/load now any higher or lower due to the incremental refresh?

 

I think the load on the database should decrease, as it only gets queried for few data, as where before it was always queried for the whole set of data.

 

Thank you.

Best Wishes

 

Johann

1 ACCEPTED SOLUTION
lbendlin
Super User
Super User

What really happens is that Power BI Service stores the results of the query against your data source in separate partitions. Based on how you specify your parameters it will then only run subqueries for the partitions that need to be updated, and will not run any queries for older partitions.

 

This will reduce the load on your source system, but only if you have an index on the field that you use for RangeStart/RangeEnd.

View solution in original post

1 REPLY 1
lbendlin
Super User
Super User

What really happens is that Power BI Service stores the results of the query against your data source in separate partitions. Based on how you specify your parameters it will then only run subqueries for the partitions that need to be updated, and will not run any queries for older partitions.

 

This will reduce the load on your source system, but only if you have an index on the field that you use for RangeStart/RangeEnd.

View solution in original post

Helpful resources

Announcements
Power BI December 2021 Update_carousel 768x460.jpg

Check it Out!

Click here to read more about the December 2021 Updates!

User Group Leader Meeting January 768x460.png

Calling all User Group Leaders!

Don't miss the User Group Leader meetings on January, 24th & 25th, 2022.

Jan 2022 Dev Camp 768x460 copy.png

Power BI Dev Camp- January 27th, 2022

Mark your calendars and join us for our next Power BI Dev Camp!