cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Johann_32
Helper I
Helper I

Incremental Refresh - Reducing "Load" on Datasource

Hello,

I wanted to understand the concept of incremental refresh and already did a test implementation and uploaded a dataset that has it configured, in our Power BI service.

 

The benefit of incremental refresh is, that,

 

- only data is loaded that is changing frequently

- only data is considered to be refreshed in a time interval that you are defining (RangeStart, RangeEnd).

 

But from a technical perspective, what does actually happen in the source system where the data is coming from?

Let's assume the data is coming from a SQL Database, is the stress/load now any higher or lower due to the incremental refresh?

 

I think the load on the database should decrease, as it only gets queried for few data, as where before it was always queried for the whole set of data.

 

Thank you.

Best Wishes

 

Johann

1 ACCEPTED SOLUTION
lbendlin
Super User
Super User

What really happens is that Power BI Service stores the results of the query against your data source in separate partitions. Based on how you specify your parameters it will then only run subqueries for the partitions that need to be updated, and will not run any queries for older partitions.

 

This will reduce the load on your source system, but only if you have an index on the field that you use for RangeStart/RangeEnd.

View solution in original post

1 REPLY 1
lbendlin
Super User
Super User

What really happens is that Power BI Service stores the results of the query against your data source in separate partitions. Based on how you specify your parameters it will then only run subqueries for the partitions that need to be updated, and will not run any queries for older partitions.

 

This will reduce the load on your source system, but only if you have an index on the field that you use for RangeStart/RangeEnd.

View solution in original post

Helpful resources

Announcements
UG GA Amplification 768x460.png

Launching new user group features

Learn how to create your own user groups today!

November Power BI Update 768x460.png

Check it Out!

Click here to read more about the November 2021 Updates!

M365 768x460.jpg

Microsoft 365 Collaboration Conference | December 7–9, 2021

Join us, in-person, December 7–9 in Las Vegas, for the largest gathering of the Microsoft community in the world.

Top Kudoed Authors