Power BI incremental refresh scenario

[Anonymous]

Hi Team,

We have a challenge on incremental refresh, we got few dimensions tables with LastUpdatedAt column, and all are imported to Power BI,

using the LastUpdatedAt we bring the recent changed record to PowerBI using Detect changes, but want to store all the rows from dimentions without any store range.

For example, Employee is dimesion table and we have data from 1990. We need to import all the data and store all, and refresh only recent changed record.

Thank you in advance

Regards,

Jyoti

[AnkitKukreja]

Hi @Anonymous 

What you could do here is just import all the data uptill Dec-2020 (or whatever suits you) into 1 table and then disable refresh for that table. This will keep your data static. Now you can add another table with data starting from Jan and append that into your 1st table or vice-versa.

This would keep your 1st table data (which is not refreshing) static and your 2nd table would be refreshing the latest data as per your needs.

Please mark it as a solution, if it answers your question.

Thanks and Regards,
Ankit
www.linkedin.com/in/ankit-kukreja1904

[v-yetao1-msft · Accepted solution]

Hi @Anonymous 

Incremental refresh is actually a "rolling window mode" . By default, refreshing data and storing data according to the period you set .

If you select the “Detect data changes” , It uses the maximum time of the time column you choose as the standard, and stores and refreshes the data according to the time period.

When a historical partition is no longer in the historical period defined by the policy, it is removed from the dataset entirely. So if you set incremental refresh for Employee table , the saved data will be scrolled forward, not all historical records will be kept .

For the conceptual issue of incremental refresh, you can refer to the link below:

https://docs.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview

Best Regards

Community Support Team _ Ailsa Tao

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.