Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.

Reply
landrade
New Member

Incremental Refresh deleted all history data

Hello

 

We have an incremental refresh setup to keep data for 5 years and refresh the last month,

the first week in October, after the refresh, all the historical data for two years are removed.

 

Is this a know issue?

We can reload, which will take a long time and we do not know what caused it and if it will happen again

1 ACCEPTED SOLUTION
v-yangliu-msft
Community Support
Community Support

Hi  @landrade ,

According to the documentation, incremental refresh will delete the historical partition, When a historical partition is no longer in the historical period defined by the policy, it is removed from the dataset entirely. This is known as a rolling window pattern.

vyangliumsft_0-1667348289271.png

Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn

If you feel that the processing of historical partitions by Power BI incremental refresh does not meet expectations, you can connect to this dataset through external tools (such as ssms, tabular editor) to check the configuration of historical partitions.

Dataset connectivity and management with the XMLA endpoint in Power BI - Power BI | Microsoft Learn

Advanced incremental refresh and real-time data with the XMLA endpoint in Power BI - Power BI | Micr...

 

Best Regards,

Liu Yang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

2 REPLIES 2
v-yangliu-msft
Community Support
Community Support

Hi  @landrade ,

According to the documentation, incremental refresh will delete the historical partition, When a historical partition is no longer in the historical period defined by the policy, it is removed from the dataset entirely. This is known as a rolling window pattern.

vyangliumsft_0-1667348289271.png

Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn

If you feel that the processing of historical partitions by Power BI incremental refresh does not meet expectations, you can connect to this dataset through external tools (such as ssms, tabular editor) to check the configuration of historical partitions.

Dataset connectivity and management with the XMLA endpoint in Power BI - Power BI | Microsoft Learn

Advanced incremental refresh and real-time data with the XMLA endpoint in Power BI - Power BI | Micr...

 

Best Regards,

Liu Yang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Tutu_in_YYC
Resident Rockstar
Resident Rockstar

Never had that issue before. But have you checked the partitions in SSMS?


Helpful resources

Announcements
PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

Top Solution Authors
Top Kudoed Authors