Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
sumchak
Employee
Employee

Query on incremental refresh

Hi All,

My Database has one month of rolling data.Can I achieve to keep 3 months data in power bi by using incremental refresh ??

 

 

Regards,

Suman

10 REPLIES 10

Hi @sumchak,

 

yes, that should be possible.

 

Keep The Existing Data In Your Power BI Dataset And Add New Data To It Using Incremental Refresh https://blog.crossjoin.co.uk/category/incremental-refresh/

Did I answer your question?
Please mark my post as solution, this will also help others.
Please give Kudos for support.

Marcus Wegener works as Full Stack Power BI Engineer at BI or DIE.
His mission is clear: "Get the most out of data, with Power BI."
twitter - LinkedIn - YouTube - website - podcast


My data soruce having 1 month  of roling data. I have implemented the incremental refresh to store 3 month data and refresh data for 15 days. But during refresh its store 1month of the data only. unable to understand is anything I am missing.

Hi @sumchak,

 

do you use the Power BI service?

 

Did I answer your question?
Please mark my post as solution, this will also help others.
Please give Kudos for support.

Marcus Wegener works as Full Stack Power BI Engineer at BI or DIE.
His mission is clear: "Get the most out of data, with Power BI."
twitter - LinkedIn - YouTube - website - podcast


Yes , I am fetching data from log analytics where we have only one month of data.

Hi @sumchak,

 

can you share some screenshots?

 

Did I answer your question?
Please mark my post as solution, this will also help others.
Please give Kudos for support.

Marcus Wegener works as Full Stack Power BI Engineer at BI or DIE.
His mission is clear: "Get the most out of data, with Power BI."
twitter - LinkedIn - YouTube - website - podcast


s1.pngs2.jpgs3.jpgs4.jpg

Hi @sumchak ,

 

looks good to me. I would have now expected the amount of data to grow with every refresh in the Power BI Service.

Did I answer your question?
Please mark my post as solution, this will also help others.
Please give Kudos for support.

Marcus Wegener works as Full Stack Power BI Engineer at BI or DIE.
His mission is clear: "Get the most out of data, with Power BI."
twitter - LinkedIn - YouTube - website - podcast


But its not working as expected ..Can it be because the of the Soft delete or Hard delete in the source DB?

Hi @sumchak ,

 

the Detect data changes column should not be the same column used to partition the data.

 

https://docs.microsoft.com/en-us/power-bi/admin/service-premium-incremental-refresh#detect-data-chan...

Detect data change.png

Take a look at this video.

Power BI Incremental Refresh - Understanding Detect Data Changes

https://www.youtube.com/watch?v=JsJWBr1_ktQ

 

 

Did I answer your question?
Please mark my post as solution, this will also help others.
Please give Kudos for support.

Marcus Wegener works as Full Stack Power BI Engineer at BI or DIE.
His mission is clear: "Get the most out of data, with Power BI."
twitter - LinkedIn - YouTube - website - podcast


The implementation was correct but there are different sets of reasons why it wasn't working. 
Thanks for your help.


Conclusion: Incremental refresh shouldn't be implemented if the data source doesn't support the foldable query feature.

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.