Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
Anonymous
Not applicable

Incremental Refresh | What should I be looking out for?

Hi all,

 

I've been watching a lot of videos on Incremental Refresh on Youtube and reading a lot of documentation. A lot of people say to be very careful with this. I want to understand what exactly I have to be concerned about.


In my case, I am not using direct query only doing the import mode. I set my parameters very wide so I can keep all the data. Is there anything I should be looking out for or be concerned about when setting up the incremental refresh?

1 ACCEPTED SOLUTION
v-jingzhang
Community Support
Community Support

Hi @Anonymous 

 

I think the main concerns are introduced in this official document: Incremental refresh for datasets in Power BI - Power BI | Microsoft Docs

 

I would like to highlight below behavior in Incremental refresh. There are some earlier posts in the forum that hope to bring updated historical data into the dataset. However, this is not available. Historical data will only be brought into the dataset in the initial refresh in Power BI Service. Once rows with a date/time become part of the historical period, no matter how data is updated or even removed in the data source, these changes cannot be brought into the dataset in Power BI Service. So if you want to configure incremental refresh for a table, consider the duration for the refresh and historical range. This is important. 

 

082406.jpg

 

Another concern is that once you have published a model with incremental refresh policies to the service, it cannot be downloaded to local computers again. If you modify the local report and publish it again, it will remove any existing partitions and data already in the dataset. When you refresh the dataset in the service for the first time, it would be a new full refresh.  

 

082407.jpg

 

Hope this helps.

 

Regards,
Community Support Team _ Jing
If this post helps, please Accept it as the solution to help other members find it.

View solution in original post

2 REPLIES 2
v-jingzhang
Community Support
Community Support

Hi @Anonymous 

 

I think the main concerns are introduced in this official document: Incremental refresh for datasets in Power BI - Power BI | Microsoft Docs

 

I would like to highlight below behavior in Incremental refresh. There are some earlier posts in the forum that hope to bring updated historical data into the dataset. However, this is not available. Historical data will only be brought into the dataset in the initial refresh in Power BI Service. Once rows with a date/time become part of the historical period, no matter how data is updated or even removed in the data source, these changes cannot be brought into the dataset in Power BI Service. So if you want to configure incremental refresh for a table, consider the duration for the refresh and historical range. This is important. 

 

082406.jpg

 

Another concern is that once you have published a model with incremental refresh policies to the service, it cannot be downloaded to local computers again. If you modify the local report and publish it again, it will remove any existing partitions and data already in the dataset. When you refresh the dataset in the service for the first time, it would be a new full refresh.  

 

082407.jpg

 

Hope this helps.

 

Regards,
Community Support Team _ Jing
If this post helps, please Accept it as the solution to help other members find it.

parry2k
Super User
Super User

@Anonymous what is your concern? I'm implemented many incremental refresh solutions for my clients and never ran into any issue, if you make sure you are configuring as per documentation I don't think you should be concerned about anything. If there is any specific question/area you are concerned with, let me know.

 

Follow us on LinkedIn

 

Check my latest blog post The Power of Using Calculation Groups with Inactive Relationships (Part 1) (perytus.com) I would  Kudos if my solution helped. 👉 If you can spend time posting the question, you can also make efforts to give Kudos to whoever helped to solve your problem. It is a token of appreciation!

 

Visit us at https://perytus.com, your one-stop-shop for Power BI-related projects/training/consultancy.



Subscribe to the @PowerBIHowTo YT channel for an upcoming video on List and Record functions in Power Query!!

Learn Power BI and Fabric - subscribe to our YT channel - Click here: @PowerBIHowTo

If my solution proved useful, I'd be delighted to receive Kudos. When you put effort into asking a question, it's equally thoughtful to acknowledge and give Kudos to the individual who helped you solve the problem. It's a small gesture that shows appreciation and encouragement! ❤


Did I answer your question? Mark my post as a solution. Proud to be a Super User! Appreciate your Kudos 🙂
Feel free to email me with any of your BI needs.

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.