Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
Ballabh
Frequent Visitor

Incremental Refresh

Hi All,

 

I have been trying to get incremental refresh wotking on one of my tables since 2 days with no success. I have gone trhought he docs and also watched few videos but nothing seems to work. I have a premium per user license.

 

Need help 

 

Regards

Ballabh

1 ACCEPTED SOLUTION
otravers
Community Champion
Community Champion

Yes, perfect. Change the parameters and Business Date column from Date to Date/Time data type:

https://docs.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-configure#create-paramete...

------------------------------------------------
1. How to get your question answered quickly - good questions get good answers!
2. Learning how to fish > being spoon-fed without active thinking.
3. Please accept as a solution posts that resolve your questions.
------------------------------------------------
BI Blog: Datamarts | RLS/OLS | Dev Tools | Languages | Aggregations | XMLA/APIs | Field Parameters | Custom Visuals

View solution in original post

20 REPLIES 20
otravers
Community Champion
Community Champion

Hi, you're going to have to be way more specific about what you've tried, it's impossible to help you with such a vague question. Explain what you did, where you did it (e.g. desktop, service), and include screenshots. See the first link in my signature.

------------------------------------------------
1. How to get your question answered quickly - good questions get good answers!
2. Learning how to fish > being spoon-fed without active thinking.
3. Please accept as a solution posts that resolve your questions.
------------------------------------------------
BI Blog: Datamarts | RLS/OLS | Dev Tools | Languages | Aggregations | XMLA/APIs | Field Parameters | Custom Visuals

Environment - PowerBi connected to local Sql Server

Current Process - Whenever we update new data in Sql, we refresh the complete data which takes almost 1.5 hours as there are more than 27 million lines. Once the data is refreshed in power bi desktop, we publish the same for all users.

Assumption : Incremental refresh would reduce the time as it would refresh only the delta data.

 

Step Taken as below

Table Name - Articlewisesale

Column Name - Business Date

1. Clicked on transform data

2. created 2 parameters

    RangeStart = 01/01/2020

    RangeEnd = 31/12/2025

3. Custom filtered the column business date with above parameters

4. Complete data got loaded once.

5. not able to get rid below error

SS.png

HRM5
Frequent Visitor

Hi @Ballabh 

I am stuggling with this same issue!! I have the DateTime format on my parameters and Column.. Please help! @otravers 

otravers
Community Champion
Community Champion

Can you post screenshots so that we have more details about your issue?

------------------------------------------------
1. How to get your question answered quickly - good questions get good answers!
2. Learning how to fish > being spoon-fed without active thinking.
3. Please accept as a solution posts that resolve your questions.
------------------------------------------------
BI Blog: Datamarts | RLS/OLS | Dev Tools | Languages | Aggregations | XMLA/APIs | Field Parameters | Custom Visuals
HRM5
Frequent Visitor

Hi @otravers 

Acutally, I have implemented the Incremental refresh on a table but its taking the same time to refresh as the Normal Full Refresh.

Any Ideas? what will be wrong?

otravers
Community Champion
Community Champion

Read the part about query folding in the following doc, lack of query folding is the most likely reason why incremental is not really happening and you end up doing full refreshes:

https://docs.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview#query-folding

------------------------------------------------
1. How to get your question answered quickly - good questions get good answers!
2. Learning how to fish > being spoon-fed without active thinking.
3. Please accept as a solution posts that resolve your questions.
------------------------------------------------
BI Blog: Datamarts | RLS/OLS | Dev Tools | Languages | Aggregations | XMLA/APIs | Field Parameters | Custom Visuals
HRM5
Frequent Visitor

Hi @otravers 
how to verify that and I have already applied incremental refresh what should I do?

otravers
Community Champion
Community Champion

https://docs.microsoft.com/en-us/power-query/power-query-folding

------------------------------------------------
1. How to get your question answered quickly - good questions get good answers!
2. Learning how to fish > being spoon-fed without active thinking.
3. Please accept as a solution posts that resolve your questions.
------------------------------------------------
BI Blog: Datamarts | RLS/OLS | Dev Tools | Languages | Aggregations | XMLA/APIs | Field Parameters | Custom Visuals
otravers
Community Champion
Community Champion

Can you show your filter step in Power Query for the Articlewisesale table?

------------------------------------------------
1. How to get your question answered quickly - good questions get good answers!
2. Learning how to fish > being spoon-fed without active thinking.
3. Please accept as a solution posts that resolve your questions.
------------------------------------------------
BI Blog: Datamarts | RLS/OLS | Dev Tools | Languages | Aggregations | XMLA/APIs | Field Parameters | Custom Visuals

I hope I sent you the correct screenshot

otravers
Community Champion
Community Champion

Yes, perfect. Change the parameters and Business Date column from Date to Date/Time data type:

https://docs.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-configure#create-paramete...

------------------------------------------------
1. How to get your question answered quickly - good questions get good answers!
2. Learning how to fish > being spoon-fed without active thinking.
3. Please accept as a solution posts that resolve your questions.
------------------------------------------------
BI Blog: Datamarts | RLS/OLS | Dev Tools | Languages | Aggregations | XMLA/APIs | Field Parameters | Custom Visuals

HI.. Just wanted to ask if I can continue with this thread. Although you have solved my initial query. I did all the configs.. but when I refreshed the data today, it again took the complete 27.2 million lines

otravers
Community Champion
Community Champion

The first refresh in the service has to be complete to create historical partitions.

------------------------------------------------
1. How to get your question answered quickly - good questions get good answers!
2. Learning how to fish > being spoon-fed without active thinking.
3. Please accept as a solution posts that resolve your questions.
------------------------------------------------
BI Blog: Datamarts | RLS/OLS | Dev Tools | Languages | Aggregations | XMLA/APIs | Field Parameters | Custom Visuals

Can you please guide me on how can I do that.. Please

otravers
Community Champion
Community Champion

This is handled for you by the Power BI service, subsequent refreshes after the initial one will be incremental per the rules you defined in the desktop:

https://docs.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-configure#refresh-dataset

------------------------------------------------
1. How to get your question answered quickly - good questions get good answers!
2. Learning how to fish > being spoon-fed without active thinking.
3. Please accept as a solution posts that resolve your questions.
------------------------------------------------
BI Blog: Datamarts | RLS/OLS | Dev Tools | Languages | Aggregations | XMLA/APIs | Field Parameters | Custom Visuals

Hi.. It Still didnt worked as expected, attaching a few screenshots of the settings which I have done, i hope they are helpful in identifying my miss outs. Please helpSettings Page.pngParamters in Settings page.pngrefresh history.pngGateway.pngIncremental Refresh.png

Thanks.. I will follow this and will get to know the impact tomorrow.  Will reach out to you again.. Thanks once again

Thanks a ton. You are awesome. Now I know exactly the place to come to for my Power BI queries.

 

Thanks once again.

Ok. Will get back in an hour and a half as the change will again load the complete data once. Thanks a lot helping

SS1.png

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors