Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Earn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.

Reply
DarinSpence
Helper I
Helper I

Data Flow Gen2 Incremental Refresh

‎08-12-2023 06:06 PM

I have some dimension tables with a Time Updated column in Snowflake.  I'd prefer to SELECT from Snowflake only the rows with a Time Updated since the last refresh; and UPDATE the table in the Lakehouse.

 

Is there a method with Data Flow Gen2 to do something like Data Flow Gen1's incremental refresh?

Labels:
Message 1 of 3
222 Views
0
2 REPLIES 2
aj1973
Community Champion
Community Champion

‎08-12-2023 06:32 PM

Hi @DarinSpence 

In Power Query select the Date column and filtered to the last date.

Regards
Amine Jerbi

If I answered your question, please mark this thread as accepted
and you can follow me on
My Website, LinkedIn and Facebook

Message 2 of 3
209 Views
0
DarinSpence
Helper I
Helper I
In response to aj1973

‎08-12-2023 06:35 PM

When I tried that with Data Flow Gen2 Append, I got new; duplicate rows 😕

Message 3 of 3
198 Views
0

Helpful resources

Announcements
LearnSurvey

Fabric certifications survey

Certification feedback opportunity for the community.

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.

View All
Top Solution Authors
View All
Top Kudoed Authors
View All