Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Grow your Fabric skills and prepare for the DP-600 certification exam by completing the latest Microsoft Fabric challenge.

Reply
mds123
Frequent Visitor

Would incremental refresh in lakehouse allow me to add only today's data?

I'm currently looking at getting premium for the lakehouse and its warehouse capabilities. My main data sources include SQL Server and daily Excel files related to factory production and spend that are uploaded to SharePoint. A problem I have is users making changes to data in our data sources a few days or weeks after the data is made.

 

I want to be able to save that data into a lakehouse table and then, every night, automatically refresh the table to only add the new data. The new data would be based on the most recent file or a date field in SQL Server. Does Lakehouse support this behavior with an incremental refresh? If so, this would be huge and allow me to stop fearing losing old Excel files. I'm not very familiar with it and am a little confused. 

 

1 REPLY 1
CokeyKim
New Member

제 생각에는 MS Fabric의 기능 중 하나인
Dataflow Gen2를 이용한다면 가능할 것 같아요!

Dataflow Gen2는 Power Query 기반이기 때문에
관련 공식 기술 문서를 첨부드립니다.

https://learn.microsoft.com/ko-kr/fabric/data-factory/tutorial-setup-incremental-refresh-with-datafl...
https://learn.microsoft.com/ko-kr/power-bi/connect-data/incremental-refresh-overview

Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

Power BI Carousel June 2024

Power BI Monthly Update - June 2024

Check out the June 2024 Power BI update to learn about new features.

RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.