Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.

Reply
Rigolleto
Resolver I
Resolver I

DataFlow

Hi,

 I am really resh in this DataFlow world and at this point I am have some problems and Questions, here is a detail of them:

 

1. Do I need to add the refresh paremater in the desktop PBI(DataSet) as well as in the dataflow? both eviroments 

2. Even I added the incremental refresh to the dataflow this is taking long process time, hours, check my set up related wth this issue, dalily I am processing around of 1M of records, so only that total should be refeshed 

dataflow.png

 

Pending for any adivice about this topic, thanks in advance

 

R

1 ACCEPTED SOLUTION
m-colbert
Resolver II
Resolver II

@Rigolleto 

 

First question, incremental refresh can apply to a dataflow or a dataset. If you are importing a dataflow with incremental refresh into a dataset, then no, you don't need to specify incremental on the dataset. This is a benefit of using dataflows this way. 

 

Second, what is your backend data source? You'll want to be sure that query folding is taking place, otherwise incremental refresh will make matters worse.

 

Thanks

 

View solution in original post

1 REPLY 1
m-colbert
Resolver II
Resolver II

@Rigolleto 

 

First question, incremental refresh can apply to a dataflow or a dataset. If you are importing a dataflow with incremental refresh into a dataset, then no, you don't need to specify incremental on the dataset. This is a benefit of using dataflows this way. 

 

Second, what is your backend data source? You'll want to be sure that query folding is taking place, otherwise incremental refresh will make matters worse.

 

Thanks

 

Helpful resources

Announcements
RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

LearnSurvey

Fabric certifications survey

Certification feedback opportunity for the community.

Top Solution Authors
Top Kudoed Authors