Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
Kpham
Resolver I
Resolver I

dataflow refresh history duration vs elapsed time

When I'm looking at my refresh history in dataflows the duration time doesn't look that bad. However when I hit the refresh button I need to wait for hours. In this case elapsed time has passed the 20 hours. When I just let them run it will eventually finish and it post a duration time of 5 minutes(?). Can you explain to why elapsed time and the duration is not the same?

 

Kpham_0-1615958911062.png

Kpham_1-1615958999871.png

 

 

1 ACCEPTED SOLUTION
v-eqin-msft
Community Support
Community Support

Hi @Kpham ,

 

The reason for refreshing taking too much time:

 

Too many datasets to refresh at the same time occupy CPU and memory, Insufficient gateway or underlying data source performance (busy on network / refresh), To refresh the model to be loaded into memory, it takes up 2 times the size of the data set, and you need to wait for memory resources.

 

 If a refresh is running a long time, you can select the dataflow options (the ellipses next to the dataflow) and then select Cancel refresh. Or scheduled the refresh of dataset at different time.

 

In addition, I found a same issue ,please check if it could help you a little.

 

https://community.powerbi.com/t5/Service/Dataflow-vs-Dataset-refresh/td-p/572076

https://medium.datadriveninvestor.com/my-dataset-is-taking-too-long-to-refresh-843fd8fd4a51

https://radacad.com/how-to-use-dataflow-to-make-the-refresh-of-power-bi-solution-faster

 

Best Regards,
Eyelyn Qin
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

1 REPLY 1
v-eqin-msft
Community Support
Community Support

Hi @Kpham ,

 

The reason for refreshing taking too much time:

 

Too many datasets to refresh at the same time occupy CPU and memory, Insufficient gateway or underlying data source performance (busy on network / refresh), To refresh the model to be loaded into memory, it takes up 2 times the size of the data set, and you need to wait for memory resources.

 

 If a refresh is running a long time, you can select the dataflow options (the ellipses next to the dataflow) and then select Cancel refresh. Or scheduled the refresh of dataset at different time.

 

In addition, I found a same issue ,please check if it could help you a little.

 

https://community.powerbi.com/t5/Service/Dataflow-vs-Dataset-refresh/td-p/572076

https://medium.datadriveninvestor.com/my-dataset-is-taking-too-long-to-refresh-843fd8fd4a51

https://radacad.com/how-to-use-dataflow-to-make-the-refresh-of-power-bi-solution-faster

 

Best Regards,
Eyelyn Qin
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors