Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
Anonymous
Not applicable

Data Flow Slow Refresh

Hello folks!

 

First time poster but long time visitor of the forums.

 

Recently I migrated one of my larger data models (about 16 entities from roughly 6 source files) into a data flow so it can be used with multiple datasets. However; my refresh times have since sky rocketed. When working with the dataset in desktop, I got a refresh time of roughly 30 seconds; versus now, which takes about 15 minutes to refresh. I took a look at the refresh log, and there isn't one entity holding the whole thing up, its just the bigger entities take 2-3 minutes, and the smaller ones take 1 or less.

 

Some details:

 - All queries are coming from a "web source" sharepoint folder, both now and before

 - The largest chunk of data is only 25k rows

 - Some entities are coming from other entities (query in a table of data, and then multiple different queries use that query as their source)

 - There are a lot of expansion transformations (splitting rows, not just columns)

 

From what I've read, data flows are supposedly faster than power query in desktop, so I was wondering if anyone else has had some trouble or advice.

1 ACCEPTED SOLUTION
GilbertQ
Super User
Super User

Hi there

Typically it is slower when using dataflows especially with a lot of transformations because using shared capacity it is sharing the memory and CPU. Whilst when you do this on desktop you got dedicated CPU and memory.

If there is no issue with it taking longer to refresh I would then leave it as is, yes it is taking longer but there is no impact to the reports.




Did I answer your question? Mark my post as a solution!

Proud to be a Super User!







Power BI Blog

View solution in original post

1 REPLY 1
GilbertQ
Super User
Super User

Hi there

Typically it is slower when using dataflows especially with a lot of transformations because using shared capacity it is sharing the memory and CPU. Whilst when you do this on desktop you got dedicated CPU and memory.

If there is no issue with it taking longer to refresh I would then leave it as is, yes it is taking longer but there is no impact to the reports.




Did I answer your question? Mark my post as a solution!

Proud to be a Super User!







Power BI Blog

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors