Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.

Reply
brent_reffner
Frequent Visitor

Execute Dataflow Tables/Queries in Parallel

The dataflow refresh history allows you to see the execution times by table including start and end time. You can clearly see that tables are executed sequentially. I have not found any option which allows you to execute in parallel as you can in a dataset. Hopefully, this is something the Microsoft Power BI team will address.

 

Requested onDataflow nameDataflow refresh statusTable nameRefresh statusStart timeEnd timeDuration
10/13/2023 3:42Common DataflowCompletedCalendarCompleted10/13/2023 3:42:0210/13/2023 3:42:3300:31.1
10/13/2023 3:42Common DataflowCompletedCustomerCompleted10/13/2023 3:42:3310/13/2023 3:43:0400:30.5
10/13/2023 3:43Common DataflowCompletedItemCompleted10/13/2023 3:43:0410/13/2023 3:43:3500:30.6
3 REPLIES 3
edhans
Super User
Super User

Those are really small. I've got some dataflows with long running times and there is some concurrency.



Did I answer your question? Mark my post as a solution!
Did my answers help arrive at a solution? Give it a kudos by clicking the Thumbs Up!

DAX is for Analysis. Power Query is for Data Modeling


Proud to be a Super User!

MCSA: BI Reporting

I gave those as an example. The entire dataflow takes 45 minutes with the longest table taking 11 minutes.  When you say you have some concurrency, what do you mean and was that something you controlled?

Meaning I've seen times during the refresh where multiple tables/entities are refreshed in parallel.

 

But you have no control. It does what it does, and concurrency might be a factor of the license/capacity, dependencies, etc.



Did I answer your question? Mark my post as a solution!
Did my answers help arrive at a solution? Give it a kudos by clicking the Thumbs Up!

DAX is for Analysis. Power Query is for Data Modeling


Proud to be a Super User!

MCSA: BI Reporting

Helpful resources

Announcements
LearnSurvey

Fabric certifications survey

Certification feedback opportunity for the community.

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors