cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
Helper II
Helper II

2 Datasets Refreshing at the same time

There are certain hours throughout the day where I have 1 very large Dataset refreshing at the same time as 1 very small Dataset, and they seem to impact eachother.

 

For example:

Large Dataset refresh time is typically 1 hour, every 3 hours.

Small Dataset refresh time is typically 3 minutes, every 30 minutes.

 

When the two overlap, the Small Dataset can run for up to 30 minutes.

 

Is it expected to see that impact?  Is there a way to give priority to the Smaller Dataset?

4 REPLIES 4
Highlighted
Community Support
Community Support

Re: 2 Datasets Refreshing at the same time

Hi @cassidy ,

If these two datasets configured under the same gateway, it is a normal phenomenon. 

When different datasets are refreshed in parallel under the same gateway, the gateway resources will be occupied at the same time. The refreshing time for a small dataset is naturally longer than the time for a single refresh of this dataset.


Currently, there is no option to select the refresh priority for the data set. We recommend that you avoid the same time period when configuring the scheduled refresh for each dataset to reduce resource occupation, and if your dataset has data sources from the cloud, you can refresh it directly through the cloud without configuring a gateway for it. In addition, you can also refer this document  to adding a gateway cluster.

 

Best Regards,
Yingjie Li

If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

Highlighted
Helper II
Helper II

Re: 2 Datasets Refreshing at the same time

Thanks for the response @v-yingjl .  Neither Dataset uses a gateway, both pull from predominantly from Dataflows or an Azure Database.  Does that change anything about your recommendations?

Highlighted
Community Support
Community Support

Re: 2 Datasets Refreshing at the same time

Hi @cassidy ,

It is a better suggestion to avoid refreshing different datasets in the same time period in power bi service currently regardless of whether you use a gateway or not.

In addition, here is an idea about refresh priority in power bi service, you can vote for it to help us improve power bi and making this feature coming sooner.

 

Best Regards,
Yingjie Li

If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

Highlighted
Community Support
Community Support

Re: 2 Datasets Refreshing at the same time

Hi @cassidy ,

If you've fixed the issue on your own please kindly share your solution. If the above posts help, please kindly mark it as a solution to help others find it more quickly. Thanks!


Best Regards,
Yingjie Li

Helpful resources

Announcements

August Community Highlights

Check out a full recap of the month!

August 2020 CYST Challenge

Check out the winners of the recent 'Can You Solve These?' community challenge!

Experience what’s next for Power BI

Join us for an in-depth look at the new Power BI features and capabilities at the free Microsoft Business Applications Launch Event.

Top Solution Authors
Top Kudoed Authors