Running mulitple datasets

[Anonymous]

Hi,

We have a few Power BI Workspaces to group the reports & datasets per department. 

Inside those workspace we don't have more than 8 datasets to show the necessary data.

The datasets will update everyday once. This is triggered by the API to start the dataset refresh. Why? Because we load our data first to our data platform and start only when this is loaded correctly, otherwise refresh will not start. 

All the datasets in the workspace are triggered on the same time, so mostly 8 datasets are refreshing together. But last weeks we have issues to refresh them. 1 of those datasets fail with following error: 

The refresh operation failed because it took too long to complete. Consider reducing the size of your dataset or breaking it up into smaller datasets.

I repeat: 1 random dataset fail. It's always another dataset and after manually retry it work correctly.

Is it possible there are problems running those all together?

king regards,

Davina

[Anonymous]

@GilbertQ Yes it's because there all running at once. 

We are triggering all the reports in 1 workspace to start refreshing with a comment in our data platform after all data are loaded. 

When we trigger 1 manually it works fine within an accept timing.

kind regards,

Davina 

[GilbertQ]

Hi @Anonymous 

I would suggest then trying to schedule the refresh so that they do not go off all at once!

[Anonymous · Accepted solution]

Thanks you all!

We will look to schedule them differently and not more all at once.

kind regards,

Davina

[v-yetao1-msft]

Hi @Anonymous 

In fact, 8 refreshes at the same time are not recommended .

https://docs.microsoft.com/en-us/power-bi/connect-data/refresh-data#best-practices 

Best Regards,
Community Support Team _ Ailsa Tao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[GilbertQ]

Hi @Anonymous 

Could it because all 8 are refreshing at once?

What if you had to stagger the refresh does it then work?