Is it possible to optimize data time refresh by distributing my tables in different dataflows?

[davidismaeloch]

Hello everyone!

I have a report that has around 20 tables, the data source is mainly connected by OData. It takes about 90 minutes or more to complete a refresh! 🤕 I will need to bring more tables into the model and for sure it will worsen the situation!!

I have the next idea but I want to hear any advice from the experts in PBI :

There are some tables in the model that doesn't need the same refreshes frequency as other tables, and I think I can use this as an advantage to create different Dataflows, each dataflow with disctinct scheduled refreshes. 

Let's say that Dataflow A has tables 1, 2, 3 with data refreshes every 3 hours. Dataflow B has tables 4 & 5 with one daily refresh. Dataflow C has table 6 with a refresh every 12 hours. And the Dataset created with these dataflows should have a refresh every 3 hours. 

Do you find this idea suitable to solve my problem?

Any advice is welcome!!

Thank you!

[v-rongtiep-msft]

Hi @davidismaeloch ,

Does that make sense? If so, kindly mark my answer as the solution to close the case please. Thanks in advance.

Best Regards

Community Support Team _ Polly

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[v-rongtiep-msft]

Hi @davidismaeloch ,

This is doable, if the refresh  interval is long. 

But you can learn more about refresh, it is  complex. So we cannot promise refresh by distributing your tables in different dataflows is faster than before.

The most significant point is that only Import mode datasets require a source data refresh. They require refresh because only this type of dataset imports data from its data sources, and the imported data might be updated on a regular or ad-hoc basis. DirectQuery datasets and datasets in LiveConnect mode to Analysis Services don't import data; they query the underlying data source with every user interaction. Datasets in push mode don't access any data sources directly but expect you to push the data into Power BI. Dataset refresh requirements vary depending on the storage mode/dataset type.

Data refresh in Power BI - Power BI | Microsoft Docs

Best Regards

Community Support Team _ Polly

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.