cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
Frequent Visitor

Advice needed : On-Demand Refresh Optimization

Hello everyone !

I'll writte you to get some advice and best practices regarding the automation and optimization of the refresh of one of my dataset regarding stock history and forecast.
To help you out, I've illustrated the flows of my sources of data : 

Flow of data and refresh rate wantedFlow of data and refresh rate wantedSo I've built a tool to merge together stock history and stock projection on a rather aggregated level. 

I've got different sources of information that I gather to create one dataset which will be eventually used with a direct connection via Excel Publisher (the fact it ends up in Excel is not on my hand unfortunately).  

For the data in the past, I have a stock history table in Azure SQL Database, that I aggregate and format then append it to my main table. The load is pretty big and because of the aggregation it takes a couple of minutes. It can be refreshed weekly or daily. 

For the future though, it's only a small .csv file that's created/modified everytime users trigger a chain in the planning system. The file is stored on sharepoint and is formated then included in my dataset. 

I would like that when an on-demand refresh is made by the user, the dataset only refresh the future data (as the history won't change). To improve the responsiveness and allow multiple refresh per day  while my history data is refreshed via the scheduled refresh. 

Would incremental refresh work here ? 

Additional : Do you think I could use Microsoft Flow to trigger this (incremental) refresh each time my .CSV file is modified ? 

Thanks for your help and advice, let me know if anything wasn't clear. 

Regards, 
Kylo

 

 

 

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted
Community Support
Community Support

Re: Advice needed : On-Demand Refresh Optimization

HI @KyloRen ,

Current power bi not support to setting different schedule refresh plans on dataset tables.

For you scenario, I'd like to suggest you to use web connector to get sharepoint files and setting incremental refresh on azure sql table.

After you publish to service side, power bi will enable onedrive refresh on csv file and you can setting scheduled refresh of dataset to refresh azure sql database.

Notice:

1. Incremental refresh require premium license.
2. Please not use composite models on this report, it may disable onedrive refresh option.

Regards,
Xiaoxin Sheng

Community Support Team _ Xiaoxin
If this post helps, please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

2 REPLIES 2
Highlighted
Community Support
Community Support

Re: Advice needed : On-Demand Refresh Optimization

HI @KyloRen ,

Current power bi not support to setting different schedule refresh plans on dataset tables.

For you scenario, I'd like to suggest you to use web connector to get sharepoint files and setting incremental refresh on azure sql table.

After you publish to service side, power bi will enable onedrive refresh on csv file and you can setting scheduled refresh of dataset to refresh azure sql database.

Notice:

1. Incremental refresh require premium license.
2. Please not use composite models on this report, it may disable onedrive refresh option.

Regards,
Xiaoxin Sheng

Community Support Team _ Xiaoxin
If this post helps, please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

Highlighted
Frequent Visitor

Re: Advice needed : On-Demand Refresh Optimization

Thank you for your answer, that was what I expected : different schedule refresh plans on dataset tables is not (yet?) accepted. 

Incremental refresh would work so it's good to know. Now it's time to convince my company to go premium 😉 

Helpful resources

Announcements
Community Blog

Community Blog

Visit our Community Blog for articles, guides, and information created by fellow community members.

Using the Community

Using the Community

Need help with the Power BI Community? Our 'Using the Community' support articles are a great place to start.

Community Summit North America

Community Summit North America

Innovate, Collaborate, Grow. The top training and networking event across the globe for Microsoft Business Applications

Power Platform 2020 release wave 2 plan

Power Platform 2020 release wave 2 plan

Features releasing from October 2020 through March 2021

Top Solution Authors
Top Kudoed Authors