Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.
I am using Power BI to extract data from Azure SQL. My financial application has multi year data. In have a standard (pricing tier) Azure SQL subscription, when i refresh a table in Power BI (2 + Million records are refreshed)- the Azure SQL Data IO is being consumed. I am paying for overage.
Is there a best practise on data refresh in Power BI to limit Data IO? Data will be only changed in current year/period, there is no need to refresh historic data.
Thanks.
Solved! Go to Solution.
Hi @F75,
Currently, Power BI still performs a complete refresh of the data each time it refreshes.
What you describe is incremental refresh, this feature is not available in Power BI, an idea about this issue has been submitted in this link, please vote it up.
In your scenario, you can use other data source such as on-premises SQL Server database to host historic data, then append your new data. For more details, please review the following similar thread and blog.
https://community.powerbi.com/t5/Service/Question-Regarding-Data-Refresh-Frequency-and-History/td-p/...
http://www.thebiccountant.com/2016/02/09/how-to-create-a-load-history-or-load-log-in-power-query-or-...
Thanks,
Lydia Zhang
Hi @F75,
Currently, Power BI still performs a complete refresh of the data each time it refreshes.
What you describe is incremental refresh, this feature is not available in Power BI, an idea about this issue has been submitted in this link, please vote it up.
In your scenario, you can use other data source such as on-premises SQL Server database to host historic data, then append your new data. For more details, please review the following similar thread and blog.
https://community.powerbi.com/t5/Service/Question-Regarding-Data-Refresh-Frequency-and-History/td-p/...
http://www.thebiccountant.com/2016/02/09/how-to-create-a-load-history-or-load-log-in-power-query-or-...
Thanks,
Lydia Zhang
Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City
Check out the April 2024 Power BI update to learn about new features.