cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
F75 Helper I
Helper I

Power BI Azure SQL Data IO - Best Practise

I am using Power BI to extract data from Azure SQL. My financial application has multi year data. In have a standard (pricing tier) Azure SQL subscription, when i refresh a table in Power BI (2 + Million records are refreshed)- the Azure SQL Data IO is being consumed. I am paying for overage.

 

Is there a best practise on data refresh in Power BI to limit Data IO? Data will be only changed in current year/period, there is no need to refresh historic data.

 

Thanks. 

1 ACCEPTED SOLUTION

Accepted Solutions
Moderator v-yuezhe-msft
Moderator

Re: Power BI Azure SQL Data IO - Best Practise

Hi @F75,

Currently, Power BI still performs a complete refresh of the data each time it refreshes.

What you describe is incremental refresh, this feature is not available in Power BI, an idea about this issue has been submitted in this link, please vote it up.

In your scenario, you can use other data source such as on-premises SQL Server database to host historic data, then append your new data. For more details, please review the following similar thread and blog.

https://community.powerbi.com/t5/Service/Question-Regarding-Data-Refresh-Frequency-and-History/td-p/...
http://www.thebiccountant.com/2016/02/09/how-to-create-a-load-history-or-load-log-in-power-query-or-...

 

Thanks,
Lydia Zhang

Community Support Team _ Lydia Zhang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

1 REPLY 1
Moderator v-yuezhe-msft
Moderator

Re: Power BI Azure SQL Data IO - Best Practise

Hi @F75,

Currently, Power BI still performs a complete refresh of the data each time it refreshes.

What you describe is incremental refresh, this feature is not available in Power BI, an idea about this issue has been submitted in this link, please vote it up.

In your scenario, you can use other data source such as on-premises SQL Server database to host historic data, then append your new data. For more details, please review the following similar thread and blog.

https://community.powerbi.com/t5/Service/Question-Regarding-Data-Refresh-Frequency-and-History/td-p/...
http://www.thebiccountant.com/2016/02/09/how-to-create-a-load-history-or-load-log-in-power-query-or-...

 

Thanks,
Lydia Zhang

Community Support Team _ Lydia Zhang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

Helpful resources

Announcements
New Ranks Launched March 24th!

New Ranks Launched March 24th!

The time has come: We are finally able to share more details on the brand-new ranks coming to the Power BI Community!

‘Better Together’ Contest Finalists Announced!

‘Better Together’ Contest Finalists Announced!

Congrats to the finalists of our ‘Better Together’-themed T-shirt design contest! Click for the top entries.

Arun 'Triple A' Event Video, Q&A, and Slides

Arun 'Triple A' Event Video, Q&A, and Slides

Missed the Arun 'Triple A' event or want to revisit it? We've got you covered! Check out the video, Q&A, and slides now.

Community Summit North America

Community Summit North America

Innovate, Collaborate, Grow. The top training and networking event across the globe for Microsoft Business Applications

Top Solution Authors
Top Kudoed Authors