cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
New Member

Dataset refresh process

Hi all,

After a long search in a lot of PBI documentation, I still couldn't find the answer on such question: "What is exactly happening with datasource when you press Refresh in PBI Service"? I understand the basic process (I hope at least) like that it sends PQ queries through the enterprise Gateway to the main datasource (we use Redshift) and then returns the results back and if refresh somehow fails, it magical way keeps the previous successfully refreshed data, but what about the details? What is happening with the dataset as an object in workspace during refresh: does it keep some copy of previous data refresh or it starts to update immidiately by getting the queries results - what if some error happens? How PBI recovers the previous dataset version?

Thank you in advance:)

Ekaterina.

1 ACCEPTED SOLUTION
Super User II
Super User II

Hi there

 

At a very basic level this is how the Refresh process works

  • You click to start the refresh process.
  • In the background Power BI creates an empty copy of the table/dataset.
    • In this background table/dataset it loads all the new data.
  • When the refresh process is complete it then does a metadata switch (which happens in milliseconds) and switches the background table with the current table.
    • If there are queries happening it will wait for a specific amount of time before forcing the switch of tables.
  • That is why if the refresh fails the current table stays as is.

 

I hope that helps.





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!







Power BI Blog

View solution in original post

1 REPLY 1
Super User II
Super User II

Hi there

 

At a very basic level this is how the Refresh process works

  • You click to start the refresh process.
  • In the background Power BI creates an empty copy of the table/dataset.
    • In this background table/dataset it loads all the new data.
  • When the refresh process is complete it then does a metadata switch (which happens in milliseconds) and switches the background table with the current table.
    • If there are queries happening it will wait for a specific amount of time before forcing the switch of tables.
  • That is why if the refresh fails the current table stays as is.

 

I hope that helps.





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!







Power BI Blog

View solution in original post

Helpful resources

Announcements
secondImage

Happy New Year from Power BI

This is a must watch for a message from Power BI!

December Update

Check it Out!

Click here to read more about the December 2020 Updates!

Community Blog

Check it Out!

Click here to read the latest blog and learn more about contributing to the Power BI blog!

Get Ready for Power BI Dev Camp

Get Ready for Power BI Dev Camp

Mark your calendars and join us for our next Power BI Dev Camp!.

Top Solution Authors