cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
CarlsBerg999
Super User
Super User

Snapshots of data - Can datamart solve this issue?

Hi,

 

What i want to do is take snapshots of my data. My data source is Odata. Currently PowerBI doesn't support snapshots and the issue is that with each refresh, the new data overwrites the old data. What i want to do is take daily snapshots of my data and build a report on top of it to compare what changed between days 1 and 2. 

 

I watched some videos of Datamart and it seems to be a data warehouse (among other things). Can datamarts solve the "snapshot problem" that has been present so far in Power BI? How would this be done in data marts? I just made a data mart out of some data just to see what it is like and quite honestly i don't understand what the difference between a Dataset and Datamart is. I understand that Datamart does bring a lot of features online, but other than that this just seems to be an extra layer to perform the things we used to perform in Power BI Desktop. 

 

Any ideas on storing snapshots to datamart?

 

Thanks for all links, tutorials, ideas and help!

1 ACCEPTED SOLUTION
TomMartens
Super User
Super User

Hey @CarlsBerg999 ,

 

indeed datamarts come with some very promising features, to get started take a look here: Dataflows with benefits – BI Polar (ssbipolar.com)

Snapshotting data can become quite challenging, no matter if you are using PowerQuery/Dataflows or datamarts. This is mainly because of the fact that whenever a query retrieves data existing data will be overwritten. This is how it works.
This basic principle can be overcome when you use incremental refresh, then the new chunks of data will be added to the already existing data, the new chunk(s) will be appended.
The problem that you have to solve is this: retrieve the same set of data (the same except changes, deletions, updates, or inserts and providing an extra field - snapshot date.

Maybe, this article by @GilbertQ might help you and provide some ideas on how to tackle your challenge: How to configure Incremental Refresh with Power Query in Power BI - Data Analytics | FourMoo and Pow...

 

Regards,

Tom 



Did I answer your question? Mark my post as a solution, this will help others!

Proud to be a Super User!
I accept Kudos 😉
Hamburg, Germany

View solution in original post

1 REPLY 1
TomMartens
Super User
Super User

Hey @CarlsBerg999 ,

 

indeed datamarts come with some very promising features, to get started take a look here: Dataflows with benefits – BI Polar (ssbipolar.com)

Snapshotting data can become quite challenging, no matter if you are using PowerQuery/Dataflows or datamarts. This is mainly because of the fact that whenever a query retrieves data existing data will be overwritten. This is how it works.
This basic principle can be overcome when you use incremental refresh, then the new chunks of data will be added to the already existing data, the new chunk(s) will be appended.
The problem that you have to solve is this: retrieve the same set of data (the same except changes, deletions, updates, or inserts and providing an extra field - snapshot date.

Maybe, this article by @GilbertQ might help you and provide some ideas on how to tackle your challenge: How to configure Incremental Refresh with Power Query in Power BI - Data Analytics | FourMoo and Pow...

 

Regards,

Tom 



Did I answer your question? Mark my post as a solution, this will help others!

Proud to be a Super User!
I accept Kudos 😉
Hamburg, Germany

Helpful resources

Announcements
September Update

Check it Out!

Click here to learn more about the September 2022 updates!

Power BI Show episode 9

The Power BI Community Show

Watch the playback when Priya Sathy and Charles Webb discuss Datamarts! Kelly also shares Power BI Community updates.

Power BI Dev Camp Session 25

Ted's Dev Camp - August 25, 2022

Watch Session 25 of Ted's Dev Camp.

Top Solution Authors
Top Kudoed Authors