cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
pratafran
Helper III
Helper III

Store and "freeze" column data prior refresh

Hello!

 

I have a tracking report with a list of shipments and their ETA-D (Estimated Time of Arrival to Destination).

 

My PBI refreshes every 30 min to reflect tracking information in a report and show the most recent ETA (pulled from online data source)

 

I want to create a measure to compare current ETA versus previous ETA and monitor if there are big changes (for example, a +1 week of delay vs previous ETA).

 

The problem is that when it automatically refreshes, I lost the previous data to make the comparisson.

 

Is there a way of storing data (like copy and pasting column values to another) upon refresh?, that way I would be able to keep two columns, the ETA that automatically refreshes and overwrite with the most recent date, and a secondary column "previous ETA" that is overwritted with the column ETA data prior each update.

 

Thanks

1 ACCEPTED SOLUTION
v-yuta-msft
Community Support
Community Support

@pratafran ,

 

I'm afraid this could not be achieved beacause power bi will not save the data which is not existing in the data source. When you refresh the dataset, if you have deleted the old data in your data source, these part of data will also not appear in power bi dataset.

 

Community Support Team _ Jimmy Tao

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

4 REPLIES 4
v-yuta-msft
Community Support
Community Support

@pratafran ,

 

I'm afraid this could not be achieved beacause power bi will not save the data which is not existing in the data source. When you refresh the dataset, if you have deleted the old data in your data source, these part of data will also not appear in power bi dataset.

 

Community Support Team _ Jimmy Tao

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Thanks everybody for the answers. Unfortunately it seems there is not solution yet for this.

 

I made a workaround by putting an intermediate process outside BI (macro downloading a daily copy of the tracking database to excel file in a folder) and then importing the folder to PBI (one file per day) and compiling them all in an histoical database. I eliminate duplicates and only keep the records where there is ETA changes, that way I'm able to have the log.

 

Regards

Hello,

Could you give me more info on the macro you made, please ? How did you do that ?

Greg_Deckler
Super User
Super User

This one has been asked quite a few times over the years. There are ways to do this but they are manual. May be some third party tool out there that can help. Probably some hacks and work-a-rounds but every 30 minutes, that's tough. For example, duplicate your query, load data, turn off refresh. But that will not work in your case I do not believe. Seems to me that you need to implement some sort of staging table where you can implement this logic and then point Power BI to that. Others may have better options.


@ me in replies or I'll lose your thread!!!
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
Learn Power BI 2nd Edition

Helpful resources

Announcements
Power Platform Conf 2022 768x460.jpg

Join us for Microsoft Power Platform Conference

The first Microsoft-sponsored Power Platform Conference is coming in September. 100+ speakers, 150+ sessions, and what's new and next for Power Platform.

Power BI Dev Camp Session 23 768x460.jpg

Check it Out!

Mark your calendars and join us on Thursday, June 30 at 11a PDT for a great session with Ted Pattison!

June 20 episode 7 with aka link 768x460.jpg

The Power BI Community Show

Join us on June 20 at 11 am PDT when Kim Manis shares the latest on Azure Synapse analytics, the Microsoft Intelligent Data Platform, and notable Power BI Updates from Microsoft Build 2022.

Top Solution Authors
Top Kudoed Authors