Using DataFlow and keep data that is deleted in the source.

[Anonymous]

Im using DataFlow to integrate data from a SQL database into Powerbi dashboard. The source that im using will only keep one week of history however i want the DataFlow to retain more then that specific week. What would be the options for me to enable this?

[collinq]

Hey @Anonymous ,

That would be a bit tricky out of the box. 

I do have an idead that MIGHT work in the dataflow but most likely would work in the desktop.  If you made a new table in that Dataflow and then appended your weekly dataflow table to it then you would have the larger table that has all of your data.

The next thing that you might try is to use Power Automate instead to get the data and put it together.

[Anonymous]

Thanks @collinq ,

I hope you dont mind me asking, but how would i do that? Im only aware of 'loading' from a source using dataflow. I have not yet seen options to 'çopy to'

Please advice

[collinq]

Hi @Anonymous ,

In the Dataflow you would have to use the Append function to move the data.  There is not a "copy" function as you point out.  So, part of the process would be to bring in table 1, then append that to table 2 and so every week when table 1 changes, it just keeps adding to table 2.

[Anonymous]

Are you talking about Azure DataFactory or DataFlow as part of PowerBI?

[Anonymous]

Could you perhaps provide a screenshot?