How to load only fresh rows and create an history table

[Joe1990]

Hey,

I'm loading data from a websource (http://www.rfs.nsw.gov.au/feeds/fdrToban.xml) that will refresh every day. This works fine, but I require a history table so I have previously loaded information saved.

I have solved this in excel with VBA, but no luck in BI yet.

Is anyone able to point me in the right direction on this one?

[v-yuta-msft]

@Joe1990 ,

Based on your description, so your requirement is to achieve a new table once the refreshed, right? If it is, I'm afraid currently power bi doesn't have this feature. The original table will be refreshed every time you click the "Refresh" button. And it's not suggested because the dataset size will be much larger if we save the whole table during each refresh.

Community Support Team _ Jimmy Tao

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Joe1990]

Yeah, this is true.

I have other means to limit the data, which I would pt in place once I have a working model (looking at around 250 records a year).

Ok, back to excel- thanks for your help.

[Joe1990]

@MattAllington,

Have you ever seen a work around for this sort of thing?