Datasource too big - Want to combine 2 datasets

[Satch]

Hi,

I have an enormous datasource, all existing of xml files comntaining data from 2018- nov 2021

So every update it's reading all those files again and again.

What I'm looking for is to make the current dataset/report stationairy.

Then in a new report I want to use that dataset.

The XML sources I will start again from 1 dec 2021

And add those xml records to the new set.

That way it only have to read the newest xml files whicht are a lot smaller of course.

But I cannot find how to combine it.

When I start a report on a existing dataset I cannot Add queries etc.

Any help is appreciated

[v-chenwuz-msft]

Hi @Satch ，

You mean incremetal refresh for files?

The main thing is to create a custom function. You can refer this following blog.

https://www.thepoweruser.com/2020/01/19/incremental-refresh-for-files-in-a-folder-or-sharepoint-powe... 

Best Regards

Community Support Team _ chenwu zhu

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Satch]

Thanks for your answer.

I have looked but it seems my xml files don't support the query folding...?

I can't config it on the table also (all options of start and endrange are greyed out)

Thus no incremental refresh.

What I'm looking for is that one big xml file (with the history records) is not refreshed every time.

And another one (with same structure and only the recent records) WILL be refreshed every time.

I tried with "Loading enabled" and "Include in report refresh" in the advanced editor etc, but still it is loading the big history file every time 😞

Maybe I do smth wrong 😞