cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Satch
Helper III
Helper III

Datasource too big - Want to combine 2 datasets

Hi,

 

I have an enormous datasource, all existing of xml files comntaining data from 2018- nov 2021

So every update it's reading all those files again and again.

 

What I'm looking for is to make the current dataset/report stationairy.

 

Then in a new report I want to use that dataset.

The XML sources I will start again from 1 dec 2021

And add those xml records to the new set.

 

That way it only have to read the newest xml files whicht are a lot smaller of course.

But I cannot find how to combine it.

When I start a report on a existing dataset I cannot Add queries etc.

 

Any help is appreciated

2 REPLIES 2
v-chenwuz-msft
Community Support
Community Support

Hi @Satch ,

 

You mean incremetal refresh for files?

The main thing is to create a custom function. You can refer this following blog.

https://www.thepoweruser.com/2020/01/19/incremental-refresh-for-files-in-a-folder-or-sharepoint-powe... 

 

Best Regards

Community Support Team _ chenwu zhu

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Thanks for your answer.

I have looked but it seems my xml files don't support the query folding...?

I can't config it on the table also (all options of start and endrange are greyed out)

Thus no incremental refresh.

 

What I'm looking for is that one big xml file (with the history records) is not refreshed every time.

And another one (with same structure and only the recent records) WILL be refreshed every time.

 

I tried with "Loading enabled" and "Include in report refresh" in the advanced editor etc, but still it is loading the big history file every time 😞

Maybe I do smth wrong 😞

Helpful resources

Announcements
June 2022 update 768X460.jpg

Check it out!

Click here to read more about the June 2022 updates!

Power Platform Conf 2022 768x460.jpg

Join us for Microsoft Power Platform Conference

The first Microsoft-sponsored Power Platform Conference is coming in September. 100+ speakers, 150+ sessions, and what's new and next for Power Platform.

Power BI Dev Camp Session 23 768x460.jpg

Check it Out!

Mark your calendars and join us on Thursday, June 30 at 11a PDT for a great session with Ted Pattison!

June 20 episode 7 with aka link 768x460.jpg

The Power BI Community Show

Join us on June 20 at 11 am PDT when Kim Manis shares the latest on Azure Synapse analytics, the Microsoft Intelligent Data Platform, and notable Power BI Updates from Microsoft Build 2022.

Top Solution Authors