Merge of queries due to changed source files without destroying the current report structure

[Mathze03]

Hi forum,

I have a question regarding our report set. We use a Power BI report to measure the usage of a performance support system. For this we get around 28 different CSV files which you can download from the performance support system. Usually, these files hold all clicks etc. from the day of launch of the system until today. 

However, the system developers told us that they can no longer provide the entire data set (launch - today) as the files get apparently too big. We are now only able to download smaller sets, like last month, last week, etc.

I have developed a faily complex report set by now and wonder how I can tell Power BI that it should add the data from the new CSV files to the existing data set?

I'm aware of the function how to add data to a query (merge and attach). However, I'm afraid that I have to re-create everything based on a merged query as the current reports draw the info directly from CSV files, calculate some measure and feed this into all of my visiual. This doesn't work anymore with the new condition as I would only have the data from the last month. (I hope it is comprehensible. 🙂 )

Thanks a lot in advance.

Mathias 

[Mathze03]

Dear @aj1973 ,

thanks a lot for your quick reply and for your help. 🙂 This was indeed a very good hint. I tried to set-up a workflow via power automate. The disadvantage ist, that powerbi needs to transform the CSV files into JSON files first and then back into CSV files. That is actually not a big problem. The actual problem is that power automate can apparently only handle files up to 100 MBs. The main file has already a size of 150 MB. 

But again, basically you provided a suitable solution. Thank you!

[aj1973]

Hi @Mathze03 

This is where Power Automate will be your saver.