Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.
Hi All,
Can you help, I'm running the latest Power BI Desktop. I'm getting data from a folder. This folder thousands of files.
My thought was to filter out the unrequired files, via steps, then reference these. for the following queries
I would then combine the files, of interest into their own query (all transactions for example); however the performance on filtering the list of files current, is very very slow, any suggestions
If this a problem with Power Query, my technique etc...
Regards,
Mathew
Hi @101Mathew ,
If I understand your requirement correctly that you want to filter out the unrequired files in Query Editor when get data from Folder connector.
If it is, you could use the query below to filter your files.
= Table.SelectRows(Source, each (Text.Contains([Extension],"."))) = Table.SelectRows(Source, each (Text.Contains([Extension],".txt")))
Here is the test output.
You also could modify the value in "" based on your requirement.
Best Regards,
Cherry
Hi @v-piga-msft ,
Thanks for taking the time to respond
I understand how to filter, the problem is the performance, it's SO SLOW. It is going through 1000s of files but still
So I'm unsure if my technique of all files, reference all file, then filter to the next sections, then reference and filter the next section is causing the issue.
Regards,
Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City
Check out the April 2024 Power BI update to learn about new features.