Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!
Hi PowerBI experts,
I am getting data from Excel files (around 400 files from a folder location). These excel files have yyyymm values starts at the cell J28. And i need to unpivot all the 12 yyyymm cell values starting from J28, e,g 202001,202002, .. to 202012.So So, basically i am skipping first 27 rows from sample excel file and then promote 28th row as column header and then apply unpivoting. All these steps i applied in transform query and defined as a function. Then i call this function as custom function in my main query to read all the excel files in similar manner.
Now as a performance tunning step, i have been asked to ETL all these excel files in SSIS and load into sql server tables.
I am bit struggling on data modelling. Can i load all excel files into a single target table and maintain sequence no dynamically while loading such as 1,2,3,.. so on. And then can i read data from the target table filter by sequence no =1 and then do the unpivoting steps and then loop the same unpivoting steps for sequence no =2 for next excel file, so on. These may be achieved through paramter in power query as a transofrm query and called in a main query to iterate through all sequence no.
I am new to M Language and not able to finding the way. Kindly please help me understand the options available in M Language to achieve this.
BR,
Umesh.
Solved! Go to Solution.
@Anonymous
There is a Query Parameter feature allows you to dynamically change the excel tables based on the sequence you selected. However, I am not sure whether you can bring the parameter together with Pbi dataset back to SQL. You may try export power bi dataset to SQL afterwards: Exporting Power BI Data to SQL Server (biinsight.com).
Please refer to my example for using parameter on excel files:
1. Connect to the folder that has all excel files, OK=>Transform.
2. Add an index column from 1, right click the index column=>add as new query.
3. Create the a parameter based on the new query.
4. Once parameter is created, set it as filter to the index column.
5. The final step is to expand the excel table, Close and Apply.
You then can dynamically change the displayed table data using parameter.
Paul Zheng _ Community Support Team
If this post helps, please Accept it as the solution to help the other members find it more quickly.
@Anonymous
There is a Query Parameter feature allows you to dynamically change the excel tables based on the sequence you selected. However, I am not sure whether you can bring the parameter together with Pbi dataset back to SQL. You may try export power bi dataset to SQL afterwards: Exporting Power BI Data to SQL Server (biinsight.com).
Please refer to my example for using parameter on excel files:
1. Connect to the folder that has all excel files, OK=>Transform.
2. Add an index column from 1, right click the index column=>add as new query.
3. Create the a parameter based on the new query.
4. Once parameter is created, set it as filter to the index column.
5. The final step is to expand the excel table, Close and Apply.
You then can dynamically change the displayed table data using parameter.
Paul Zheng _ Community Support Team
If this post helps, please Accept it as the solution to help the other members find it more quickly.
You have been asked to do that in SSIS. Not sure what that has to do with M?