Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
Anonymous
Not applicable

Help With Column Disappearing on Combine and Transform

Hi Everyone,

 

I'm currently creating a table using multiple excel files inside a folder as a source. These excel files all have the same number of columns except 1 of them, which has an extra column called "Column ABC". Column ABC is being removed from the final table and I need it to show up. Does anyone have suggestions for this? 

 

combine.PNG

Thank you, 

 

PBInJelly1

1 ACCEPTED SOLUTION
watkinnc
Super User
Super User

The easiest way to stop this is to make sure that before you expand the tables, the table with the most columns at the top. Ideally this would be your "sample file" that you do your pre-combine transforms. First get the tables ordered how you need them, by created date or whatever. Then add an index column to keep that sort order. Then, use the Add Column GUI function to type:

each Table.ColumnCount([TheNameOfYourTableColumn])

Now, sort the ColumnCount column descending. Now when you expand the tables, all of your columns will be there, and the only nulls will be in the last column. If you run into a missing column error, add the MissingField.Ignore parameter as the last parameter of Table.ExpandTableColumn.

 

--Nate


I’m usually answering from my phone, which means the results are visualized only in my mind. You’ll need to use my answer to know that it works—but it will work!!

View solution in original post

3 REPLIES 3
watkinnc
Super User
Super User

The easiest way to stop this is to make sure that before you expand the tables, the table with the most columns at the top. Ideally this would be your "sample file" that you do your pre-combine transforms. First get the tables ordered how you need them, by created date or whatever. Then add an index column to keep that sort order. Then, use the Add Column GUI function to type:

each Table.ColumnCount([TheNameOfYourTableColumn])

Now, sort the ColumnCount column descending. Now when you expand the tables, all of your columns will be there, and the only nulls will be in the last column. If you run into a missing column error, add the MissingField.Ignore parameter as the last parameter of Table.ExpandTableColumn.

 

--Nate


I’m usually answering from my phone, which means the results are visualized only in my mind. You’ll need to use my answer to know that it works—but it will work!!
goncalogeraldes
Super User
Super User

Hello, could you provide the Advanced Query Editor steps? It may help to understand what is happening the combine step. Change all sensitive information if needed!

 

In the meantime, maybe these to videos can help you:

 

https://www.youtube.com/watch?v=nG-iIdb19Ng

https://www.youtube.com/watch?v=wKglApDFMog

 

Anonymous
Not applicable

*edited to removed advanced script*

 

Update - I found the solution in the video that you sent (see image). However, now that I added a list of column headers, all values have changed to null. This did not happen in the video. Do you have any ideas why it did this? 

 

listofcolumns.PNG

 

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors