Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Grow your Fabric skills and prepare for the DP-600 certification exam by completing the latest Microsoft Fabric challenge.

Reply
GulianiG
Helper II
Helper II

Appending 3 files bring headers 3 times

I have 2 solutions to remove repeating headers from this combined data table

Ee IDEe NameEe Status

101

ABCaa
102DEFbb
Ee IDEe NameEe Status

103

dghsaa
104sfghbb
Ee IDEe NameEe Status

105

AgfBCaa
106DgtEFbb


Option 1: To promote 1st row as headers and use Does Not Contain Filter after

GulianiG_0-1694275058358.png

 

Option 2: Remove Duplicate Row from entire table

This option works too because no 2 rows are duplicate in the dataset except the repeating headers

Please suggest
1) Which one is more efficient- I have 30 tables with 6000 rows each to append
2) If there is a technique in combining multiple files from SharePoint folder that can avoid bringing duplicate headers

1 ACCEPTED SOLUTION
Greg_Deckler
Super User
Super User

@GulianiG Well, I would generally say whichever one supports query folding. However, if it is a SharePoint Folder, I do not believe that supports query folding. For the sake of future proofing, I would probably go with Option 1 as it seems like it would be less seceptible to future problems. Also, if query folding were in play, a simple filter would almost certainly fold.


Follow on LinkedIn
@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...

View solution in original post

3 REPLIES 3
GulianiG
Helper II
Helper II

@foodd AND @Greg_Deckler Thank you both
We will be moving sources to SQL soon, so query folding via filter advised would help

Greg_Deckler
Super User
Super User

@GulianiG Well, I would generally say whichever one supports query folding. However, if it is a SharePoint Folder, I do not believe that supports query folding. For the sake of future proofing, I would probably go with Option 1 as it seems like it would be less seceptible to future problems. Also, if query folding were in play, a simple filter would almost certainly fold.


Follow on LinkedIn
@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...

Yes, fully agree, Option 1, and perserve folding with a filter.

Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

MayPowerBICarousel1

Power BI Monthly Update - May 2024

Check out the May 2024 Power BI update to learn about new features.

Top Solution Authors
Top Kudoed Authors