cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
Helper I
Helper I

Re: Table Merge creates duplicate records

Hi I’m having the exact same issue when merging two tables, I see you posted that the issue lays with the data and not the merge, can I ask how you solved it? I’m pretty sure I have unique values so I believe that is not the issue, actually the merge is working on someone else’s computer but not on mine. Appreciate any hint you may provide.
Highlighted
Advocate I
Advocate I

Re: Table Merge creates duplicate records

Sadly, I still have not been able to fix this problem with the "Merge" feature.  I have resorted to using "Append" instead - and in some cases it works and in others it doesn't.  It is a very frustrating situation.

Highlighted
New Member

Re: Table Merge creates duplicate records

I got the same problem.

Source table is an daily order table with duplicated rows, i.e. SKU ID and merged with another matching table with unique rows of SKU ID, and created randomly duplicated rows.

 

Whatever I tried to remove duplicates or aggregated by median still not get the correct final data.

 

My order data could get up to 20K rows and it's easily get wrong while I merged the tables.

 

That is so annoying.

 

Hope POWER BI experts can really solve this problem.

 

Thanks.

Highlighted
Regular Visitor

Re: Table Merge creates duplicate records

Hi, is there anyone who can help with this? I have the same issue and there seems to be no solution for it apart from Table.First, but this function slows down the query...

Highlighted
Frequent Visitor

Re: Table Merge creates duplicate records

I just ran into the same problem and fixed it by joining the two tables on multiple fields.  For example, let's say a transaction number is the unique field you are joining on, expand the join to include other fields if possible.  So your joins would be on transaction number, time, and amount.  

Highlighted
Regular Visitor

Re: Table Merge creates duplicate records

Yes, that's what I've done too. However, even that solution created some duplicates as we don't have a one to one mappings in some cases. The only solution I could come up with (and one that would've slow down the query significantly) was to remove duplicates against the columns which then were used in merge. To make sure there's only one line per particular combination of columns. It's similar to how vlookup works. It brings up only the first occurrence for duplicates. However, since I'm new to PQ there might be things which I am not aware of. Thus waiting for some more experienced users to chip in.
Highlighted
Regular Visitor

Re: Table Merge creates duplicate records

I've had the same problem for some time now. It looks like it's 'fixed' after changing the privacy settings to 'Always ignore Privacy Level settings'.

Highlighted
Frequent Visitor

Re: Table Merge creates duplicate records

I changed the privacy settings and still have the issue too. To work around I just used the remove duplicates feature, I know this is not ideal but I know my table only has one line for each record.

Highlighted
Anonymous
Not applicable

Re: Table Merge creates duplicate records

I'm facing the same trouble here. Not sure why merging 2 tables create duplicates. Have anyone got a work around this? 

 

Update 9/10 : Problem Solved. My original first table already have got unique rows hence I should have merged it as aggregated values otherwise it will further expand the table, causing duplicates. Also, it helps to use and select more than one field as the key to look up if you need that level of granularity. 

Highlighted
New Member

Re: Table Merge creates duplicate records

Hi, I was having the same issue, and then I noticed that my second file, from where I was getting the data, had also duplicated figures. That was the problem. After I deleted those duplicates, I clicked on the refresh button, and the problem was solved!

Helpful resources

Announcements
August 2020 Community Challenge: Can You Solve These?

August 2020 Community Challenge: Can You Solve These?

We're excited to announce our first cross-community 'Can You Solve These?' challenge!

July 2020 Community Highlights

July 2020 Community Highlights

Learn about the exciting things that happened in July.

Upcoming Events

Upcoming Events

Wondering what events you could join or have an event to promote yourself? Check out our Upcoming Events.

Get Ready for Power BI Dev Camp

Get Ready for Power BI Dev Camp

We are thrilled to announce we will begin running a monthly webinar series named Power BI Dev Camp.

Top Solution Authors
Top Kudoed Authors