cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Betho24 Frequent Visitor
Frequent Visitor

Re: Table Merge creates duplicate records

So, I am having the same issue and I just found your post and read it with hope. Although it has been helpful my issue is a little different just a tiny bit.

 

What I am doing is mergint two tables I am creating with M inside the advance query for one of my tables. In this operation I create two tables by doing a left anti join, that works fine.

 

I have table A that are all new leases.

I have table B with all terminated leases.

 

I want a single table C with both, so I need two columns, new lease, terminated lease. All this is fine so far.

I do then a nested join which is a left outer from the new leases to the terminated leases, so im keeping all that is new and just putting a false in those that are not.

 

The moment i merge is ok, but then when i expand the table is when booom, i get duplicates. The problem i just found is that while im using lease_id as my key to join, there are some that do not have that key because they are not leases, they are owned so it is a different number, and coincidentally those are the duplicated ones.

 

Any ideas on how to solve it ???

 

 

BIWORKS Frequent Visitor
Frequent Visitor

Re: Table Merge creates duplicate records

I am also facing the same issue.my both tables have duplicate rows. I want first column value to be picked only.
Highlighted

Re: Table Merge creates duplicate records

Hi people.

 

I've been looking for this issue with no luck as well until I founded a valid work around.

 

the work around goes like this ::

 

-Merge your sheets as you like (you don't have to merge on more than one column, one is fine).

 

-Add index column

 

-Expand your merged column (this will create duplicate values, the main issue we're looking into).

 

-since the values in the "index column" were purely unique, now Remove duplicates using index column.

 

-and now your data is back to original as it was inteded to be.

ksatpati Occasional Visitor
Occasional Visitor

Re: Table Merge creates duplicate records

Had the same issue, where I was merging queries.

The issue in my instance was that the base query was expanded which resulted in duplicates in the base query.

Once the expansion was removed in the base query the merged query was fine. 

So if data is okay, the issue may be caused by duplicates in the base query.

zzzzoooo Frequent Visitor
Frequent Visitor

Re: Table Merge creates duplicate records


@othmanalazzam wrote:

Hi people.

 

I've been looking for this issue with no luck as well until I founded a valid work around.

 

the work around goes like this ::

 

-Merge your sheets as you like (you don't have to merge on more than one column, one is fine).

 

-Add index column

 

-Expand your merged column (this will create duplicate values, the main issue we're looking into).

 

-since the values in the "index column" were purely unique, now Remove duplicates using index column.

 

-and now your data is back to original as it was inteded to be.


My duplicate issue is solved by applying this method. Thank you very much.

TKurt Frequent Visitor
Frequent Visitor

Re: Table Merge creates duplicate records

Can you explain "base query was expanded"?

RodgerB Frequent Visitor
Frequent Visitor

Re: Table Merge creates duplicate records

I've been working with a sales table and trying to create dimension tables from the table with all of the fields.  I've been frustrated, because I could not tell where the duplicate rows of data were coming from; however, could tell they happened after one of the two merge query steps.

 

I can affirm that having a unique index prior to the merge, and then removing duplicates from this field works.

 

Does anyone know why this occurs?

baronraghu Member
Member

Re: Table Merge creates duplicate records

Hi All,

 

I having similar issue, Below are the tables and the output after using full outer join

 

Table1 

image.png

 

Table 2

image.png

 

Merging query screenshot

image.png

 

Merged table with duplicate entries- actually it copies table 2 for each entry of table 1

image.png

 

Any solution

Helpful resources

Announcements
New Kudos Received Badges Coming

New Kudos Received Badges Coming

Kudos to you if you earned one of these! Check your inbox for a notification.

Microsoft Implementation for Communities Wins Award

Microsoft Implementation for Communities Wins Award

Learn about the award-winning innovation that was implemented across Microsoft’s Business Applications Communities.

Power Platform World Tour

Power Platform World Tour

Find out where you can attend!

Top Kudoed Authors (Last 30 Days)
Users online (2,937)