Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
Anonymous
Not applicable

Bizarre behaviour from 'Remove Duplicates'

What is going on here??

I've got a column with 63 rows, of which 19 are distinct values.

remove-duplicates-1.PNG

I right-click and select 'Remove Duplicates' (or use the button in the ribbon, it has the same effect).

remove-duplicates-2.PNG

I get a list of 4 values back! It has clearly removed non-distinct values from this list.

remove-duplicates-3.PNG

Why is this happening? And how do I get 'Remove Duplicates' to work as expected?

2 ACCEPTED SOLUTIONS

Hi @Anonymous 

 

Can you not use Group By Instead?

I wonder if you will get the same result.

 

Regards,
Mariusz

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

 

View solution in original post

Hi @Anonymous 

You can extend "Group By" by switching to advanced, like below.

image.png

 

21 unique values is probobly the right result as query editor previews serten amount of rows rather then loads whole table, so 19 unique values might have been incomplete.

 

 

View solution in original post

7 REPLIES 7
Mariusz
Community Champion
Community Champion

Hi @Anonymous 

You need to select both Columns

 

Regards,
Mariusz

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Anonymous
Not applicable

@Mariusz  Same thing still happens. Same result no matter how many columns I select.

remove-duplicates-4.PNG

remove-duplicates-5.PNG

Hi @Anonymous 

 

Can you not use Group By Instead?

I wonder if you will get the same result.

 

Regards,
Mariusz

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

 

Anonymous
Not applicable

@Mariusz  'Group By' does give me the expected list of results (21 unique, not 19 as previously indicated).

remove-duplicates-6.PNG

However I also lose the rest of the table, so it's not really a solution. Interesting that this works but 'Remove Duplicates' doesn't.

Hi @Anonymous 

You can extend "Group By" by switching to advanced, like below.

image.png

 

21 unique values is probobly the right result as query editor previews serten amount of rows rather then loads whole table, so 19 unique values might have been incomplete.

 

 

Anonymous
Not applicable

@Mariusz  That does give me the output I'd expect. I will mark it as a solution however I don't see it as the "right" solution. 'Remove Duplicates' clearly isn't behaving as expected and that's still the issue, even when using this workaround.

Thanks for your help!

Mariusz
Community Champion
Community Champion

@Anonymous 

Please ingore this comment Smiley Frustrated

Thanks

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.