Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!
I have data that includes entirely duplicated rows - every column is the same. I want to remove them. Annoyingly I can't do it in the data source so I have to do it in query editor.
I can't use the "Remove Duplicates" function becuase that only removes duplicates using a single column and that's not what I need as there are supposed to be duplicates in the columns. Here's an example:
I have a table with ID and Time.
ID Time
1 10.00
2 10.00
3 10.00
1 11.00
2 11.00
3 11.00
3 11.00
It is only the last row that I want to remove - that's the only row with duplciates across all columns. If I remove dupicates using ID I'm left with the first 3 rows only and if I remove duplicates using Time I'm left with rows 1 and 4.
Currently I get around this by concatenating the columns and removing duplicates based on the concatenated column and this works but I was wondering if there was a native solution.
Thanks.
Solved! Go to Solution.
Hi, select both columns and Remove Rows-Duplicate.
Regards
Victor
User | Count |
---|---|
128 | |
108 | |
100 | |
64 | |
62 |
User | Count |
---|---|
136 | |
113 | |
102 | |
71 | |
60 |