Power Query M doesn't remove duplicates

[DenisBergeron]

Hello Fellows PowerBI USers,

I have that Excel sheet producced made by our DBA from a SQL Query.

In this sheet I have a ID that use sequentiel numeric value, for some reason, this field is duplitated, I don't want it duplicated.

I don't care about wich row I keep.

PowerBi read this field as a text, avec loaded it, I trim and clean the field, transform in Whole Number and then do a "Remove Duplicates" But I keed having duplicates

[zoloturu]

Hi @DenisBergeron ,

Please check the following article about possible issues and how to resolve them - - https://radacad.com/remove-duplicate-doesnt-work-in-power-query-for-power-bi-here-is-the-solution.

Regards,
Ruslan Zolotukhin (zoloturu)
BI Engineer at Akvelon Inc. / Kharkiv Power BI User Group Leader / DAX & Power BI Trainer
-------------------------------------------------------------------
Did I answer your question? Mark my post as a solution!
It was useful? Press Thumbs Up!

You are from Ukraine? If yes then welcome to Power BI User Group - KhPUG website. Other country? Check and find proper one - Power BI User Groups

[dax]

Hi DenisBergeron,

If possible, could you please inform me more detailed information (such as your sample and your expected output)? Then I will help you more correctly.

Please do mask sensitive data before uploading.

Thanks for your understanding and support.
Best Regards,
Zoe Zhi

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Anonymous]

Try performing a group by on the key field(s) and performing Min on the remaining fields. See example off of a made up table.

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WMlTSUUpMSlaK1YGwKyqrwGwjILsgJQ3OrsgphrNz8/KVYmMB", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type text) meta [Serialized.Text = true]) in type table [ID = _t, Type = _t]),
    #"Changed Type" = Table.TransformColumnTypes(Source,{{"ID", Int64.Type}, {"Type", type text}}),
    #"Grouped Rows" = Table.Group(#"Changed Type", {"ID"}, {{"Type", each List.Min([Type]), type text}})
in
    #"Grouped Rows"