Earn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.
Hi i have a dataset with duplicates for multiple values and i want to remove duplicates for only one of the value.
for examples i have column where i have duplicates for 1,2,3 are want to remove duplicates of value 1 only not other values.
pl help.
Hi @Info_User, you should provide sample data so we can copy/paste and expected result based on sample data. But the idea how to do that could be this:
let
Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WMlSK1YlWMgKThkgkRMQYScQYVWUsAA==", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [Column1 = _t]),
ChangedType = Table.TransformColumnTypes(Source,{{"Column1", Int64.Type}}),
FilteredRowsDuplicatesToRemove = Table.SelectRows(ChangedType, each ([Column1] = 1)),
RemovedDuplicates = Table.Distinct(FilteredRowsDuplicatesToRemove),
StepBack = ChangedType,
FilteredRowsDuplicatesToKeep = Table.SelectRows(StepBack, each ([Column1] <> 1)),
Combined = RemovedDuplicates & FilteredRowsDuplicatesToKeep
in
Combined
Hi,
is there any option if we want to keep the last appearance instead of first appearance of duplicate value?
what if the values that need to remove are text?