Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more.
Get startedGrow your Fabric skills and prepare for the DP-600 certification exam by completing the latest Microsoft Fabric challenge.
Hi i have a dataset with duplicates for multiple values and i want to remove duplicates for only one of the value.
for examples i have column where i have duplicates for 1,2,3 are want to remove duplicates of value 1 only not other values.
pl help.
Hi @Info_User, you should provide sample data so we can copy/paste and expected result based on sample data. But the idea how to do that could be this:
let
Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WMlSK1YlWMgKThkgkRMQYScQYVWUsAA==", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [Column1 = _t]),
ChangedType = Table.TransformColumnTypes(Source,{{"Column1", Int64.Type}}),
FilteredRowsDuplicatesToRemove = Table.SelectRows(ChangedType, each ([Column1] = 1)),
RemovedDuplicates = Table.Distinct(FilteredRowsDuplicatesToRemove),
StepBack = ChangedType,
FilteredRowsDuplicatesToKeep = Table.SelectRows(StepBack, each ([Column1] <> 1)),
Combined = RemovedDuplicates & FilteredRowsDuplicatesToKeep
in
Combined
Hi,
is there any option if we want to keep the last appearance instead of first appearance of duplicate value?
what if the values that need to remove are text?
Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.
Ask questions in Eventhouse and KQL, Eventstream, and Reflex.
User | Count |
---|---|
41 | |
23 | |
21 | |
21 | |
13 |