cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Jaf017
Helper I
Helper I

Data Translation

I am needing to translate my data from vertical to horizontal.

Is there a way to do this in Power Query?

 

Example pictures below.Example Data.PNG

 

1 ACCEPTED SOLUTION
mahoneypat
Microsoft
Microsoft

Here is one way to do it.  To see how it works, just create a blank query, go to Advanced Editor, and replace the text there with the M code below.

 

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("hY47CoAwEESvElIr7m42iUmpWCripxLvfw0HLMQP2EzxhnnMtllWEmVfsi3sOCxIV4mvhIQMh+wVZJ27ie9NzBJBuLZ7cUlSAmvap0S/JYoiE5mxNxTQIF6yxyVMJLuEyZ8Rz857+wE=", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [GRP = _t, USER_INPTS = _t, OBC_TS = _t, ACK_BY = _t, ACK_TS = _t, ERROR = _t]),
    #"Changed Type" = Table.TransformColumnTypes(Source,{{"GRP", type text}, {"USER_INPTS", type text}, {"OBC_TS", type text}, {"ACK_BY", type text}, {"ACK_TS", type text}, {"ERROR", Int64.Type}}),
    #"Grouped Rows" = Table.Group(#"Changed Type", {"GRP"}, {{"AllRows", each _, type table [GRP=text, USER_INPTS=text, OBC_TS=text, ACK_BY=text, ACK_TS=text, ERROR=number]}}),
    #"Added Custom" = Table.AddColumn(#"Grouped Rows", "WithIndex", each Table.AddIndexColumn([AllRows], "Index",1,1)),
    #"Removed Columns" = Table.RemoveColumns(#"Added Custom",{"AllRows"}),
    #"Expanded WithIndex" = Table.ExpandTableColumn(#"Removed Columns", "WithIndex", {"USER_INPTS", "OBC_TS", "ACK_BY", "ACK_TS", "ERROR", "Index"}, {"USER_INPTS", "OBC_TS", "ACK_BY", "ACK_TS", "ERROR", "Index"}),
    #"Unpivoted Other Columns" = Table.UnpivotOtherColumns(#"Expanded WithIndex", {"GRP", "Index"}, "Attribute", "Value"),
    #"Merged Columns" = Table.CombineColumns(Table.TransformColumnTypes(#"Unpivoted Other Columns", {{"Index", type text}}, "en-US"),{"Attribute", "Index"},Combiner.CombineTextByDelimiter("_", QuoteStyle.None),"Merged"),
    #"Pivoted Column" = Table.Pivot(#"Merged Columns", List.Distinct(#"Merged Columns"[Merged]), "Merged", "Value"),
    #"Changed Type1" = Table.TransformColumnTypes(#"Pivoted Column",{{"GRP", type text}, {"USER_INPTS_1", type text}, {"OBC_TS_1", type datetime}, {"ACK_BY_1", type text}, {"ACK_TS_1", type text}, {"ERROR_1", Int64.Type}, {"USER_INPTS_2", type text}, {"OBC_TS_2", type text}, {"ACK_BY_2", type text}, {"ACK_TS_2", type text}, {"ERROR_2", Int64.Type}})
in
    #"Changed Type1"

 

If this works for you, please mark it as the solution.  Kudos are appreciated too.  Please let me know if not.

Regards,

Pat





Did I answer your question? Mark my post as a solution! Kudos are also appreciated!

To learn more about Power BI, follow me on Twitter or subscribe on YouTube.


@mahoneypa HoosierBI on YouTube


View solution in original post

5 REPLIES 5
mahoneypat
Microsoft
Microsoft

Here is one way to do it.  To see how it works, just create a blank query, go to Advanced Editor, and replace the text there with the M code below.

 

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("hY47CoAwEESvElIr7m42iUmpWCripxLvfw0HLMQP2EzxhnnMtllWEmVfsi3sOCxIV4mvhIQMh+wVZJ27ie9NzBJBuLZ7cUlSAmvap0S/JYoiE5mxNxTQIF6yxyVMJLuEyZ8Rz857+wE=", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [GRP = _t, USER_INPTS = _t, OBC_TS = _t, ACK_BY = _t, ACK_TS = _t, ERROR = _t]),
    #"Changed Type" = Table.TransformColumnTypes(Source,{{"GRP", type text}, {"USER_INPTS", type text}, {"OBC_TS", type text}, {"ACK_BY", type text}, {"ACK_TS", type text}, {"ERROR", Int64.Type}}),
    #"Grouped Rows" = Table.Group(#"Changed Type", {"GRP"}, {{"AllRows", each _, type table [GRP=text, USER_INPTS=text, OBC_TS=text, ACK_BY=text, ACK_TS=text, ERROR=number]}}),
    #"Added Custom" = Table.AddColumn(#"Grouped Rows", "WithIndex", each Table.AddIndexColumn([AllRows], "Index",1,1)),
    #"Removed Columns" = Table.RemoveColumns(#"Added Custom",{"AllRows"}),
    #"Expanded WithIndex" = Table.ExpandTableColumn(#"Removed Columns", "WithIndex", {"USER_INPTS", "OBC_TS", "ACK_BY", "ACK_TS", "ERROR", "Index"}, {"USER_INPTS", "OBC_TS", "ACK_BY", "ACK_TS", "ERROR", "Index"}),
    #"Unpivoted Other Columns" = Table.UnpivotOtherColumns(#"Expanded WithIndex", {"GRP", "Index"}, "Attribute", "Value"),
    #"Merged Columns" = Table.CombineColumns(Table.TransformColumnTypes(#"Unpivoted Other Columns", {{"Index", type text}}, "en-US"),{"Attribute", "Index"},Combiner.CombineTextByDelimiter("_", QuoteStyle.None),"Merged"),
    #"Pivoted Column" = Table.Pivot(#"Merged Columns", List.Distinct(#"Merged Columns"[Merged]), "Merged", "Value"),
    #"Changed Type1" = Table.TransformColumnTypes(#"Pivoted Column",{{"GRP", type text}, {"USER_INPTS_1", type text}, {"OBC_TS_1", type datetime}, {"ACK_BY_1", type text}, {"ACK_TS_1", type text}, {"ERROR_1", Int64.Type}, {"USER_INPTS_2", type text}, {"OBC_TS_2", type text}, {"ACK_BY_2", type text}, {"ACK_TS_2", type text}, {"ERROR_2", Int64.Type}})
in
    #"Changed Type1"

 

If this works for you, please mark it as the solution.  Kudos are appreciated too.  Please let me know if not.

Regards,

Pat





Did I answer your question? Mark my post as a solution! Kudos are also appreciated!

To learn more about Power BI, follow me on Twitter or subscribe on YouTube.


@mahoneypa HoosierBI on YouTube


This worked perfectly for the sample dataset!

Thank you for this @mahoneypat !

 

I'm trying to implement this code into my dataset of 3.2M rows with up to 6 errors per GRP.

Is this method scalable to that level?

It will probably be very slow with that many records.  Please report back if so. There may be some tricks to try.  In any case, what type of analysis are you doing with the data in that structure.  Typically, it is best to unpivot vs. pivot stuff out, so if possible I would encourage you to revist your data model structure.

 

Regards,

Pat

 





Did I answer your question? Mark my post as a solution! Kudos are also appreciated!

To learn more about Power BI, follow me on Twitter or subscribe on YouTube.


@mahoneypa HoosierBI on YouTube


It just got done running, it was quite slow, but manageable.

 

One thing that happened was on the final step, it resulted in 300+ columns. Is there a step maybe in the index where I can limit it to 6 errors per group? I think that would speed it up enough that would be acceptable.

 

And yes, 100% agree we need to adjust the data model, but don't have the support to do so at the moment. 

I limited the the columns to just "ERROR" and this increased performance.

This solved my issue, thank you!

Helpful resources

Announcements
August 1 episode 9_no_dates 768x460.jpg

The Power BI Community Show

Watch the playback when Priya Sathy and Charles Webb discuss Datamarts! Kelly also shares Power BI Community updates.

Power BI Dev Camp Session 24 without aka link and time 768x460.jpg

Ted's Dev Camp - July 28, 2022

Watch Session 24 of Ted's Dev Camp along with past sessions!

Power Platform Conf 2022 768x460.jpg

Join us for Microsoft Power Platform Conference

The first Microsoft-sponsored Power Platform Conference is coming in September. 100+ speakers, 150+ sessions, and what's new and next for Power Platform.