cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
DLROLLINGS
Helper I
Helper I

Unpivot Multiple Columns without duplicating records

Hi all,

 

I have a link into Dynamics 365 to a data set that contains multiple columns, I am not happy about the way it has been built but I have to work with it. 

 

For each applicant there is a column for application date, application source, applicant name such as 

Application 1.Date, Application 2.Date, Application 3.Date. Application 1.Source, Application 2.Source, Application 3.Source etc etc.

 

There are 12 applicant details, although not all contain data. I have unpivoted each date type individually, CTRL+SELECT Application 1.Date, Applcation 2.Date. Application 3.Date etc but this creates multiple records of each account each time I do a new column. I have done them all individually (as in select all 12 for the relevant field) and yes this has caused a bit of an issue. The number of rows exceeds 50 million because of the duplication....infact, I think I am trying to create a file with over a trillion rows.

 

The data set has 1850 records so I have created 1850*12 for Application Date, 22,200*12 when adding the next column and I have about 12 columns. I have managed to get to a "septtillion" (21 zeros) number of rows of data...if they loaded. 

 

Thanks

1 REPLY 1
DataInsights
Super User
Super User

@DLROLLINGS,

 

Here are some solutions you may be able to adapt:

 

https://datachant.com/2019/10/11/guest-story-unpivot-pairs-of-columns/ 

 

https://community.powerbi.com/t5/Desktop/Unpivot-in-Power-Query/m-p/2186044 





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!




Helpful resources

Announcements
Carousel_PBI_Wave1

2023 Release Wave 1 Plans

Power BI release plans for 2023 release wave 1 describes all new features releasing from April 2023 through September 2023.

Power BI Summit Carousel 2

Global Power BI Training

Make sure you register today for the Power BI Summit 2023. Don't miss all of the great sessions and speakers!

Thank you 2022 Review

2022 Monthly Feature Releases

We had a great 2022 with a ton of feature releases to help you drive a data culture.