Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Grow your Fabric skills and prepare for the DP-600 certification exam by completing the latest Microsoft Fabric challenge.

Reply
Ganira
Regular Visitor

Power query - changing entries and Big Data

Hello, everybody.

 

I have CSV files that upon opening have some irregular IDs' entries (all IDs should have 17 characters but after filtering them by length I found some that had an irregular amount of characters - 14, 15, 18). 

However, when I created a Power Query, suddenly all the ride IDs became normal and other odd calculations were fixed too (like time(duration) became normal instead of 0:00:00).

 

Question 1: Why IDs become normal (example "326DCA34ABA1FAHHD") in PowerQuery but are in the form of "8.28E+22" upon opening? 

 

Question 2: I have multiple CSV files with hundreds of thousands of rows in each file, I need to repeat the same analysis steps for each one of them and create the same pivot tables. I could run the same VBA code for each one of them, but that would take a lot of time. I am just a beginner, so I am not sure whether or not I should use Data Models for that, create a connection to Power Bi, or what. 

 

Any help would be greatly appreciated.  🙂

 

1 ACCEPTED SOLUTION
lbendlin
Super User
Super User

Question 1:  Power Query is messing with you and (wrongly) guessing column types. Tell it to not do that (in the options)

 

Question 2:  Whatever you are more comfortable with. Could be VBA, could be Power Query, could be the data model/DAX.  Try it out.

View solution in original post

2 REPLIES 2
lbendlin
Super User
Super User

Question 1:  Power Query is messing with you and (wrongly) guessing column types. Tell it to not do that (in the options)

 

Question 2:  Whatever you are more comfortable with. Could be VBA, could be Power Query, could be the data model/DAX.  Try it out.

Thank you so so much! 🙂

Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

Top Solution Authors
Top Kudoed Authors