Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
MasterSonic
Helper IV
Helper IV

Computation time to compare 2 tables _ 100k rows each _ 150 columns each _ 6.5 mln rows as a result

Hi Guys,

I found solution for my problem on this forum before.

Having 2 tables to compare ( 2 tables _ 100k rows each _ 150 columns each )
- I just unpivoted them on key column, inner joined on key and columns name  + added  cond. column to compare columns.

KeyColumn namesValue table 1 Value table 2value table1= value table2 yes/no

 

Problem is 6.5 mln of rows, and merge query loading 2hrs on deskopt ( sharpoint will be worse ?!!!)

 

Is there any other way to compare them ? Any idea

 

 

1 ACCEPTED SOLUTION
v-yanjiang-msft
Community Support
Community Support

Hi @MasterSonic ,

Sorry maybe I'm not understanding your problem correctly, if you want to compare two tables, why not simply select Merge Queries.

vkalyjmsft_0-1663917932259.png

If we select Full Outer join kind, after expand all rows, we can see all values in a single table.

vkalyjmsft_1-1663918031864.png

If the two tables are all have 100k rows, the merged table will have less than 200k rows, which is a lot less than 6.5 mln rows.

 

Best Regards,
Community Support Team _ kalyj

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

1 REPLY 1
v-yanjiang-msft
Community Support
Community Support

Hi @MasterSonic ,

Sorry maybe I'm not understanding your problem correctly, if you want to compare two tables, why not simply select Merge Queries.

vkalyjmsft_0-1663917932259.png

If we select Full Outer join kind, after expand all rows, we can see all values in a single table.

vkalyjmsft_1-1663918031864.png

If the two tables are all have 100k rows, the merged table will have less than 200k rows, which is a lot less than 6.5 mln rows.

 

Best Regards,
Community Support Team _ kalyj

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors