Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.
Hello,
Wondering if anyone has any suggestions or best practice regarding Power Query Clustering Values with large dataset(dataset has over 1.5million rows). I've tryied just about everything to reduce the lag and improve performance but with no luck.
it buffers or gets stock for hours without any results:
Any advice or recommandation is greatly appriacate, thank you!
Solved! Go to Solution.
Hi @Anonymous ,
Before applying the fuzzy cluster, we can refer the following link to optimize the data model to improve the performance.
As any fuzzy operation on the dataset will bring a huge performance impact to the data processing. The reason is that every text value has to be compared with every other text value in the table, the similarity threshold of the two has to be calculated (based on the algorithm above). This process is a very time-consuming process. Especially with more rows in the data table, you will feel it much more... Please find more details about Fuzzy Clustering...
Fuzzy Clustering in Power BI using Power Query: Finding similar values
Best Regards
Hi @Anonymous ,
Before applying the fuzzy cluster, we can refer the following link to optimize the data model to improve the performance.
As any fuzzy operation on the dataset will bring a huge performance impact to the data processing. The reason is that every text value has to be compared with every other text value in the table, the similarity threshold of the two has to be calculated (based on the algorithm above). This process is a very time-consuming process. Especially with more rows in the data table, you will feel it much more... Please find more details about Fuzzy Clustering...
Fuzzy Clustering in Power BI using Power Query: Finding similar values
Best Regards
Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City
Check out the April 2024 Power BI update to learn about new features.
User | Count |
---|---|
110 | |
96 | |
77 | |
63 | |
55 |
User | Count |
---|---|
143 | |
109 | |
89 | |
84 | |
66 |