Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.
I have a workbook with a query that hooks up to my data in DevOps for Work Items (approximately 10,000 records). The query brings back about 20 columns from the table (and expanded tables - e.g. projects), and has another dozen or so Custom Fields - e.g. the age of the item worked out in days, and others - if value = this then custom = 1, else = 0 type custom columns.
It does take quite a while to refresh, so am trying to find ways to shave seconds or minutes off the refresh time. One thing I wondered, and was hoping someone could confirm, is whether the query may run better if I replaced all of the null values with zero (or some other value) for the fields that I'm bringing through. Or does Power Query not mind there being NULLs?
Another thing I wanted to try and establish was whether I'm right in creating these 12 columns, re-ordering all of the standard and custom columns, renaming the fields, filtering out some records depending on the project site they relate to, within the one query. I've tried to keep everything together, so I'm not surprised it does take a few minutes to refresh, but just wondered if that was good practice with Power Query or whether I should split down into smaller chunks?
Appreciate that speeding up a query is the holy grail of Power Query, and there may not be anything that can be done, I'm just hoping that there may be options besides using 'Fast Load' (which I've already got turned on).
If you share the M code from the Advanced Editor of the query, we might be able to suggest some improvements. Also, null vs 0 shouldn't matter.
Regards,
Pat
To learn more about Power BI, follow me on Twitter or subscribe on YouTube.
I would reccomend you to start by running a diagnostic on the query to find where its the performance being affected at, the source? a step? evaaluation? etc.... theres a tool for this inside power query will give you a starting point to look and you can share here your run results for a better answer or asistence, check this link:
https://docs.microsoft.com/en-us/power-query/querydiagnostics
Proud to be a Super User!
Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City
Check out the April 2024 Power BI update to learn about new features.