Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.
Good morning!
I am pull 6 queries from Teradata that are identical in column names, but have slightly different data. I'm pulling 6 because I'm pulling in a total of 40 million rows of data, and I can have 6 threads running at once. My download speed is very slow, about 2,000 rows per second, which is why I need 6 to run at once, which they do.
The issue is, when I want to squish the 6 into one dataset, using append, the appended query then tries to pull all the data back down from Teradata through the single thread. How can I combine query outputs without the new dataset repulling?
Hey @mtrando
The functionality you're looking for is reference. References are copies of the original query that do not pull the query again. They allow you to copy the query and then make changes to it. Therefore, you can create a reference of each query and then append those to each other to save load time and avoid having to reload each query each time.
Simply right click the query in query editor and select reference. This creates the reference table. You can do what you need to with those, create the appended query, and the ndisable load by right clicking each reference.
Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City
Check out the April 2024 Power BI update to learn about new features.
User | Count |
---|---|
104 | |
101 | |
79 | |
72 | |
64 |
User | Count |
---|---|
142 | |
108 | |
101 | |
81 | |
74 |