Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
Anonymous
Not applicable

Best Practice: Combine data using Power BI or SQL statements?

Hi,

 

I'm relatively new to Power BI, dablling for about a year, seriously using for about 6 months. I've created many reports, but only 4 at this time that are useful and utilized. Now that I have these core reports built and published, my focus is on data architecture and efficiences, not only for these reports, but also future development.

 

My question stems around the best way to managae the data PowerBI consumes. The four reports that are in use, utilize a combination of MS Access and Postgres database connections. One of these reports comsumes over 700+k records of data. Currently all these records come from two Postgres views, each connected to PowerBI. Within the tool, I've used the "Append Queries as New" option to take the two queries and combine them as one. 

 

My question is, which is more efficient given that much data? Combining the data in Postgres and making one connection to PowerBI, or keeping it as is, two connections and appending to a new query within PowerBI?

 

Thanks!

1 ACCEPTED SOLUTION
Greg_Deckler
Super User
Super User

In general, the more that you can push back to the server the better. This is a general rule. So, creating a View in Postgres that does is simply a UNION of your two other views is going to be the most efficient. You have those options in Power BI because most end users do not have access to the backend SQL database, but if you do, then that is generally the "best" way of doing it.


@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...

View solution in original post

1 REPLY 1
Greg_Deckler
Super User
Super User

In general, the more that you can push back to the server the better. This is a general rule. So, creating a View in Postgres that does is simply a UNION of your two other views is going to be the most efficient. You have those options in Power BI because most end users do not have access to the backend SQL database, but if you do, then that is generally the "best" way of doing it.


@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.