cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
schwinnen Member
Member

Combine tables without appending

I'm looking for a way to combine data from multiple tables with identical columns without appending.  

Currently, I am querying a Postgresql database going back at least 60 days.  This is a lot of data and causing some refresh issues.  As a solution, I'm trying to pull in static data for past months that doesn't need to refresh so that I will be refreshing data only for the current month.  I still need all this data in one table, however if I append them it's going to continue to refresh all of the data even if I uncheck "include in report refresh" on the original table.  

Questions:

1) Is there a way to combine this data without appending?

2) As an alternative solution, is there a way to create a calculated column to lookup information that could be on one of multiple tables.  My formula now is:

RESULT = LOOKUPVALUE(Table1[ABC],Table1[transaction_id],Table2[id])
Could I still accomplish this if the value I'm trying to lookup could be on Table1, Table3, Table4, etc.

3) Does it matter?  I read on another forum that the data is going to refresh in Power BI Service even if I uncheck "include in report refresh" in desktop.  If that's the case, none of this matters.

Any other ideas for accessing large amounts of data without having to refresh the entire dataset are welcome. We are working on a longer term data warehousing solution, but that's down the line.  I only have a few queries complex enough to cause issues so I'm looking for a temporary solution to get those under control.  Unfortunately, the complexity of those queries also seems to make incremental refresh impossible as well. 

4 REPLIES 4
Highlighted
MCornish Regular Visitor
Regular Visitor

Re: Combine tables without appending

Unless you have Power BI Premium, incremental refresh isnt available.

 

My company wont pay the cost of Premium so I have looked at every possible way I could think of to do what your looking at and nothing work.

 

If its server load your looking at you could export a month at a time into files, load into PBI append all your queries and then query just live month data from your server and append that. Then only the live data would be pulled from the server.

 

Beyond that I dont think there is a way, hence why Premium is so expensive, because they have you over a barrel

Community Support Team
Community Support Team

Re: Combine tables without appending

Hi @schwinnen ,

 

Please find my comments below:

1. Not quite sure about the result you expected, could you plz show more?

2. You can refer to :https://social.msdn.microsoft.com/Forums/sqlserver/en-US/999e8db0-e689-4ce6-bfa1-a3f2d67b1647/tabula...

3. Yes. uncheck "include in report refresh" works in desktop, but when you published to service and implemented the gateway, it's different.

4. incremental refresh accessible in power bi premium https://docs.microsoft.com/en-us/power-bi/service-premium-incremental-refresh

 

Community Support Team _ Dina Ye
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Community Support Team
Community Support Team

Re: Combine tables without appending

Hi @schwinnen 

 

Could you tell me if your problem has been solved? If it is, kindly mark the helpful answer as a solution. if not, please share more details about your question, we'd like to provide further support. thanks!
If you've fixed by your own, it would be much appreciated if you can share your solution here. 

 

Community Support Team _ Dina Ye
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
schwinnen Member
Member

Re: Combine tables without appending

@v-diye-msft- It is not solved, athough there probably is no solution possible at this time.

Helpful resources

Announcements
Virtual Launch Event

Microsoft Business Applications October Virtual Launch Event

Join us for an in-depth look at the new innovations across Dynamics 365 and the Microsoft Power Platform.

Power BI Helps Homeless and Trouble Youth

Power BI Helps Homeless and Trouble Youth

We spoke with Power BI Super User, Greg Deckler, about his charity work

MBAS Gallery

Watch Sessions On Demand!

Continue your learning in our online communities.

Top Kudoed Authors
Users Online
Currently online: 6 members 3,102 guests
Please welcome our newest community members: