I'm looking for a way to combine data from multiple tables with identical columns without appending.
Currently, I am querying a Postgresql database going back at least 60 days. This is a lot of data and causing some refresh issues. As a solution, I'm trying to pull in static data for past months that doesn't need to refresh so that I will be refreshing data only for the current month. I still need all this data in one table, however if I append them it's going to continue to refresh all of the data even if I uncheck "include in report refresh" on the original table.
1) Is there a way to combine this data without appending?
2) As an alternative solution, is there a way to create a calculated column to lookup information that could be on one of multiple tables. My formula now is:
RESULT = LOOKUPVALUE(Table1[ABC],Table1[transaction_id],Table2[id])
Could I still accomplish this if the value I'm trying to lookup could be on Table1, Table3, Table4, etc.
3) Does it matter? I read on another forum that the data is going to refresh in Power BI Service even if I uncheck "include in report refresh" in desktop. If that's the case, none of this matters.
Any other ideas for accessing large amounts of data without having to refresh the entire dataset are welcome. We are working on a longer term data warehousing solution, but that's down the line. I only have a few queries complex enough to cause issues so I'm looking for a temporary solution to get those under control. Unfortunately, the complexity of those queries also seems to make incremental refresh impossible as well.
Unless you have Power BI Premium, incremental refresh isnt available.
My company wont pay the cost of Premium so I have looked at every possible way I could think of to do what your looking at and nothing work.
If its server load your looking at you could export a month at a time into files, load into PBI append all your queries and then query just live month data from your server and append that. Then only the live data would be pulled from the server.
Beyond that I dont think there is a way, hence why Premium is so expensive, because they have you over a barrel
Could you tell me if your problem has been solved? If it is, kindly mark the helpful answer as a solution. if not, please share more details about your question, we'd like to provide further support. thanks! If you've fixed by your own, it would be much appreciated if you can share your solution here.
Community Support Team _ Dina Ye If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.