Moved data to new location / keep SQL data without constant refresh

[ciken]

Hey PBI community,

Recently our company switched ecomm platforms from Woo Commerce (mySQL server) to Big Commerce. I do not want to lose all of our historical data from the SQL server, but want to now run reports on my new pipleline through Salesforce. Is there a way to keep all of the data from SQL without every refresh calling back to it and refreshing 400,000 lines of data? Should I just move it all into a static excel spreadsheet? 

Any help you can provide would be amazing!!

[V-lianl-msft · Accepted solution]

You can create data flow and use incremental refresh.

Incremental refresh only needs to load all data at the first refresh.In subsequent refreshes, only the latest data within the date range will be refreshed.There is no need to completely refresh the entire dataset with each refresh operation.

In addition, you have to store the historical data somewhere.https://visualbi.com/blogs/microsoft/powerbi/historical-data-preservation-using-power-bi-dataflow/ 

[amitchandak]

@ciken , better to keep historical data in some excel or database.