Refreshing Data source through filtering dates of a specified timeframe for better performance

[Anonymous]

Hi all, 

I have dashboard with a data source as an excel file. As of now when new data given , i will clean the data and then append it to the data source excel file. 

My concern is that as more data if fed into the source file, excel would not be able to load it due to its limited data storage. For example if i have 20 months of data in the file, i would like to take the latest 12 months of data without reading the last 8 extra months

Is there a way to do this in power Bi ?

[v-kelly-msft]

Hi  @Anonymous ,

You may try to use "Incremental refresh".
Below is the reference：

https://docs.microsoft.com/en-us/power-bi/admin/service-premium-incremental-refresh

Best Regards,
Kelly

Did I answer your question? Mark my post as a solution!

[ibarrau]

Hi. The storage issue is something outside of Power Bi. It's always a good idea to save data in databases. If you can't do that, you can try the way data lakes work. You can create an excel by month (week, day depending on how often you make the change) and save it as csv (if it only has one sheet). Then you can make Power Bi get data from "folder" reaading all csv files inside it. The Transform Data menu will help you combine all files. You can use names like 202101 that would be a row after concatenation.

Hope this helps,