cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
Advocate II
Advocate II

Incremental refresh using only most recent files in a Sharepoint Folder

Hi, 

 

I have several sharepoint folder that have gotten very full. They are updated daily with new data exports. PBI refreshes daily using the folder as a data source. Is there a way to do an incremental refresh so it appends the dataset with data from only the most recent files rather than refreshing from the entire folder each time?

 

If not directly in PBI, what about using other automation tools like Power Flows? 

 

Thanks.

1 REPLY 1
Highlighted
Super User IV
Super User IV

@SHDJason Could certainly probably get there with Power Automate and Power BI REST API. Outside of that, I assume you are using a Folder query? You could probably create a duplicate Folder query and then in the original Folder query filter out files with Created On dates after a certain period. In your other Folder query, filter out files with Created On dates before the same period. Disable refresh on the original query. Create an Append Query or append query step in new query to append the other queries' data.

 

@ me if you have questions.


---------------------------------------

@ me in replies or I'll lose your thread!!!

I have a NEW book! 
DAX Cookbook from Packt
Over 120 DAX Recipes!




Did I answer your question? Mark my post as a solution!

Proud to be a Super User!




Helpful resources

Announcements
Community Conference

Power Platform Community Conference

Check out the on demand sessions that are available now!

Community Conference

Microsoft Power Platform Communities

Check out the Winners!

secondImage

Create an end-to-end data and analytics solution

Learn how Power BI works with the latest Azure data and analytics innovations at the digital event with Microsoft CEO Satya Nadella.

Top Solution Authors
Top Kudoed Authors