Incremental Refresh with Dataverse

[a-santiago]

Hi!!

Im wrtiting today in order to know if Incremental refresh works with Dataverse?

The issue is because ive been trying to apply incremental refresh to some .xlsx files inside a  sgarepoint folder without success. So before giving to my customers the option of taking the data into an SQL Database, I was wondering if they can do it through connecting the sharepoint to the dataverse and then apply the Incremental Refresh to the Dataverse as a source. 

Haven´t found any info about it and dont really know how to dataverse works so if you can help me it will be a big help.

Thanks & Regards

[v-yaningy-msft]

Hi, @a-santiago 

You can use Incremental Refresh in conjunction with Dataverse.
To set up an incremental refresh table in Dataverse, first configure the table as you would any other table. After you have created and saved the data flow, select Incremental Refresh in the Table view. Note that using Incremental Refresh requires that the source data introduced into the stream has DateTime fields that can be filtered by Incremental Refresh.

As for connecting SharePoint to Dataverse, there are a few tutorials that can guide you through the process of integrating SharePoint with Dataverse. You can use Power Automate to synchronize lists from SharePoint to Dataverse. Once the data is in Dataverse, you can apply an incremental refresh.

However, please note that migrating from SharePoint to Dataverse is not a direct conversion. You will need to configure Dataverse tables to model the SharePoint list structure. After you configure the data model, you can export data from SharePoint lists and import it into Dataverse.

Related links:

Using incremental refresh with dataflows - Power Query | Microsoft Learn

How to Integrate SharePoint with Dataverse? - YouTube

Solved: How to sync lists from sharepoint to dataverse - Power Platform Community (microsoft.com)

Solved: SharePoint to Dataverse - Power Platform Community (microsoft.com)

If the above configuration process is difficult, you can try importing the data table directly into SQL Server using the incremental refresh strategy (note: the data should have DateTime columns, RangeStart and RangeEnd case, etc.)

Related link:

Incremental refresh for semantic models and real-time data in Power BI - Power BI | Microsoft Learn

Best Regards,
Yang
Community Support Team

If there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

How to get your questions answered quickly --  How to provide sample data in the Power BI Forum

[lbendlin]

 ive been trying to apply incremental refresh to some .xlsx files inside a  sgarepoint folder

Incremental Refresh in the context of Power BI requires the presence of SSAS Tabular partitions.  You can create a semantic model with a incremental refresh data source based on Excel files (using the file create date for the mapping) but you cannot incrementally refresh an Excel file, regardless of Dataverse or not.

[a-santiago]

Hi!

In this case what would you recommend, try to see if Incremental refresh is available for dataverse and try to upload the data there, or

Upload the files into a SQL Server database?

Thanks & Regards,

Alejandro

[lbendlin]

Incremental Refresh in the context of Power BI semantic models requires the presence of (SSAS Tabular) partitions.  A SQL server database won't help with that.

If you insist on using Dataverse then you can consider using Incremental Refresh for dataflows  which follows roughly the same rules but has a very different storage.