Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
thisisausername
Helper II
Helper II

Using incremental refresh with OData - slow

When I attempt to use Incremental Refresh with an OData source, I get the following error regarding query folding:

 

"Unable to confirm if the M query can be folder. It is not recommended to use incremental refresh with non-foldable queries"

 

I don't know if this is because it can't trace OData anyway and is just showing that message just to be safe.

 

Is there a way I can get Incremental Refresh to work successfully with OData?

4 REPLIES 4
v-lid-msft
Community Support
Community Support

Hi @thisisausername ,

 

Based on this document, IF you are not using composite modelsdata sources do not support SQL queries like flat files, blobs, web, and OData feeds typically do not support query folding. In cases where the filter is not supported by the datasource back-end, it cannot be pushed down. In such cases, the mashup engine compensates and applies the filter locally, which may require retrieving the full dataset from the data source. This can cause incremental refresh to be very slow, and the process can run out of resources either in the Power BI service or in the on-premises data gateway if used.

 

If unable to verify, a warning is displayed in the incremental refresh dialog when defining the incremental refresh policy. SQL based data sources such as SQL, Oracle, and Teradata can rely on this warning. Other data sources may be unable to verify without tracing queries. If Power BI Desktop is unable to confirm, the following warning is displayed.

 

If you are using composite models, incremental refresh is supported for SQL Server, Azure SQL Database, SQL Data Warehouse, Oracle, and Teradata data sources only.

 

Best regards,

Community Support Team _ Dong Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Community Support Team _ Dong Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Thanks both. I had indeed read that article - it mentions 'typically', how can I find out if my OData feed is/is not able to fold with Incremental Refresh?

Hi @thisisausername ,

 

The easy way is to set a small incremental range and try to do a incremental refresh, if it supports Query Folder, it should take much less time than full-size refresh. But it should test carefully such as limit the total rows because the process may run out of resources either in the Power BI service or in the on-premises data gateway if it does not support Query Folder.

 

Best regards,

Community Support Team _ Dong Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Community Support Team _ Dong Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
venal
Memorable Member
Memorable Member

@thisisausername 

 

Please refer the link.

 

But please vote for this feature.

 

If this post helps, then please consider Accept it as the solution to help the other members find it more

If this post was helpful may I ask you to mark it as solution and give it some kudos?

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors