Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!
Does incremental refresh work with azure table storage ?
Hi @Anonymous ,
If your datasource can set up dynamic filters based on parameters, I think incremental refresh should works on it.
Incremental refresh in Power BI Premium
Regards,
Xiaoxin Sheng
Hello,
I would like to get a definite answer to that as well. I have tried setting up incremental refresh for an Azure storage table source but it doesn't seem to be working, even if it supports parameter-based filtering. Consider the following query:
TableSource = AzureStorage.Tables(ParamTableUrl),
TableSourceTelemetry = TableSource{[Name = ParamTableName]}[Data],
TableSourceTelemetryFiltered = Table.SelectRows(TableSourceTelemetry, each ([PartitionKey] = ParamTenantName and [Timestamp] >= RangeStart and [Timestamp] < RangeEnd))
When doing this, I can see when inspecting the network traffic that the query made to the table storage API includes the timestamp-based filters, so there is some kind of query folding going on and the data is nicely filtered server-side. However,
when I right-click on the last step in the query the "View Native Query" option is disabled, and when configuring the incremental refresh for the table I do get the "Unable to confirm if the M query can be folded. It is not recommended to use incremental refresh with non-foldable queries." warning.
When I publish the file, the Power BI service just seems to be using the values of RangeStart and RangeEnd that were saved instead of replacing them based on the incremental refresh settings.
It would be nice if someone could confirm whether this is supposed to work or not.