Incremental refresh from dataflow

[Anonymous]

Hello,

I'm new to increment refresh and the more I read the more I get confused.

I create certified datasets for the analytics team to create reports.

I have two types of datasets that I would like to apply the incremental refresh as they are pretty large.

One is a dataset that was built using dataflows, and I used queries in Oracle to create them.

I want to apply incremental refresh to each query (each dataflow) as the analytics can import whatever dataflow they need to use, which means I cannot use one date column only. 

In that case, can an Incremental refresh be applied?

The second dataset is a composite mode, where I'm using the above dataset (PBI says it's DQ) and an import mode (query from Oracle db). 

For the second dataset, I keep getting the failed message which states it couldn't be refreshed because the import mode query is timing out. How should I apply the incremental refresh in this case?

Thank you.

[v-rzhou-msft · Accepted solution]

Hi @Anonymous ,

I think you can try to set incremental refresh for dataflow directly.

For reference:

Using incremental refresh with dataflows

If you want to set incremental refresh for report with dataflow dataset, you can try to convert the connection from live connection from live connection to direct query.

For reference:

Using DirectQuery for Power BI datasets and Analysis Services (preview)

The composite mode will get error, this may be caused by your data source doesn't support Query folding.

You can configure incremental refresh, though data source doesn't support query folding. However, it may give you bad performance when incremental refresh.

For reference:

Supported data sources

Best Regards,
Rico Zhou

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.