Issue with refreshing data with Incremental Refresh

[Anonymous]

Hi everyone,

I have an Adobe Analytics Connection that everyday import data from the 1st of January 2019 until "yesterday" (based on the current date).

This is a screenshot of the query:

Since the query is quite slow I would like to use the incremental refresh to store historical data - from 01/01/2019 until "yesterday-1" (based on the current date) and make the query import only date of "yesterday".

Here the steps:

1-I create two date/time parameters:

• RangeStart: 01/01/2000 00:00:00 AM
• RangeEnd: 31/12/2050 00:00:00 AM

2- I create a Custom Filter on my Date/Time column (simply called 'date') with the following condition:

• date is after or equal RangeStart
• date is before RangeEnd 3- I set up the incremental refresh:

4- I publish on the Service and Schedule a daily refresh

5- When the dataset should update, I get this error:

Any idea on what is happening here?

Many thanks,

Robert

[v-yiruan-msft · Accepted solution]

Hi @Anonymous ,

First, please disable the feature "Detect Data Changes" in Increment Refresh configuration page in Power BI Desktop and save it.

Then delete the related dataset and reports in Power BI Service, and re-publish the report to Power BI Service.

The complete steps as follow:

Power BI Desktop side:

1. Open the relate report file in Power BI Desktop, disable the feature "Detect Data Changes" in Increment Refresh configuration page

2. Click "Refresh" (5th icon in the Home ribbon) and save the report

Power BI Service side:

1. Delete the related dataset and report from Power BI Service

2. Use "GetData" from the service to publish the updated pbix file in previous steps

5. Go to Schedule Refresh->Manage Datasources and enter credentials for all your connections

6. Select the related dataset and click "Refresh Now" and see what happens

You can find all deatils of solution in this link.

Best Regards

Rena

[v-yiruan-msft · Accepted solution]

Hi @Anonymous ,

First, please disable the feature "Detect Data Changes" in Increment Refresh configuration page in Power BI Desktop and save it.

Then delete the related dataset and reports in Power BI Service, and re-publish the report to Power BI Service.

The complete steps as follow:

Power BI Desktop side:

1. Open the relate report file in Power BI Desktop, disable the feature "Detect Data Changes" in Increment Refresh configuration page

2. Click "Refresh" (5th icon in the Home ribbon) and save the report

Power BI Service side:

1. Delete the related dataset and report from Power BI Service

2. Use "GetData" from the service to publish the updated pbix file in previous steps

5. Go to Schedule Refresh->Manage Datasources and enter credentials for all your connections

6. Select the related dataset and click "Refresh Now" and see what happens

You can find all deatils of solution in this link.

Best Regards

Rena

[Anonymous]

Hi @v-yiruan-msft 

thank you for your reply.

I've just completed all the steps you've suggested, but to be sure that the refresh will automatically update with the date of today, I must wait the automatic refresh scheduled for tomorrow.

I have one question: how can I be sure that tomoPBI won't do a full replace tomorrow, but only the data of the 13th March will be imported as an update?  In both cases, I will see in the report the entire date range (from 1-1-2019 to 3-13-2020)

Many thanks,

Roberto

[Anonymous]

Hi @v-yiruan-msft,

now I have this error.

Any idea?

Thanks,
Roberto

[v-yiruan-msft · Accepted solution]

Hi @Anonymous ,

The issue seems to be caused by the date format mismatch.Please try to update the date type of related date fields using increment refresh parameters as "Using locale" in Query Editor:

You can find the details in this documentation.

Best Regards

Rena