cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
Frequent Visitor

Issue with refreshing data with Incremental Refresh

Hi everyone,

I have an Adobe Analytics Connection that everyday import data from the 1st of January 2019 until "yesterday" (based on the current date).

 

This is a screenshot of the query:Screenshot.png

 

Since the query is quite slow I would like to use the incremental refresh to store historical data - from 01/01/2019 until "yesterday-1" (based on the current date) and make the query import only date of "yesterday".

 

Here the steps:

1-I create two date/time parameters:

    • RangeStart: 01/01/2000 00:00:00 AM
    • RangeEnd: 31/12/2050 00:00:00 AM

Parameters.png

 

2- I create a Custom Filter on my Date/Time column (simply called 'date') with the following condition:

  • date is after or equal RangeStart
  • date is before RangeEndFilter Rows.png 3- I set up the incremental refresh:

Incremental refresh.png4- I publish on the Service and Schedule a daily refresh

 

5- When the dataset should update, I get this error:

Refresh Error.png

 

Any idea on what is happening here?

 

Many thanks,

Robert

 

2 ACCEPTED SOLUTIONS

Accepted Solutions
Highlighted
Microsoft
Microsoft

Re: Issue with refreshing data with Incremental Refresh

Hi @rbisceglia ,

First, please disable the feature "Detect Data Changes" in Increment Refresh configuration page in Power BI Desktop and save it.

disable detect data changes.JPG

Then delete the related dataset and reports in Power BI Service, and re-publish the report to Power BI Service.

 

The complete steps as follow:

Power BI Desktop side:

1. Open the relate report file in Power BI Desktop, disable the feature "Detect Data Changes" in Increment Refresh configuration page

2. Click "Refresh" (5th icon in the Home ribbon) and save the report

 

Power BI Service side:

1. Delete the related dataset and report from Power BI Service

2. Use "GetData" from the service to publish the updated pbix file in previous steps

5. Go to Schedule Refresh->Manage Datasources and enter credentials for all your connections

6. Select the related dataset and click "Refresh Now" and see what happens

 

You can find all deatils of solution in this link.

 

Best Regards

Rena

View solution in original post

Highlighted
Microsoft
Microsoft

Re: Issue with refreshing data with Incremental Refresh

Hi @rbisceglia ,

The issue seems to be caused by the date format mismatch.Please try to update the date type of related date fields using increment refresh parameters as "Using locale" in Query Editor:

11.png

You can find the details in this documentation.

 

Best Regards

Rena

View solution in original post

4 REPLIES 4
Highlighted
Microsoft
Microsoft

Re: Issue with refreshing data with Incremental Refresh

Hi @rbisceglia ,

First, please disable the feature "Detect Data Changes" in Increment Refresh configuration page in Power BI Desktop and save it.

disable detect data changes.JPG

Then delete the related dataset and reports in Power BI Service, and re-publish the report to Power BI Service.

 

The complete steps as follow:

Power BI Desktop side:

1. Open the relate report file in Power BI Desktop, disable the feature "Detect Data Changes" in Increment Refresh configuration page

2. Click "Refresh" (5th icon in the Home ribbon) and save the report

 

Power BI Service side:

1. Delete the related dataset and report from Power BI Service

2. Use "GetData" from the service to publish the updated pbix file in previous steps

5. Go to Schedule Refresh->Manage Datasources and enter credentials for all your connections

6. Select the related dataset and click "Refresh Now" and see what happens

 

You can find all deatils of solution in this link.

 

Best Regards

Rena

View solution in original post

Highlighted
Frequent Visitor

Re: Issue with refreshing data with Incremental Refresh

Hi @yingyinr 

thank you for your reply.


I've just completed all the steps you've suggested, but to be sure that the refresh will automatically update with the date of today, I must wait the automatic refresh scheduled for tomorrow.

 

I have one question: how can I be sure that tomoPBI won't do a full replace tomorrow, but only the data of the 13th March will be imported as an update?  In both cases, I will see in the report the entire date range (from 1-1-2019 to 3-13-2020)

 

Many thanks,

Roberto

Highlighted
Frequent Visitor

Re: Issue with refreshing data with Incremental Refresh

Hi @yingyinr,

now I have this error.

 

DateTime Error.png

 

Any idea?

 

Thanks,
Roberto

 

Highlighted
Microsoft
Microsoft

Re: Issue with refreshing data with Incremental Refresh

Hi @rbisceglia ,

The issue seems to be caused by the date format mismatch.Please try to update the date type of related date fields using increment refresh parameters as "Using locale" in Query Editor:

11.png

You can find the details in this documentation.

 

Best Regards

Rena

View solution in original post

Helpful resources

Announcements
May 2020 Community Highlights

May 2020 Community Highlights

It’s time for another PBI Community recap!

Community Blog

Community Blog

Visit our Community Blog for articles, guides, and information created by fellow community members.

Using the Community

Using the Community

Need help with the Power BI Community? Our 'Using the Community' support articles are a great place to start.

Galleries

Galleries

Looking for inspiration on how to present your data? Need instructional videos? Check out our Galleries!

Top Solution Authors
Top Kudoed Authors