cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
frano72
Helper IV
Helper IV

Dataflow incremental refresh datetime column driven by timezone selected in schedule refresh setting

I spent the best part of today trying to figure out why some computed entities were missing data.  I worked my way backwards and I think I found the issue.

 

I'd always assumed that the datetime value that you use for incremental refresh was to be in UTC.  Then over in the area where you schedule your dataflow refresh, you can choose a timezone - and I always figured that was for the benefit of the dataflow author to make it easy to visualise the time of data when they want it to run.

 

wrong (I think).

 

These two settings are linked.

 

The timezone that you use to schedule the refresh - specifies the timezone for the datetime value that use to incrementally refresh.

 

In my case, i'd always had my schedule in Brisbane time, and I'd always had my datetime column in UTC.

 

After I changed by schedule to be in UTC to match with the column I was using for incremental refresh - the missing data appeared.

 

I think this is a bit of a gothcha, as choosing the timezone to refresh - seems like a rather inocuous setting to just help with understanding time of day, NOT specifying the timezone of the field to refresh !

 

Ideally i'd like these to be separate - selecting timezone for refresh timing - selecting timezone of column used for inc refresh.

 

This is mentioned in microsoft article : https://docs.microsoft.com/en-us/power-query/dataflows/incremental-refresh

 

Dataflow incremental refresh determines dates according to the following logic: if a refresh is scheduled, incremental refresh for dataflows uses the time zone defined in the refresh policy. If no schedule for refreshing exists, incremental refresh uses the time from the computer running the refresh.

 

2021-10-18_17-37-23.jpg

1 REPLY 1
v-angzheng-msft
Community Support
Community Support

Hi, @frano72 

 

Thank you for sharing, it will definitely benefit other users who might have the same situation.
If you allow, you can mark this case as answered so that other people will find your post more quickly.

 

 

Best Regards,
Community Support Team _ Zeon Zheng

 

Helpful resources

Announcements
May 23 2022 epsiode 5 without aka link.jpg

The Power BI Community Show

Welcome to the Power BI Community Show! Jeroen ter Heerdt talks about the importance of Data Modeling.

charticulator_carousel_with_text (1).png

Charticulator Design Challenge

Put your data visualization and design skills to the test! This exciting challenge is happening now through June10th!

Power BI Dev Camp Session 22 without aka link and time 768x460.jpg

Check it Out!

Watch Session 22 Ted's Dev Camp along with past sessions!

Power BI Release May 2022 768x460.png

Check it out!

Click here to read more about the May 2022 updates!

Top Solution Authors
Top Kudoed Authors