Updated record behavior in data flow incremental refresh

[Narukkp]

Hi Team,

I have a doubt on Power bi Dataflow incremental refresh, If we enable the incremental refresh on dataflow how it will handle the updated records i.e. if suppose I have one employee and his designation has software engineer and after some days he got promoted to senior software engineer, now dataflow will delete the existing record and insert the new record or updated the existing employee record with updated designation ?

Why I have got the doubt  here  we do not have any primary key concept and having only dates filed, so that how dataflow will understand the records is either updated record or inserted record ?

[v-lili6-msft · Accepted solution]

hi  @Narukkp 

If the old data datetime is refresh duration, then it will be updated, otherwise, it will be inserted a new record.

For example:

If you store last 5 Years data, and refresh the rows in last 10 days (Today is 6/30/2020).

Now if the date field for "one employee and his designation has software engineer" is before 10 days(before 6/20/2020), it will be inserted a new record, if date field is in 6/20/2020 - 6/30/2020, it will be updated.

Regards,

Lin

[amitchandak]

@Narukkp , refer if this can help

https://powerpivotpro.com/2019/06/how-can-i-get-a-lookup-table-from-a-slowly-changing-dimension-scd/