Data refresh issue

[turkfoster]

Updating a SQL table with only 1.1m rows shows more than 6m records being refreshed during update. Its the only table where I have refresh turned on. What's going on?

[turkfoster]

The source table has 1.1m records but durning the refresh as its showing how many rows have been refreshed it goes way past 1.1m. I would have thought it could only show the number of records in the source table but its showing millions more. The good news is that it seems to have refreshed the table properly because when I look in table view after the refresh the number of records matches the source table so that's good.

[parry2k]

@turkfoster ok so what is the issue than?

[turkfoster]

It seems like there may not be an issue but it makes me nervouse that it is reflecting more rows in the refresh process than actually exist. As there are more than 1 m records in the result set I have to trust that they came through correctly but it seems odd to have the refresh showing upwards of 7m records being refreshed from a table that only has about 1m records.

[parry2k]

@turkfoster without looking at it , it is very hrd to say what is going on.

after refersh, if row count matches with your source data then you are good. May be you check sum of few columns with sum on souce data to make sure value matches. 

[turkfoster · Accepted solution]

The checksum is a good idea. I just want to be able to have confidence in the data that was loaded. Thanks!

[v-piga-msft]

Hi @turkfoster ,

Have you solved your problem?

If you have solved, please always accept the replies making sense as solution to your question so that people who may have the same question can get the solution directly.

If you still need help, please feel free to ask.

Best  Regards,

Cherry

[parry2k]

@turkfoster what is the way you are checking that there are only 1.1m rows refreshed?