records count on incremental refresh

[Rajeshkumaryarl]

Hi Everyone. I have dataflows created from snowflake and we enabled incremental refresh on the dataflow. We are doing some analysis to know the total number of records processed (row count) on incremental refresh. Similar exercize we want to do on full load of dataflow. Is there any way we can know this records count on completion of refresh ?? In refresh history i only see start time and end time but no where i see the number of records processed

[v-binbinyu-msft]

Hi @Rajeshkumaryarl ,

Please try to incorporate custom logging within the source system (like Snowflake) to log the number of records being processed during each refresh. This method requires manual setup and might involve storing these logs in a separate location where you can query them later for analysis.

For more details, you could read related document:  Tutorial: Get Started with Logging and Tracing | Snowflake Documentation

Best regards,
Community Support Team_Binbin Yu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Rajeshkumaryarl]

We were able to see the record count in Snowflake. My question is can we do this in Power BI as well ?Now in refresh history, if i download and see , i see the number of rows processed as "NA"?The reason we want this information in Power BI is we want to examine the records count and if there is a large time difference in Power BI refrsh and snowflake refresh, so thst we can understand where issue is there so tht perfromance can be done in backend 

[lbendlin]

click the download button and examine the csv.