Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more.
Get startedGrow your Fabric skills and prepare for the DP-600 certification exam by completing the latest Microsoft Fabric challenge.
Hi All
We are using Hybrid table in our data model using the Get the latest data in real time with DirectQuery (Premium only).
We are facing the data loss of few records. We have applied the incremental refresh as shown below where we have filtered the records on the basis of GLDGJ_G_LDate column and using the incremental policy to Detect data changes on the basis of SQDRRefreshTime date column. (SQDRRefreshTime column provides the information when the record is inserted or updated)
(GLDGJ_G_LDate is static used to create partitions whereas SQDRRefreshTime changes used to get the data changes)
We are facing this issue specifically for the records that are getting updated in the system (these are not new inserts)
For eg.
Record id | GLDGJ_G_LDate date | SQDRRefreshTime | type of record |
1 | 9th march | 9th march | new insert in db |
2 | 28-Feb | 9th march | updated an existing record in db |
Below is the screenshot of the missed records -
However, we get these records after refreshing the dataset.
Please help us understand shall we expect these records(updated records in db) as part of dataset refresh (incremental refresh) or direct query (in real time) of hybrid table
Ask questions in Eventhouse and KQL, Eventstream, and Reflex.
Check out the May 2024 Power BI update to learn about new features.