Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Grow your Fabric skills and prepare for the DP-600 certification exam by completing the latest Microsoft Fabric challenge.

Reply
AM_BSL
Frequent Visitor

All the Today's records are not appearing as part of Direct Query for Hybrid Tables

Hi All

We are using Hybrid table in our data model using the Get the latest data in real time with DirectQuery (Premium only).

We are facing the data loss of few records. We have applied the incremental refresh as shown below where we have filtered the records on the basis of GLDGJ_G_LDate column and using the incremental policy to Detect data changes on the basis of SQDRRefreshTime date column. (SQDRRefreshTime column provides the information when the record is inserted or updated)

(GLDGJ_G_LDate is static used to create partitions whereas SQDRRefreshTime changes used to get the data changes)

We are facing this issue specifically for the records that are getting updated in the system (these are not new inserts)

For eg. 

Record idGLDGJ_G_LDate dateSQDRRefreshTime type of record
19th march9th marchnew insert in db
228-Feb9th marchupdated an existing record in db

Below is the screenshot of the missed records -

AM_BSL_2-1678368553280.png

 

 

 

AM_BSL_0-1678368264811.png

However, we get these records after refreshing the dataset.

Please help us understand shall we expect these records(updated records in db) as part of dataset refresh (incremental refresh) or direct query (in real time) of hybrid table

AM_BSL_3-1678369123393.png

 

0 REPLIES 0

Helpful resources

Announcements
RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

MayPowerBICarousel1

Power BI Monthly Update - May 2024

Check out the May 2024 Power BI update to learn about new features.

Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

Top Solution Authors