Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
npowerbi
Helper I
Helper I

Table Count of loaded data / Validation of Incremental Load

Hi Folks,

 

I am trying to connect to a database in import mode and fetching records. I am checking if we can implement incremental load functionality.

 

For this purpose I need a quick table count of loaded tables every 2 hours. Kindly guide me if there is any quick way to get table count and store it for testing purpose.

 

Here is the workflow I am planning for my incremental load testing.

 

  1. I connect to a table A and load the entire table. [Need to quickly check table count. As of now it shows only 199+ because of large volume]. I need to store this count in custom table as well e.g. today's date, today's time and table count
  2. Let's say initial run table loads 10K records
  3. If I schedule next run in next 4 hours, and fetches 1 K records, I need to enter today's date, time and 1 K as an entry

This will confirm that my next run has fetched only 1 K records.

 

It will be great if you can suggest a better approach confirm my incremental loads

 

 

 

 

2 REPLIES 2
Greg_Deckler
Super User
Super User

Hmm, maybe the REST API?

 

https://docs.microsoft.com/en-us/rest/api/power-bi/admin

 


@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
Mastering Power BI 2nd Edition

DAX is easy, CALCULATE makes DAX hard...

Just to add to this, if you get your dataset, it has a definition for tables and a method in tables for getting rows in a table.

 

https://docs.microsoft.com/en-us/rest/api/power-bi/datasets/getdatasetbyid

 


@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
Mastering Power BI 2nd Edition

DAX is easy, CALCULATE makes DAX hard...

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.