Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
npowerbi
Helper I
Helper I

Table Count of loaded data / Validation of Incremental Load

Hi Folks,

 

I am trying to connect to a database in import mode and fetching records. I am checking if we can implement incremental load functionality.

 

For this purpose I need a quick table count of loaded tables every 2 hours. Kindly guide me if there is any quick way to get table count and store it for testing purpose.

 

Here is the workflow I am planning for my incremental load testing.

 

  1. I connect to a table A and load the entire table. [Need to quickly check table count. As of now it shows only 199+ because of large volume]. I need to store this count in custom table as well e.g. today's date, today's time and table count
  2. Let's say initial run table loads 10K records
  3. If I schedule next run in next 4 hours, and fetches 1 K records, I need to enter today's date, time and 1 K as an entry

This will confirm that my next run has fetched only 1 K records.

 

It will be great if you can suggest a better approach confirm my incremental loads

 

 

 

 

2 REPLIES 2
Greg_Deckler
Super User
Super User

Hmm, maybe the REST API?

 

https://docs.microsoft.com/en-us/rest/api/power-bi/admin

 


@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...

Just to add to this, if you get your dataset, it has a definition for tables and a method in tables for getting rows in a table.

 

https://docs.microsoft.com/en-us/rest/api/power-bi/datasets/getdatasetbyid

 


@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors