cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
npowerbi Regular Visitor
Regular Visitor

Table Count of loaded data / Validation of Incremental Load

Hi Folks,

 

I am trying to connect to a database in import mode and fetching records. I am checking if we can implement incremental load functionality.

 

For this purpose I need a quick table count of loaded tables every 2 hours. Kindly guide me if there is any quick way to get table count and store it for testing purpose.

 

Here is the workflow I am planning for my incremental load testing.

 

  1. I connect to a table A and load the entire table. [Need to quickly check table count. As of now it shows only 199+ because of large volume]. I need to store this count in custom table as well e.g. today's date, today's time and table count
  2. Let's say initial run table loads 10K records
  3. If I schedule next run in next 4 hours, and fetches 1 K records, I need to enter today's date, time and 1 K as an entry

This will confirm that my next run has fetched only 1 K records.

 

It will be great if you can suggest a better approach confirm my incremental loads

 

 

 

 

2 REPLIES 2
Super User
Super User

Re: Table Count of loaded data / Validation of Incremental Load

Hmm, maybe the REST API?

 

https://docs.microsoft.com/en-us/rest/api/power-bi/admin

 


Did I answer your question? Mark my post as a solution!

Proud to be a Datanaut!


Super User
Super User

Re: Table Count of loaded data / Validation of Incremental Load

Just to add to this, if you get your dataset, it has a definition for tables and a method in tables for getting rows in a table.

 

https://docs.microsoft.com/en-us/rest/api/power-bi/datasets/getdatasetbyid

 


Did I answer your question? Mark my post as a solution!

Proud to be a Datanaut!