cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
atul06 Regular Visitor
Regular Visitor

Push Dataset Record Level Limitation (Live Connection)

I am getting below error in our Live Power BI connection setup (using Push dataset).  I have a large dataset about 600k rows.

 

Spoiler
Error : System.Net.WebException: The remote server returned an error: (429).

In this article - https://www.techtalkcorner.com/power-bi-api-dataset-limit/ - limitations are mentioned that 

  •  Send multiple rows in a single request (up to 10.000) but be aware of the limitation per hour (1.000.000)
  • Post Requests per minute which is 120 requests per dataset

 

Can any one help me understand these limiations?  Does it mean we can only push total 1million rows in an hour in one dataset?  Is there any similar record level limitation at workspace level?

 

Embed dataset via API

live connection limitation? 

1 ACCEPTED SOLUTION

Accepted Solutions
Community Support Team
Community Support Team

Re: Push Dataset Record Level Limitation (Live Connection)

HI @atul06 ,

I'd like to suggest you to take a look at following document first, it mention the limitations when you use post datasource.

Power BI REST API limitations

 

Spoiler

To POST Rows

  • 75 max columns
  • 75 max tables
  • 10,000 max rows per single POST rows request
  • 1,000,000 rows added per hour per dataset
  • 5 max pending POST rows requests per dataset
  • 120 POST rows requests per minute per dataset
  • If table has 250,000 or more rows, 120 POST rows requests per hour per dataset
  • 200,000 max rows stored per table in FIFO dataset
  • 5,000,000 max rows stored per table in ‘none retention policy’ dataset
  • 4,000 characters per value for string column in POST rows operation

 

>> Is there any similar record level limitation at workspace level?

As document said, power bi has limitation on data amount and frequency when you use rest api to send data. Current it not has limitations on workplace level, but you need to check your capacity amount to confirm if data amount are over limit.

Manage data storage in Power BI workspaces

Regards,

Xiaoxin Sheng

Community Support Team _ Xiaoxin Sheng
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.



For learning resources/Release notes, please visit: | |
2 REPLIES 2
Community Support Team
Community Support Team

Re: Push Dataset Record Level Limitation (Live Connection)

HI @atul06 ,

I'd like to suggest you to take a look at following document first, it mention the limitations when you use post datasource.

Power BI REST API limitations

 

Spoiler

To POST Rows

  • 75 max columns
  • 75 max tables
  • 10,000 max rows per single POST rows request
  • 1,000,000 rows added per hour per dataset
  • 5 max pending POST rows requests per dataset
  • 120 POST rows requests per minute per dataset
  • If table has 250,000 or more rows, 120 POST rows requests per hour per dataset
  • 200,000 max rows stored per table in FIFO dataset
  • 5,000,000 max rows stored per table in ‘none retention policy’ dataset
  • 4,000 characters per value for string column in POST rows operation

 

>> Is there any similar record level limitation at workspace level?

As document said, power bi has limitation on data amount and frequency when you use rest api to send data. Current it not has limitations on workplace level, but you need to check your capacity amount to confirm if data amount are over limit.

Manage data storage in Power BI workspaces

Regards,

Xiaoxin Sheng

Community Support Team _ Xiaoxin Sheng
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.



For learning resources/Release notes, please visit: | |
atul06 Regular Visitor
Regular Visitor

Re: Push Dataset Record Level Limitation (Live Connection)

Thank you so much @v-shex-msft .

 

I have a few follow up questions:

  • 75 max columns - Does it mean we cannot have more than 75 columns in one dataset (push)?
  • 75 max tables - What does it mean.. we cannot have more than one table in a single live dataset?
  • 10,000 max rows per single POST rows request - I am able to push 600k rows so is it working because we are sending multiple POST rows request?
  • 1,000,000 rows added per hour per dataset - in our setup, we our using live dataset in embedded reports.  There is one master PowerBI pro account that is used to Push the dataset.  I wan to ask.. if we have 10 requests accessing the same report - will it the records count be added from all the requests?  I am assuming the logical answer is yes. 
  • 120 POST rows requests per minute per dataset
  • If table has 250,000 or more rows, 120 POST rows requests per hour per dataset - this is confusing.. I am able to push 600k rows in 330 secs in one dataset.
  • 4,000 characters per value for string column in POST rows operation - It this the limit of max characters for string?

 

Kindly help!  Thank you so much in advance!

Helpful resources

Announcements
Virtual Launch Event

Microsoft Business Applications October Virtual Launch Event

Join us for an in-depth look at the new innovations across Dynamics 365 and the Microsoft Power Platform.

Power BI Helps Homeless and Trouble Youth

Power BI Helps Homeless and Trouble Youth

We spoke with Power BI Super User, Greg Deckler, about his charity work

MBAS Gallery

Watch Sessions On Demand!

Continue your learning in our online communities.

Users Online
Currently online: 39 members 1,098 guests
Please welcome our newest community members: