cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
tejald Frequent Visitor
Frequent Visitor

Online refresh is failing :The received uncompressed data on the gateway client has exceeded limit

Need Help: Manage storage is showing dataset size is 44 MB and over all size is 170 MB. Dataset has ~5M records. Desktop version refreshes in 5-7 mins but online refresh fails with error "The received uncompressed data on the gateway client has exceeded limit" 

16 REPLIES 16
Community Support Team
Community Support Team

Re: Online refresh is failing :The received uncompressed data on the gateway client has exceeded lim

Hi @tejald,

 

Basd on you description, I think you use the directquery mode to connect your datasource, right?

If this is a case, I'd like to suggest you take a look at below article first, current direct query has limitation about 1m records:

Use DirectQuery in Power BI Desktop

 

Power BI creates queries that are as efficient as possible. Under certain situations however, the generated query may not be efficient enough to avoid refresh that would fail. One example of this situation is when a generated query would retrieve an excessively large number of rows (more than 1 million) from the back-end data source, in which case the following error occurs:

The resultset of a query to external data source has exceeded
the maximum allowed size of '1000000' rows.

This situation can occur with a simple chart that includes a very high cardinality column, with the aggregation option set to Don’t Summarize. The visual needs to only have columns with a cardinality below 1 million, or must have appropriate filters applied.

 

Regards,

Xiaoxin Sheng

Community Support Team _ Xiaoxin Sheng
If this post helps, please consider Accept it as the solution to help the other members find it more quickly
Learning resources: Power BI
tejald Frequent Visitor
Frequent Visitor

Re: Online refresh is failing :The received uncompressed data on the gateway client has exceeded lim

Thanks Xiaoxin for your response. I am using import mode. Does same restriction apply to import mode as well? I can load up to ~ 3+Millions but failing after ~4 Millions rows. Data is coming from 4 different views(second one has 500k records, 3rd and and 4th views having unique records used for data modeling) with maximum of 20 columns in total. I am using filters for charts but if none is selected, it can load entire data specially table having details. Please advice.
Highlighted
ascendbi Regular Visitor
Regular Visitor

Re: Online refresh is failing :The received uncompressed data on the gateway client has exceeded lim

Hi @tejald and @v-shex-msft

 

We are also using Import Mode and now have 2 data models that are suddenly failing with the same error. We connect to SQL and Folder (.csv) files. 

 

One is 76 MB (45M Rows, 10 columns, Single Table) on the Group Storage (Gear > Manage Group Storage) after publishing and the other is 458 MB (Very complex, 1000+ measures, 12M row Fact Table, Many lookup tables, bi-directional cross filtering etc.). 

 

We have a ticket open with Microsoft (Via Office 365 Support Incident) but I am not sure why I bother. I am tired of training them on the product they are supporting. Waiting to get escalated i guess. 

 

Observations

We started having "Out of Memory" errors about 4 weeks ago for the large data model mentioned above. We opened a ticket and MS finally responded that they made some changes to the resources in the North Central US Data Center and the next day the errors went away. 

 

Then on June 7, 2017 the Uncompressed errors appeared and no Scheduled refresh has been OK since for either Dataset. What is strange is that there was  actually NO NEW data being made available for the smaller data model. It just suddenly became too large... This leads me to beleive that Microsoft Made some change likely due to / related to the Premium Product. I say this because the the wording on this page: Troubleshooting refresh scenarios 

  • Uncompressed data limits for refresh

    The maximum size for datasets imported into the Power BI service is 1 GB. These datasets are heavily compressed to ensure high performance. In addition, in shared capacity, the service places a limit on the amount of uncompressed data that is processed during refresh. This limit accounts for the compression, and therefore is much higher than 1 GB. Datasets in Power BI Premium are not subject to this limit. If refresh in the Power BI service fails for this reason, please reduce the amount of data being imported to Power BI and try again.

 

We have a workaround: Refresh and republish the .pbix in Power BI Desktop and the data will "refresh"  even though the immediate refresh attemmpt back via the Data Gateway reports as another failure. 

 

Refresh history for large 450 MB Dataset
ScheduledOneDrive
Details Type Start End Status Message
Show
On demand6/9/2017, 8:10:58 AM6/9/2017, 9:00:30 AMFailedThe received uncompressed data on the gateway client has exceeded limit.
Show
On demand6/9/2017, 6:34:03 AM6/9/2017, 7:25:01 AMFailedThe received uncompressed data on the gateway client has exceeded limit.
Show
Scheduled6/9/2017, 3:30:10 AM6/9/2017, 5:12:10 AMFailedThe received uncompressed data on the gateway client has exceeded limit.
Show
On demand6/8/2017, 9:49:25 AM6/8/2017, 10:42:41 AMFailedThe received uncompressed data on the gateway client has exceeded limit.
Show
Scheduled6/8/2017, 3:31:29 AM6/8/2017, 5:17:17 AMFailedThe received uncompressed data on the gateway client has exceeded limit.
Show
On demand6/7/2017, 3:04:13 PM6/7/2017, 3:44:43 PMFailedThe received uncompressed data on the gateway client has exceeded limit.
Show
On demand6/7/2017, 2:11:54 PM6/7/2017, 3:04:12 PMFailedThe received uncompressed data on the gateway client has exceeded limit.
Show
On demand6/7/2017, 7:05:17 AM6/7/2017, 7:55:56 AMFailedThe received uncompressed data on the gateway client has exceeded limit.
Show
Scheduled6/7/2017, 3:31:20 AM6/7/2017, 5:42:40 AMFailedThe received uncompressed data on the gateway client has exceeded limit.
 Scheduled6/6/2017, 3:31:24 AM6/6/2017, 5:16:02 AMCompleted 
 Scheduled6/5/2017, 3:31:15 AM6/5/2017, 5:14:06 AMCompleted 
 Scheduled6/4/2017, 3:31:12 AM6/4/2017, 5:09:03 AMCompleted 
 Scheduled6/3/2017, 3:31:10 AM6/3/2017, 5:15:39 AMCompleted 
 Scheduled6/2/2017, 3:31:35 AM6/2/2017, 5:03:35 AMCompleted 
 Scheduled6/1/2017, 3:31:19 AM6/1/2017, 6:55:43 AMCompleted 
 Scheduled5/31/2017, 3:31:20 AM5/31/2017, 5:07:06 AMCompleted 
 Scheduled5/30/2017, 3:31:04 AM5/30/2017, 4:59:47 AMCompleted 
 Scheduled5/29/2017, 3:31:07 AM5/29/2017, 4:59:02 AMCompleted 
 Scheduled5/28/2017, 3:31:19 AM5/28/2017, 5:02:21 AMCompleted 
 Scheduled5/27/2017, 3:31:06 AM5/27/2017, 6:08:17 AMCompleted

 

 

Refresh history for smaller Dataset
ScheduledOneDrive
Details Type Start End Status Message
Show
Scheduled6/9/2017, 9:30:13 AM6/9/2017, 10:11:01 AMFailedThe received uncompressed data on the gateway client has exceeded limit.
Show
Scheduled6/8/2017, 9:31:27 AM6/8/2017, 10:27:08 AMFailedThe received uncompressed data on the gateway client has exceeded limit.
Show
Scheduled6/7/2017, 9:31:14 AM6/7/2017, 10:15:21 AMFailedThe received uncompressed data on the gateway client has exceeded limit.
 Scheduled6/6/2017, 9:31:22 AM6/6/2017, 10:03:42 AMCompleted 
 Scheduled6/5/2017, 9:31:19 AM6/5/2017, 10:01:24 AMCompleted 
 Scheduled6/4/2017, 9:31:23 AM6/4/2017, 10:00:34 AMCompleted 
 Scheduled6/3/2017, 9:31:25 AM6/3/2017, 10:00:53 AMCompleted 
 Scheduled6/2/2017, 9:32:05 AM6/2/2017, 10:02:07 AMCompleted 
 Scheduled6/1/2017, 9:31:55 AM6/1/2017, 10:14:58 AMCompleted 
 Scheduled5/31/2017, 9:31:26 AM5/31/2017, 10:00:27 AMCompleted 
 Scheduled5/30/2017, 9:31:26 AM5/30/2017, 10:01:03 AMCompleted 
 Scheduled5/29/2017, 9:31:22 AM5/29/2017, 9:58:28 AMCompleted 
 Scheduled5/28/2017, 9:31:09 AM5/28/2017, 9:58:07 AMCompleted 
 Scheduled5/27/2017, 9:31:04 AM5/27/2017, 9:51:40 AMCompleted 
 Scheduled5/26/2017, 9:31:22 AM5/26/2017, 10:00:34 AMCompleted 
 Scheduled5/25/2017, 9:31:20 AM5/25/2017, 10:01:43 AMCompleted 
 Scheduled5/24/2017, 9:31:07 AM5/24/2017, 10:02:36 AMCompleted 
 Scheduled5/23/2017, 9:31:38 AM5/23/2017, 9:58:49 AMCompleted 
 Scheduled5/22/2017, 9:30:16 AM5/22/2017, 10:11:08 AMCompleted 
 Scheduled5/21/2017, 9:33:38 AM5/21/2017, 10:02:38 AMCompleted
tejald Frequent Visitor
Frequent Visitor

Re: Online refresh is failing :The received uncompressed data on the gateway client has exceeded lim

As mentioned my PBIX size is 86.5 MB and after compression it shows 37 MB still I am getting this error. Uploading PBIX is manual effort and we want to get it refreshed frequently during business hours. It seems to be restriction with number of records.

Any help is appriciated.

 

Thanks,

Tejal

CasperAbakion Frequent Visitor
Frequent Visitor

Re: Online refresh is failing :The received uncompressed data on the gateway client has exceeded lim

We also have this problem with two of our customer's solutions. I found four  posts on it on the forums. It would be really nice to get this solved.

 

Last refresh failed: Wed Jun 14 2017 10:40:20 GMT+0200 (Romance Daylight Time)
The received uncompressed data on the gateway client has exceeded limit.
Hide details

Cluster URI:WABI-NORTH-EUROPE-redirect.analysis.windows.net
Activity ID:d748407e-178a-d40e-e1d4-bca80d794676
Request ID:5f15b9a9-10ab-fe8d-98be-bfdb9257dd61
Time:2017-06-14 08:40:20Z

 

 

Last refresh failed: Wed Jun 14 2017 00:25:38 GMT+0200 (Romance Daylight Time)
The received uncompressed data on the gateway client has exceeded limit.
Hide details

Cluster URI:WABI-NORTH-EUROPE-redirect.analysis.windows.net
Activity ID:be47e442-a91a-49d7-9f9f-5e4e6562c964
Request ID:07225bac-8945-48b9-8e5a-0171afa8c1fe
Time:2017-06-13 22:25:38Z

 

Community Support Team
Community Support Team

Re: Online refresh is failing :The received uncompressed data on the gateway client has exceeded lim

Hi @tejald,

 

There are other users report this issue to power bi team with CRI 39670466, I will update here once it has any modifies.

 

Regards,

Xiaoxin Sheng

 

 

Community Support Team _ Xiaoxin Sheng
If this post helps, please consider Accept it as the solution to help the other members find it more quickly
Learning resources: Power BI
vidotom Regular Visitor
Regular Visitor

Re: Online refresh is failing :The received uncompressed data on the gateway client has exceeded lim

I also ran into the "The received uncompressed data on the gateway client has exceeded limit" error with some 325 MB dataset (import from text files).

 

Something tells me that they re-allocated existing resources to the premium tenants, and introduced some not-disclosed limits on the non-premium tenants in order to make the premium work. If so, then this is quite a dirty way of managing limited resources... And unacceptable if you ask me.

ascendbi Regular Visitor
Regular Visitor

Re: Online refresh is failing :The received uncompressed data on the gateway client has exceeded lim

Hi Everyone, 

 

I receive the following notice from Microsoft Support and Engineering yesterday. They have confimred that this is a bug. No ETA other that "soon". 

 

Date: Tue, 20 Jun 2017 18:28:39 (UTC -04:00)

Hello David,

 

After extensive research we found out that this is a bug. I have notified the product group and I have created bug tracking number for them. They are working on this issue and this issue should be resolved soon. I will get back to you once I receive an update from my product group.

 

 

Regards,

Engineer - Microsoft Business Intelligence

 

tejald Frequent Visitor
Frequent Visitor

Re: Online refresh is failing :The received uncompressed data on the gateway client has exceeded lim

Thanks for providing update to us.

Please update on this thread once you receive further communication on this bug. 

Helpful resources

Announcements
Exclusive LIVE Community Event #3 – Ask Arun Anything

Exclusive LIVE Community Event #3 – Ask Arun Anything

Join us in the third Triple A event!

Meet the 2020 Season 1 Power BI Super Users!

Meet the 2020 Season 1 Power BI Super Users!

It’s the start of a new Super User season! Learn all about the new Super Users and brand-new tiered recognition system.

Super User Challenge: Can You Solve These?

Super User Challenge: Can You Solve These?

We're celebrating the start of the New Super User season with our first ever Super User 'Can You Solve These?' challenge.

January 2020 Community Highlights

January 2020 Community Highlights

Make sure you didn't miss any of the things that happened in the community in January!

Top Solution Authors