Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
albertoserinf
Regular Visitor

Scheduled refresh failed : There was an error when processing the data in the dataset.

When trying to update dataset in Power BI service by using the scheduled data refresh via the gateway I got this error messageerror2.PNG

 

error1.PNG

 

 

The pbix file has been created with Power BI Desktop and the datasource is an on-premise SQL server database.

 

Thanks for your hints.

 

Regards

 

Alberto

1 ACCEPTED SOLUTION

@v-yuezhe-msft

 

We solved this issue by creating a view of the table within the source database

Thanks for your hints.

Regards

 

Alberto

View solution in original post

6 REPLIES 6
v-yuezhe-msft
Employee
Employee

@albertoserinf,

The above error message points to Pick_fact_revenues table. Are you able to refresh the data when you open report in Power BI Desktop? And have you checked if there are any issues with Pick_fact_revenues  table in Power BI Desktop?

Regards,
Lydia

Community Support Team _ Lydia Zhang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Good morning Lydia

Yes, we are able to refresh data within Power BI Desktop.

We found out that the problem is linked to the size of the Pick_fact_reveneus table within the SQL database we connected to the datamodel.

Since this table is bigger than 10GB,  the uncompressed data received by the data gateway client exceeds the limit admitted for Power BI Pro.

Now my question is:

let's say that we find out a way within Power BI Desktop to reduce the amount of data we import from this table, but the size of this table reamains the same in the source database (bigger than 10GB).

What happens when we try to schedule a data refresh by using the data gateway? Does this limit still exist? 

Thanks @v-yuezhe-msft for your reply.

  

Regards

 

Alberto

 

 

@albertoserinf,

What is the size of your PBIX file? The maximum size for datasets imported into the Power BI service is 1 GB and Power BI Service places a limit on the amount of uncompressed data that is processed during refresh to 10 GB.

If you still hit the above two limitations, you are not able to refresh dataset in Power BI Service. You can use DirectQuery/Live connection mode to connect to your data source instead, or purchase Power BI Premium license to solve this issue.

Regards,
Lydia

Community Support Team _ Lydia Zhang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Hello @v-yuezhe-msft

 

the PBIX file is just 80MB...

The problem is that (as I mentioned in the previous post) one of the table of the sql database we connected as source is bigger than 10GB.

So my question is: is there a chance to filter data only of a specific table of the entire database you import in Power BI Desktop?

If we are able to avoid loading in Power BI Desktop all the data coming from the "pick fact revenues" table then probably the limitation of the table bigger than 10GB is no more valid. I guess so...

 

Thanks

@albertoserinf,

You can write T-SQL to select required columns and rows from this specific table, then load data to Power BI Desktop.
1.PNG

Regards,
Lydia

Community Support Team _ Lydia Zhang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

@v-yuezhe-msft

 

We solved this issue by creating a view of the table within the source database

Thanks for your hints.

Regards

 

Alberto

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors