EnterpriseGateway time out

[Anonymous]

Hi Community!

We are trying to import our fact table into dataflow. We have managed to import it spliting the fact table in weeks time periods, but there are so many dataflows. When we try to split the fact table in months or higher periods we have a time out error. Our source is a SQL Server query that usually takes from 10 min for a week period up to 35 min for a longer time periods.

We don´t have time out errors in the SQL Server manage studio when we execute the query

In the Power BI Serviece the operation keeps timing out and the logfile give us these error details:

- Failed to initialize report master: System.UnauthorizedAccessException: Access to the path 'D:\Gateway_Report' is denied

- Non-gateway exception encountered in activity scope: Microsoft.Data.Mashup.MashupHostingException (0x80004005): Timeout expired. The timeout period elapsed prior to completion of the operation.

We have tried increasing these parameters 'QueryExecutionAggregationTimeInMinutes' and 'SystemCounterAggregationTimeInMinutes' as we saw in this url (https://docs.microsoft.com/en-us/data-integration/gateway/service-gateway-performance) but the operation still times out. 

Hope you can help me!

[GilbertQ · Accepted solution]

Hi there

Why dont you use an incremental refresh on your dataflow?

That will then only refresh the latest data and NOT the entire dataset every time it refreshes.

Here is also my blog post explaining how to control the timeout from SQL Server https://www.fourmoo.com/2020/02/26/ensuring-your-power-bi-incremental-refresh-does-not-timeout-when-...

[Anonymous]

Hi,

The issue is that the dataflows in the service are the source of my Power bi desktop. So the time out error happens when I try to create the dataflow in the service with such a big SQL query . Then yes, I will do an incremental refresh while I will be uploading the report daily into the service

Best regards,

[GilbertQ]

Hi there

You can also configure incremental refreshing on your dataflow

https://docs.microsoft.com/en-us/power-bi/transform-model/service-dataflows-incremental-refresh

[Anonymous]

Hi,

It is a premium feature and we don´t have it yet but I hope that will work in a few days. 

Thank you GilbertQ

[GilbertQ]

Pleasure!