Sheduled Dataflow Refresh(es) - Still running after 5 hours

[dataConnect]

Dear Microsoft Support Team,

currently we have the following issue regarding two sheduled Power BI Dataflow refreshes in Power BI Premium Capacity (P1) workspace(s), location: West Europe:

Sheduled refresh started at 03/02/2022 02:00:03 (UTC+1) and is still running.

• Standard Power BI Premium timeouts after 5 hours seems not working
• Cannot stopp refresh via cancel refresh in Dataflow options

• Cannot cancel refresh via Power BI Rest API "Dataflows - Cancel Dataflow Transaction" (https://docs.microsoft.com/en-us/rest/api/power-bi/dataflows/cancel-dataflow-transaction) in combination with Power BI REST API "Dataflows - Get Dataflow Transactions" (https://docs.microsoft.com/en-us/rest/api/power-bi/dataflows/get-dataflow-transactions)

How could I cancel these Dataflow refreshes? Many thanks in advance!

[jeffshieldsdev]

Schedule a dataflow refresh for shortly in the future, let it run, then clear/reset the schedule.  This will clear the stuck refresh.

[3username]

Currently dealing with the same issue with dataflows refreshing for hours on end, however I was able to cancel them. Refreshing them again, both manually and scheduled, still doesn't seem to work though.

[v-cazheng-msft]

Hi @dataConnect,

To investigate on such kind of issue, there are some info needed to be collected. Hence, please consider creating a support ticket in Power BI Support if you are a Pro user. Then, there will be a technical engineer to have a remote session with you to troubleshoot on it.

The link of Power BI Support: Support | Microsoft Power BI

For how to create a support ticket, please refer to How to create a support ticket in Power BI - Microsoft Power BI Community

It couldn’t be better if you post the root cause and solution here after you get them from the engineer to help others may encounter similar issue . Thanks in advance!

Best Regards,

Community Support Team _ Caiyun

[dataConnect]

Hi @v-cazheng-msft,

thanks for your response and sharing the how to create a support ticket with me. Currently we have a Microsoft Gold Partner Partnership :). So far my first support ticket here.

Luckily both Dataflows stopped running refreshes after more than 17 hours last night. Both worked fine in the past and finished regulary in under 20 minutes.

Dataflow 1 in Power BI Premium capacity (P1) workspace

Next sheduled run after error was sucessful.

Dataflow 2 in Power BI Premium capacity (P1) workspace

Following questions:

• What are the current standard timeouts for Power BI Dataflows in Premium capacity?
• Is it currently possible to adapt the standard timeouts for Power BI Dataflows in Premium capacity?
  

  Seems this is currently only possible for Datasets, correct?

• Do we have other oportunities to cancel Dataflow refrehes when Web GUI or REST API failed?
• Is it currently possible to monitor running Dataflow refreshes ala Visualise your Power BI Refresh - Phil Seamark on DAX with SQL-Profiler for Datasets? Is this may included inside of Azure Log Analytics or possible with the Premium Capacity App?
  
  Thanks in Advance! Greetings

[v-cazheng-msft]

Hi @dataConnect ,

Currently, for dataflow in Premium capacity, the timeout is 24 hours per dataflow and we don’t provide a feature to make a change to the timeout. For more details, you may refer to Dataflows Limitations, restrictions and supported connectors and features - Power BI | Microsoft Doc....

If you are using Premium Gen1, you could regulate the workload of dataflow. For more details, you may refer to Configure Power BI Premium dataflow workloads - Power BI | Microsoft Docs. But if you are using Premium Gen2, I remember there should be no options to adapt these metrics in a few months. And currently, something maybe change. You may refer to How to configure workloads in Power BI Premium - Power BI | Microsoft Docs.

Unfortunately, expect the Web UI and the Dataflows - Cancel Dataflow Transaction REST API, we don’t provide other methods to cancel dataflow refresh.

For using SQL Profiler, you could refer to Use SQL Server Profiler to Monitor Analysis Services | Microsoft Docs. And for what info will be recorded in Capacity app, you could refer to Monitor Power BI Premium capacities with the Premium Capacity Metrics app. - Power BI | Microsoft Do... and Monitor Power BI Premium Gen2 capacities with the Gen2 metrics app. - Power BI | Microsoft Docs.

For something related to Azure Log Analytics, please read this official document: Using Azure Log Analytics in Power BI (Preview) - Power BI | Microsoft Docs.

Best Regards,

Community Support Team _ Caiyun

[v-cazheng-msft]

Change the status fo this issue since related dataflows works well now. Support engineer will help figure out the root cause.