Embedded Query Duration Metrics - Very High

[MattCalderwood]

Hi All,

Over the weekend we had a sudden change to our query metcis output in Azure.

Approximately 2pm (GMT) query duration started increasing for no apparent reason - and it wont stop increasing.

BTW - we dont work over weekends so this is not a dpeloyment or change gone bad,

Query duration (average) on our premium capacity is now sat at 2.3 HOURS - when it normally sits within milliseconds (or a few seconds during busy periods). 

Anyone else seeing strange query duration metrics?
Using our applicatioin - everything appears to be working normally. Mondays are our busiest day of the week, so the site is always a little bit slow - but over 2 hours for a single query ??? dont think so.

I have switched premium capacity between 2 regions - and the same thing happens.
Its almost as if the average duration has become a cumulative sum of all queries. 

Keeping my fingers crossed that this is a metric calculation issue and not a genuine indication of something going horribly wrong with our data model.

Cheers,
Matt

[MattCalderwood]

Following on from this...

I used the Azure Embedded metrics to look at the COUNT of query duration events.
There is a noticable change at the exactly the same time things went bad.

Looks like this is a metrics issue as opposed to something wrong with the Power BI instance itself.

The annoying thing for us is that we have alerts set around performance., So things are looking really bad from that perspective. 

[auroraer_gjr]

We have the same issue. 

[v-qiuyu-msft]

Hi @MattCalderwood @auroraer_gjr, 

Please create a support ticket to get dedicated help. 

Best Regards,
Qiuyun Yu 

[MattCalderwood]

@v-qiuyu-msft @auroraer_gjr 

Ticket created - will update this thread with any results.

Thanks

[auroraer_admin]

We have done the same and will update too.

[MattCalderwood]

I had missed a call from MS Support - but they left a message saying that the issue has been identified. 
No ETA for a fix yet though.