Showing results for 
Search instead for 
Did you mean: 
Willgart Regular Visitor
Regular Visitor

automated testing of a powerbi desktop report?



how I can implement some automated testing around PowerBI reports?

We have multiple Tabular models and SSAS cubes in place, and PowerBI desktop report connected to them.

I want to make sure that the reports still working when we release a new version of the source cube or model.


how can I do this?

(I will certainly ask the same things for Excel and SSRS reports, but for now we focus on powerbi)



Moderator v-qiuyu-msft

Re: automated testing of a powerbi desktop report?

Hi @Willgart,


After you update data and process the model on SSAS side, you can refresh the dataset in Power BI manually or use schedule refresh to update the data.


Best Regards,
Qiuyun Yu

Community Support Team _ Qiuyun Yu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Willgart Regular Visitor
Regular Visitor

Re: automated testing of a powerbi desktop report?

well... first  I'm using SSAS and Tabular to have shared models instead of multiple standalone powerbi files. (this also allows me to have model of any size)

so my powerbi are in directquery mode connected to these cube and models.


second I want to do automatic testing, not manual testing.

I want to make sure that all the existing reports did not suffer any issue due to a renaming or something like this.

and i want this done automatically to be done in minutes instead of hours of manual processes.

(the data side will be validated directly in the cube and tabular model, this is easy, and the main reason why I want to use direct query)


and if we have powerbi report with extracted data (which shoukd be a rare case) I'll want to test the refresh process.


if 1 of the report failed, we have to correct it before we releases our new cube or tabular model in prod.

We dont want to wait to be in prod and hearing a user crying...


Super User
Super User

Re: automated testing of a powerbi desktop report?

i am not sure if you can create a trace on the power bi service/ gateway, if there is a log that is generated with the values you require (maybe look in the audit log settings?), if you could access that data and do a power bi report and set an alert on it with a threshhold of errors > 0, that would be one way of checking for errors. 

Did I answer your question? Mark my post as a solution.
Proud a to be a Datanaut!
yarlagaddak Frequent Visitor
Frequent Visitor

Re: automated testing of a powerbi desktop report?

Hi Willgart,


I am currently in the same situation.

Have you figured any solution, appreciate if you share your findings.


I have 2 technologies in mind, CodedUI or Selenium+C#.