I recently found a bug with power bi service alerts. We currently have a data quality dashboard that monitors certain aspects of our power bi datasets. We had a user of our dashboard notice that one of the historical totals had changed when some new data came into the system. This is one of the totals that we had set an alert for and it should have set alerted us but isntead when I opened the dashboard to troubleshoot the issue, it loaded and then I got all the alerts.
I think this must be a bug because I shouldn't have to have the dashboard open in order to see the alerts.