Create a report (verison 1), upload to service, pin a visual as a tile in a dashboard
In Desktop, edit the report's layout (not its data), add/delete graphs and other visual elements (report version 2)
Republish to the service, without re-pinning the visual to the dashboard
Here's the behavior I've seen:
The tile remains up-to-date with each and every subsequent refresh and republishing of the .pbix file to the service. This is expected.
When a user clicks on the dashboard tile, it takes them to report version 1's layout and visual elements. Changes made to the report are notreflected. This is unexpected.
If the report has multiple pages, a user can navigate to a different page, then back to the page containing the visual associated with the dashboard tile. In this case, report version 2's layout and visual elements are loaded.
It seems like the entire report page a pinned visual came from is being stored and recalled when a user clicks on the tile, instead of referencing the most up-to-date version of the report page. This doesn't seem right.