I am writing this because I am getting fed up with the ill performance of Datawarehouse. Here is my current setup:
(External Data such as SQL, Sharepoint, and GA4) => (Dataflow Gen2) => (Data WareHouse) => (Dataset) => (Report)
The issue lies with the data warehouse, it is without fail that once or twice a week I have to manually go and click the refresh button on my Dataset that points at the data warehouse because the connection to the warehouse failed or timed out. A simple click of the refresh and it's fine. That would be find except now, the performance on the warehouse just tanked. Now when I try to do a simple select top 1 (seq_no) from Table I tried to let it load for over 30 minutes and no results. I have lost all faith in data warehouses.
I have also set up a data lake house in a different workspace and different project. This one is connected to a gen 2, and similar issues in the fact that without fail 1 or 2 times a week I have to go in and click the refresh button on the data set because it is unable to establish connection to the lake house. It works fine after that.
For reference:
Gateway is (3000.214.8) ( I know there is a new version, waiting on our network teams schedule to have it pushed, but this issue existed prior to the new release)
Let me know if you need anymore details or if i should just open a ticket.
