Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Grow your Fabric skills and prepare for the DP-600 certification exam by completing the latest Microsoft Fabric challenge.

Reply
nandic
Memorable Member
Memorable Member

Dataset refresh is 2x faster - but also we have frequent timeout issues since March 2024

Hi,

Our dataset was taking 1.5 hours to refresh via Service for couple of years.

Starting with March 2024, our dataset refresh speed improved, it takes mainly 45-50 minutes. This is amazing as we didn't improve anything, it must be that Power BI service has improved.
However, since March 2024, we also see a lot of dataset refresh timeout failures. Refresh taking hours or even hitting 5 hours limit.

In March 2024, region WestEurope started using much more IP ranges (390 at the moment). Until then, it was 180.
Can this have the impact?

We use Premium P2, database is Amazon Redshift.
Region: West Europe.
There are no gateways, data structure is the same for years.
Capacity both on Power BI capacity and on Refshift capacity is below 50%.

We have open ticket at Microsoft for 2 months, not helpful at all.
Their product team can't confirm if IP addresses are issue and they have no idea what might be the issue.

HAS ANYONE ELSE SEEN IMPROVEMENT OF DATASET REFRESH SPEED SINCE MARCH 2024? 🙂

Best regards,
Nemanja Andic

2 REPLIES 2
nandic
Memorable Member
Memorable Member

@johnbasha33 did you see any change in dataset refresh on your side since March 2024?
Thumbs up for ChatGPT, but i appreciate more real answers.

johnbasha33
Solution Sage
Solution Sage

@nandic 

It's great to hear that you've experienced an improvement in dataset refresh speed since March 2024. However, the increase in dataset refresh timeout failures is concerning and could potentially be related to the increase in IP ranges used by the West Europe region.

Here are a few points to consider and steps you can take to address the timeout failures:

1. **Impact of Increased IP Ranges:** The increase in IP ranges used by the West Europe region could indeed have an impact on the dataset refresh process. If there are network-related issues, such as increased latency or packet loss, it could affect the performance of data transfer between Amazon Redshift and Power BI Service. You may want to investigate further to see if there are any network bottlenecks or issues that need to be addressed.

2. **Review Power BI Premium Capacity:** While you mentioned that the capacity on Power BI Premium (P2) is below 50%, it's still worth reviewing the resource utilization and performance metrics for your Premium capacity. Ensure that there are no resource contention issues or performance bottlenecks within your Premium capacity that could be contributing to the dataset refresh timeouts.

3. **Optimize Dataset Refresh:** Review the dataset refresh process and look for opportunities to optimize it. This could include optimizing queries, data loading strategies, or data transformation steps to reduce the overall refresh time and mitigate the risk of timeouts.

4. **Engage with Microsoft Support:** Continue working with Microsoft Support to address the dataset refresh timeout failures. Provide them with as much information as possible, including details about the increase in IP ranges, any changes made to the dataset or data source configuration, and any specific error messages or logs related to the timeout failures. While it's frustrating that they haven't been able to provide a definitive solution so far, persistence and thorough investigation may lead to a resolution.

5. **Community Engagement:** Reach out to the Power BI community forums or user groups to see if other users have experienced similar issues since March 2024. Sharing experiences and insights with other users may help identify common patterns or potential solutions.

By thoroughly investigating the potential causes of the dataset refresh timeout failures and engaging with Microsoft Support and the Power BI community, you can work towards resolving the issue and ensuring smooth and reliable dataset refreshes moving forward.

Did I answer your question? Mark my post as a solution! Appreciate your Kudos !!

Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

Top Solution Authors