I have a very large dataset of over 25 million rows and I set up a 90-day incremental refresh for it. But the refresh took nearly as long as the usual refresh. Does anybody know how to reduce the incremental refresh time?
Solved! Go to Solution.
I tried to use Dataflow and Snowflake. But they were both slow. I saw the warning of query folding when I set it up. Is there any other way I can speed up the refresh without changing the data source?
Thanks for the information. I applied incremental refresh for dataflow. But it shows the same warning as Snowflake: unable to confirm if the m query can be folded it is not recommended to use incremental refresh with non-foldable queries
Do you know what kind of data source support query folding?
I am fairly certain that if you are combining the 2 data source that the incremental refreshing process has to load all the data before it can incrementally load the data.
And that is why you are not seeing it saving any more time.
What happens if you try them individually?
Hi @GilbertQ ,
Thank you for your advice. I didn't make it clearly. I use dataflow and snowflake individually for incremental refresh and they both didn't work.
Check out new user group experience and if you are a leader please create your group!
Power Platform release plan for the 2021 release wave 2 describes all new features releasing from October 2021 through March 2022.
Click here to read more about the July 2021 Updates
Did you know that you can visit the Power Query Forum in Power BI and now Power Apps