Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!
I have a very large dataset of over 25 million rows and I set up a 90-day incremental refresh for it. But the refresh took nearly as long as the usual refresh. Does anybody know how to reduce the incremental refresh time?
Solved! Go to Solution.
Hi,
I tried to use Dataflow and Snowflake. But they were both slow. I saw the warning of query folding when I set it up. Is there any other way I can speed up the refresh without changing the data source?
Thanks,
Snowflake and Dataflow
Thanks for the information. I applied incremental refresh for dataflow. But it shows the same warning as Snowflake: unable to confirm if the m query can be folded it is not recommended to use incremental refresh with non-foldable queries
Do you know what kind of data source support query folding?
Thanks,
No. I tried the same pbix file with two data sources and they both didn't work.
Hi @Anonymous
I am fairly certain that if you are combining the 2 data source that the incremental refreshing process has to load all the data before it can incrementally load the data.
And that is why you are not seeing it saving any more time.
What happens if you try them individually?
Hi @GilbertQ ,
Thank you for your advice. I didn't make it clearly. I use dataflow and snowflake individually for incremental refresh and they both didn't work.
Thanks,