Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!
I have 2 dataflows containing tables from separate sources (Archives and Current) both whose sources are hosted on Sharepoint. We're trying to combine both dataflows into one dataflow and standardize the columns into one format. The Archives data should have about 10 years worth of data.
I pull a table each from the Archives and Current dataflows and try to combine them into 1 table in the Combined dataflow however at the 10 minute mark, the query timeouts and I am unable to proceed with validating the queries in the dataflow. Is there something I can do to fix this? Or a better way of doing this?
Have you considered incremental refresh and bootstrapping of partitions? You can then refresh individual partitions independently.
Advanced incremental refresh with the XMLA endpoint in Power BI - Power BI | Microsoft Docs