Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.
Hello,
looking some assistance to understand what happens in the backend.
There are at least two known option to load data:
So which option is the best option for which usecase?
What happens if i set the first option to once a day, are the dataset sync just do a incremental load?
What meas incremental Sync in detail only the new data are updated or also all data which are changed or deleted in the last day.
The public documentation around this topics are really poore...
Thx
Hi @upfaffer ,
Has your problem been solved? If the problem is still not resolved, please provide detailed error information or the expected result you expect. Let me know immediately, looking forward to your reply.
Best Regards,
Winniz
Hi @upfaffer ,
Are you referring to the difference between incremental refresh and full refresh of a dataset?
If you choose incremental refresh, first your data source should support query folding. Then set two date ranges, one for the stored data and one for the refresh, like this:
Suppose your data source contains data from 2022-3-25 to today (2022-4-1), and then you set these two ranges: 3 days and 1 day.
DateTime | Value |
3/25/2022 0:00 | 1 |
3/26/2022 0:00 | 2 |
3/27/2022 0:00 | 3 |
3/28/2022 0:00 | 4 |
3/29/2022 0:00 | 5 |
3/30/2022 0:00 | 6 |
3/31/2022 0:00 | 7 |
4/1/2022 0:00 | 8 |
Then modify the values in the data source to
DateTime | Value |
3/25/2022 0:00 | 1 |
3/26/2022 0:00 | 200 |
3/27/2022 0:00 | 3 |
3/28/2022 0:00 | 4 |
3/29/2022 0:00 | 500 |
3/30/2022 0:00 | 6 |
3/31/2022 0:00 | 90 |
4/1/2022 0:00 | 80 |
Then after refreshing on Service, the data in the dataset is
DateTime | Value |
3/28/2022 0:00 | 4 |
3/29/2022 0:00 | 5 |
3/30/2022 0:00 | 6 |
3/31/2022 0:00 | 90 |
4/1/2022 0:00 | 80 |
In other words, incremental refresh only performs refresh operations (insert/delete/update) on the data in the refresh range (3/31/2022 - 4/1/2022(today)).
If you have a large dataset and the data source supports query folding, then incremental refresh is a good choice. For more information, please refer to: Incremental refresh and real-time data for datasets
If you have a small amount of data, or a live connected data source, then use full refresh. For more information, please refer to: Data refresh in Power BI
If the problem is still not resolved, please provide detailed error information or the expected result you expect. Let me know immediately, looking forward to your reply.
Best Regards,
Winniz
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Are you referring to dataset refresh?
Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City
Check out the April 2024 Power BI update to learn about new features.