cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
upfaffer
Regular Visitor

Dataload and Datasync

Hello,

 

looking some assistance to understand what happens in the backend.

There are at least two known option to load data:

  • Based on Dataset the Incremental Sync Option
  • Based on Dataset (as Part of a Datasource synced by a Gateeway)

So which option is the best option for which usecase?
What happens if i set the first option to once a day, are the dataset sync just do a incremental load?

 

What meas incremental Sync in detail only the new data are updated or also all data which are changed or deleted in the last day.
The public documentation around this topics are really poore...

 

Thx

3 REPLIES 3
v-kkf-msft
Community Support
Community Support

Hi @upfaffer ,

 

Has your problem been solved? If the problem is still not resolved, please provide detailed error information or the expected result you expect. Let me know immediately, looking forward to your reply.


Best Regards,
Winniz

v-kkf-msft
Community Support
Community Support

Hi @upfaffer ,

 

Are you referring to the difference between incremental refresh and full refresh of a dataset?


If you choose incremental refresh, first your data source should support query folding. Then set two date ranges, one for the stored data and one for the refresh, like this:

vkkfmsft_0-1648796121526.png

 

Suppose your data source contains data from 2022-3-25 to today (2022-4-1), and then you set these two ranges: 3 days and 1 day.

 

DateTime Value
3/25/2022 0:00 1
3/26/2022 0:00 2
3/27/2022 0:00 3
3/28/2022 0:00 4
3/29/2022 0:00 5
3/30/2022 0:00 6
3/31/2022 0:00 7
4/1/2022 0:00 8

 

Then modify the values in the data source to

 

DateTime Value
3/25/2022 0:00 1
3/26/2022 0:00 200
3/27/2022 0:00 3
3/28/2022 0:00 4
3/29/2022 0:00 500
3/30/2022 0:00 6
3/31/2022 0:00 90
4/1/2022 0:00 80

 

Then after refreshing on Service, the data in the dataset is

 

DateTime Value
3/28/2022 0:00 4
3/29/2022 0:00 5
3/30/2022 0:00 6
3/31/2022 0:00 90
4/1/2022 0:00 80

 

In other words, incremental refresh only performs refresh operations (insert/delete/update) on the data in the refresh range (3/31/2022 - 4/1/2022(today)).

 

If you have a large dataset and the data source supports query folding, then incremental refresh is a good choice. For more information, please refer to: Incremental refresh and real-time data for datasets 


If you have a small amount of data, or a live connected data source, then use full refresh. For more information, please refer to: Data refresh in Power BI 

 

 

If the problem is still not resolved, please provide detailed error information or the expected result you expect. Let me know immediately, looking forward to your reply.
Best Regards,
Winniz
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

 

Tutu_in_YYC
Memorable Member
Memorable Member

Are you referring to dataset refresh?

Helpful resources

Announcements
Power Platform Conf 2022 768x460.jpg

Join us for Microsoft Power Platform Conference

The first Microsoft-sponsored Power Platform Conference is coming in September. 100+ speakers, 150+ sessions, and what's new and next for Power Platform.

Power BI Dev Camp Session 23 768x460.jpg

Check it Out!

Mark your calendars and join us on Thursday, June 30 at 11a PDT for a great session with Ted Pattison!

Top Solution Authors