Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.
Hi everyone,
Is it possible use the Incremental Refresh using the sequencial number instead of date?
I am working in one project that using data with trillions of line and when the module is update the server crash.
I was using the transaction date as a parameter to do the incremental refresh and unfortunatelly for a lot of reason this date can not be using as a parameter. So, the DBA told me that the best away to refresh the data is by using the sequencial number as a paramter.
I need to find one solution to store the rows from the last 4 or 5 years and just refresh the data based on the last sequencial number. As I can show in the example below:
COMPANY |TRANSACTION DATE |SEQUENCIAL NUMBER|AMOUNT
TEST1 |01-01-17 |127953 | 1
TEST1 |01-01-17 |127954 | 1
TEST1 |01-01-17 |127955 | 1
TEST1 |01-01-18 |127956 | 1
TEST1 |01-01-18 |127957 | 1
TEST1 |01-01-18 |127958 | 1
TEST1 |01-01-19 |127959 | 1
TEST1 |01-01-19 |127960 | 1
TEST1 |01-01-19 |127961 | 1
TEST1 |01-01-20 |127962 | 1
TEST1 |01-01-20 |127963 | 1
TEST1 |01-01-20 |127964 | 1
TEST1 |01-01-21 |127965 | 1
TEST1 |01-02-21 |127966 | 1
TEST1 |19-04-21 |127967 | 2
TEST1 |19-04-21 |127968 | 2
TEST1 |20-04-21 |127969 | 2
On this cenario the last sequencial was 127968 and I whould like that the refresh just happend from
the next sequencial number which is "127969" . So the module should keep all the data from 127953 to 127968 and refresh just the next sequencial number.
I tried to use a incremental refresh by using the sequencial number as parameter list but it dont works, or I didnt did the correct steps.
Is the are any solution for this case?
Can you please help me? I`m stuck trying to find this solution
Note: As the information is confidential I cant share the data.
Thanks
Hi @fabiolamelo ,
I'm afraid it can not be simply done by incremental refresh.Try to realize it in sql server or other database,then connect the updated data to power bi .
Best Regards,
Kelly
Did I answer your question? Mark my post as a solution!
Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City
Check out the April 2024 Power BI update to learn about new features.
User | Count |
---|---|
110 | |
94 | |
82 | |
66 | |
58 |
User | Count |
---|---|
151 | |
121 | |
104 | |
87 | |
67 |