Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more.
Get startedGrow your Fabric skills and prepare for the DP-600 certification exam by completing the latest Microsoft Fabric challenge.
Hi, I have a power query that is extracting the data using the rest API.
My requirement is to run the query first to extract all the records using the below query:
this will extract all the records from the table. Now I want to run the same query but only want to extract records updated in the last 7 days. What changes I need to make in the query so it should check if there are already records in the table(power query) and
1.if not it will extract the entire dataset
2. if there are records in the table then it should only extract the updated dataset. Something like this
https://<host>/api/now/table/incident?sysparm_query=sys_created_onONToday%40javascript%3Ags.beginningOfToday()%40javascript%3Ags.endOfToday()%5EORsys_updated_onBETWEENjavascript%3Ags.beginningOfToday()%40javascript%3Ags.beginningOfLast7Days()
Solved! Go to Solution.
Hi @Anonymous
Power Query does not have a capability to store the data, so every time you run the script it will pull the data preview egain or it will pull whole data when you load into the model.
You could use dataflows to simulate your scenerio with incremental refresh if your sorce suports it and you are lucky enough to be on premium.
You can think of Power Query as a ETL tool not a storage db.
Please see the below for the ref.
https://docs.microsoft.com/en-us/power-query/power-query-what-is-power-query
Hi @Anonymous
Power Query does not have a capability to store the data, so every time you run the script it will pull the data preview egain or it will pull whole data when you load into the model.
You could use dataflows to simulate your scenerio with incremental refresh if your sorce suports it and you are lucky enough to be on premium.
You can think of Power Query as a ETL tool not a storage db.
Please see the below for the ref.
https://docs.microsoft.com/en-us/power-query/power-query-what-is-power-query