Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
thelvyn78
Frequent Visitor

Creating a History table with a data flow

I have a JSON web query that pulls back a table of information.  (about 2400 rows).  This information does not have any date information in it.  I'm trying to keep a running history of what this data is daily.  I'm trying to do a refresh of the data once a day and add a date stamp to it when the query runs.  This works great but overwrites the data after each refresh, so it's not keeping the values from the previous days.  I've tried several workarounds where you use 2 tables and append the main table, which does not seem to work for me.  I think it may be because I'm using a calculated column for the date time stamp.  I have tried incremental refresh, but I get errors when I try to turn it on saying the query cannot be saved, with no other reason for the error.  I'm working in a premium workspace but from what I gather, incremental refresh works with pro accounts now also.  is this possible in Power BI?  

 

 
 
 
 
 
 
 
1 REPLY 1
lbendlin
Super User
Super User

No.  Use Power Automate to pull your JSON daily, slap the timestamp on, and save the data somewhere as a CSV file on a Onedrive or something. Then point Power BI to that OneDrive folder and consume the CSV files.

 

For a ore modern experience, ignore the CSV part and save the JSON as is - Power BI can read that just fine, and you can use the filedate as the timestamp.

 

You could even do incremental refresh but that's overkill with just 2400 rows per day.

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors