Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.

Reply
thelvyn78
Frequent Visitor

Creating a History table with a data flow

I have a JSON web query that pulls back a table of information.  (about 2400 rows).  This information does not have any date information in it.  I'm trying to keep a running history of what this data is daily.  I'm trying to do a refresh of the data once a day and add a date stamp to it when the query runs.  This works great but overwrites the data after each refresh, so it's not keeping the values from the previous days.  I've tried several workarounds where you use 2 tables and append the main table, which does not seem to work for me.  I think it may be because I'm using a calculated column for the date time stamp.  I have tried incremental refresh, but I get errors when I try to turn it on saying the query cannot be saved, with no other reason for the error.  I'm working in a premium workspace but from what I gather, incremental refresh works with pro accounts now also.  is this possible in Power BI?  

 

 
 
 
 
 
 
 
1 REPLY 1
lbendlin
Super User
Super User

No.  Use Power Automate to pull your JSON daily, slap the timestamp on, and save the data somewhere as a CSV file on a Onedrive or something. Then point Power BI to that OneDrive folder and consume the CSV files.

 

For a ore modern experience, ignore the CSV part and save the JSON as is - Power BI can read that just fine, and you can use the filedate as the timestamp.

 

You could even do incremental refresh but that's overkill with just 2400 rows per day.

Helpful resources

Announcements
PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

Top Solution Authors
Top Kudoed Authors