cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
Super User II
Super User II

web scraping and keeping historical data

I need to scrape data from a webpage but then i also need to keep historical data, it gets overwritten on the website.    Has anyone been able to figure out how to do this?  

 

ie

 

1) pull data from a web page

2) store and not overwrite when new data comes in?





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!




3 REPLIES 3
Highlighted
Super User II
Super User II

Re: web scraping and keeping historical data

bumping this to see if anyone has any thoughts on this?





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!




Highlighted
Anonymous
Not applicable

Re: web scraping and keeping historical data

Do you mean scraping with the "Get data" in Power BI?

Highlighted
Microsoft
Microsoft

Re: web scraping and keeping historical data

Hi @vanessafvg,

 

Please check the workarounds mentioned in this thread, as currently, there is no direct way to keep historical data when refreshing data.

 

Someone has submitted this idea to Microsoft, you could click to vote it up. And this topic is under review, it might be added to future release. 

 

Best regards,
Yuliana Gu

Community Support Team _ Yuliana Gu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources

Announcements

August Community Highlights

Check out a full recap of the month!

Experience what’s next for Power BI

Join us for an in-depth look at the new Power BI features and capabilities at the free Microsoft Business Applications Launch Event.

Top Solution Authors