Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
vanessafvg
Super User
Super User

web scraping and keeping historical data

I need to scrape data from a webpage but then i also need to keep historical data, it gets overwritten on the website.    Has anyone been able to figure out how to do this?  

 

ie

 

1) pull data from a web page

2) store and not overwrite when new data comes in?





If I took the time to answer your question and I came up with a solution, please mark my post as a solution and /or give kudos freely for the effort 🙂 Thank you!

Proud to be a Super User!




3 REPLIES 3
v-yulgu-msft
Employee
Employee

Hi @vanessafvg,

 

Please check the workarounds mentioned in this thread, as currently, there is no direct way to keep historical data when refreshing data.

 

Someone has submitted this idea to Microsoft, you could click to vote it up. And this topic is under review, it might be added to future release. 

 

Best regards,
Yuliana Gu

Community Support Team _ Yuliana Gu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
vanessafvg
Super User
Super User

bumping this to see if anyone has any thoughts on this?





If I took the time to answer your question and I came up with a solution, please mark my post as a solution and /or give kudos freely for the effort 🙂 Thank you!

Proud to be a Super User!




Anonymous
Not applicable

Do you mean scraping with the "Get data" in Power BI?

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.