cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
plymburner2
Frequent Visitor

Webscraping a Webpage with a Login and Password

I need some help working through an issue with trying to pull into both desktop and dataflows of a table of data behind a login and password.

 

The data is coming from https://fcafuel.org/historical-fuel-index/.

 

The public version includes historical data, yet not the current records.

 

The entire historical table is only available behind the pay wall.

 

I want to pull this data into a dataset for a report.

5 REPLIES 5
v-diye-msft
Community Support
Community Support

Hi @plymburner2 

 

Let me know if you'd like to get below data:

0009.PNG

You might refer to this article:

https://www.poweredsolutions.co/2018/05/14/new-web-scraping-experience-in-power-bi-power-query-using... 

 

Community Support Team _ Dina Ye
If this post helps, then please consider Accept it as the solution to help the other members find it more
quickly.

@v-diye-msft  Thanks for the suggestion.

 

I've already tried similar methods and run into the issues of not being able to pass/use login and password to access current values.

 

Instead, I run into the "Table highlighting is disabled..." error like in the thread below.

Get error message as Table Highlighting is disable... 

@plymburner2 

I tried to extract data form a website which required credentials and failed dismally. I eventually succeeded with a long workaround using Excel.

If you're interested, you can see how in this thread:

 

Get data from web with credentials 





Did I answer your question? Mark my post as a solution!
In doing so, you are also helping me. Thank you!

Proud to be a Super User!
Paul on Linkedin.






@PaulDBrown 

 

Thanks! I'll look into the link you sent and try it out.

@plymburner2 

Good luck! (btw, you still need the credentials to get into the dataset- the solution in the thread only solves the problem of getting access to the dataset going through the login requirements; it does not provide a back-entry avoiding login...)

 

EDIT: I just did a search for a solution using Python and came across this:

 

Scraping data from web which requires login using Python 





Did I answer your question? Mark my post as a solution!
In doing so, you are also helping me. Thank you!

Proud to be a Super User!
Paul on Linkedin.






Helpful resources

Announcements
August 1 episode 9_no_dates 768x460.jpg

The Power BI Community Show

Watch the playback when Priya Sathy and Charles Webb discuss Datamarts! Kelly also shares Power BI Community updates.

Power BI Dev Camp Session 24 without aka link and time 768x460.jpg

Ted's Dev Camp - July 28, 2022

Watch Session 24 of Ted's Dev Camp along with past sessions!

Power Platform Conf 2022 768x460.jpg

Join us for Microsoft Power Platform Conference

The first Microsoft-sponsored Power Platform Conference is coming in September. 100+ speakers, 150+ sessions, and what's new and next for Power Platform.

Top Solution Authors
Top Kudoed Authors