Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
arbiborje
Regular Visitor

Extract Data from Web for Multiple Pages with Non-Changing URLs

Hello! As the title says, I would just like to ask if it is possible to use the extract data from web feature of PBI to get data from a table in a webpage that has multiple pages, but non-changing URLs when you click on "Next Page." I see many examples explaining how it is possible to extract data for changing URLs e.g. ?page=1 for page 1 and ?page=2 for page 2, but I cannot seem to find a solution for tables that have non-changing URLs 😞

 

I cannot exactly disclose the website to extract data from but just to illustrate:

 

The URL I need to use is www.website.com/current-files

This URL has a table showing the result, with multiple pages. But when I click on "Next Page," the URL does not change, that's why I cannot use the 'Invoke Function' solution that is outlined in many blog posts.

 

I'd appreciate whatever ideas you may have. Thank you!

2 REPLIES 2
Greg_Deckler
Super User
Super User

Perhaps @ImkeF knows some magic for this. I suppose it might be possible if the entire table is loaded and it is just javascript magic that displays the right rows. If it is some kind of AJAX javascript call back, no idea.


@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
Mastering Power BI 2nd Edition

DAX is easy, CALCULATE makes DAX hard...

Sorry guys, no help with M on this one.

But you can check out UI Flows.

They use the SELENIUM enginge in the background for webscraping. (which you can use directly with Python, if you're proficient with it)

 

Imke Feldmann (The BIccountant)

If you liked my solution, please give it a thumbs up. And if I did answer your question, please mark this post as a solution. Thanks!

How to integrate M-code into your solution -- How to get your questions answered quickly -- How to provide sample data -- Check out more PBI- learning resources here -- Performance Tipps for M-queries

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors