Extract Data from Web for Multiple Pages with Non-Changing URLs

[arbiborje]

Hello! As the title says, I would just like to ask if it is possible to use the extract data from web feature of PBI to get data from a table in a webpage that has multiple pages, but non-changing URLs when you click on "Next Page." I see many examples explaining how it is possible to extract data for changing URLs e.g. ?page=1 for page 1 and ?page=2 for page 2, but I cannot seem to find a solution for tables that have non-changing URLs 😞

I cannot exactly disclose the website to extract data from but just to illustrate:

The URL I need to use is www.website.com/current-files

This URL has a table showing the result, with multiple pages. But when I click on "Next Page," the URL does not change, that's why I cannot use the 'Invoke Function' solution that is outlined in many blog posts.

I'd appreciate whatever ideas you may have. Thank you!

[Greg_Deckler]

Perhaps @ImkeF knows some magic for this. I suppose it might be possible if the entire table is loaded and it is just javascript magic that displays the right rows. If it is some kind of AJAX javascript call back, no idea.

[ImkeF]

Sorry guys, no help with M on this one.

But you can check out UI Flows.

They use the SELENIUM enginge in the background for webscraping. (which you can use directly with Python, if you're proficient with it)