Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!
Hello! As the title says, I would just like to ask if it is possible to use the extract data from web feature of PBI to get data from a table in a webpage that has multiple pages, but non-changing URLs when you click on "Next Page." I see many examples explaining how it is possible to extract data for changing URLs e.g. ?page=1 for page 1 and ?page=2 for page 2, but I cannot seem to find a solution for tables that have non-changing URLs 😞
I cannot exactly disclose the website to extract data from but just to illustrate:
The URL I need to use is www.website.com/current-files
This URL has a table showing the result, with multiple pages. But when I click on "Next Page," the URL does not change, that's why I cannot use the 'Invoke Function' solution that is outlined in many blog posts.
I'd appreciate whatever ideas you may have. Thank you!
Perhaps @ImkeF knows some magic for this. I suppose it might be possible if the entire table is loaded and it is just javascript magic that displays the right rows. If it is some kind of AJAX javascript call back, no idea.
Sorry guys, no help with M on this one.
But you can check out UI Flows.
They use the SELENIUM enginge in the background for webscraping. (which you can use directly with Python, if you're proficient with it)
Imke Feldmann (The BIccountant)
If you liked my solution, please give it a thumbs up. And if I did answer your question, please mark this post as a solution. Thanks!
How to integrate M-code into your solution -- How to get your questions answered quickly -- How to provide sample data -- Check out more PBI- learning resources here -- Performance Tipps for M-queries