Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
Anonymous
Not applicable

Dynamic web content scraping where URL doesn't change

Hello,

 

I can find lots of cases where you can get the data from web pages dynamically as the parameters change in the URL, however I was interested in such a scenario where the web content is changed say by picking an item from the drop down list, and this change doesn't get reflected in the URL. The example is below. I was wondering and hoping that you could help. Thanks in advance - Di

 

E.g.  the UR is https://azure.microsoft.com/en-us/pricing/details/virtual-machines/linux/

 

In the web page when I iterate through the OS options the URL gets updated accordingly and therefore it's easy to get the pricing tables, but when I go through the Region drop down the URL doesn't get changed, but the pricing in the tables does. So my question is how can you loop through the regions' list and get the updated pricing tables?

3 REPLIES 3
v-piga-msft
Resident Rockstar
Resident Rockstar

Hi @Anonymous ,

By my tests and research, I'm afraid that we cannot get the data from web pages when the change doesn't get reflected in the URL in Power BI currently. We only could get data based on the URL.

Actually, when you get data from the web url, you get all of the data. I think you could create the Region slicer to filter the price when you create the report in power bi.

Best  Regards,

Cherry

 

Community Support Team _ Cherry Gao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Anonymous
Not applicable

Thanks @v-piga-msft ,

 

I pulled the regions into a slicer but by switching between the regions the pricing in the query table doesn't get updated dynamically. I guess because the region list is actually not a table in the webpage? Could you give more hints on how I can get the pricing updated after picking different regions?

Hi @Anonymous ,

Yes, you're right. The region list is actually not a table in the webpage, so we cannot extract the data via web connector in power bi currenly.

Sorry, I cannot help further on this case. Hope others have better ideas.

Best  Regards,

Cherry

 

Community Support Team _ Cherry Gao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors