cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
vyacheslavg Helper II
Helper II

Iterate Over Web Pages using Web Connector

Hello Community, 

 

Could you please advise how to work with web connector. 

 

I want to collect information from several pages and get a single table (if possible).

 

The typical URL is:

 

https://test.com.aspx?component=1

 

On this page there are several tables, and Power BI web connector is perfectly able to parse these html tables.

 

Also I have a list of components ids table I want to scrap/download tables.

 

For example:

 

component
1
5
7
42

 

For component id = 42, the URL would be https://test.com.aspx?component=42

 

I want Power BI to take Ids from this list and download tables for these ids.

Would be perfect if tables will be concatenated.

 

Any ideas or suggestions would be appreciated. 

My thinking is I need some advanced Power Query/M and Parameters?

1 ACCEPTED SOLUTION

Accepted Solutions
Microsoft v-yulgu-msft
Microsoft

Re: Iterate Over Web Pages using Web Connector

Hi @vyacheslavg,

 

Per my research, you could refer to below blogs 

Loop through Multiple Web Pages using Power Query

Iterating over multiple pages of web data using Power Query

 

Regards,

Yuliana Gu

Community Support Team _ Yuliana Gu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

2 REPLIES 2
Microsoft v-yulgu-msft
Microsoft

Re: Iterate Over Web Pages using Web Connector

Hi @vyacheslavg,

 

Per my research, you could refer to below blogs 

Loop through Multiple Web Pages using Power Query

Iterating over multiple pages of web data using Power Query

 

Regards,

Yuliana Gu

Community Support Team _ Yuliana Gu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

Highlighted
vyacheslavg Helper II
Helper II

Re: Iterate Over Web Pages using Web Connector

This is exactly what I was looking for.

He even shows couple of methods - thru functions-iterators and thru generated table - iterators.

In my case I already have a table thru which I want to iterate, which makes the exercise easier.

 

Thanks a lot!

Helpful resources

Announcements
New Ranks Launched March 24th!

New Ranks Launched March 24th!

The time has come: We are finally able to share more details on the brand-new ranks coming to the Power BI Community!

‘Better Together’ Contest Finalists Announced!

‘Better Together’ Contest Finalists Announced!

Congrats to the finalists of our ‘Better Together’-themed T-shirt design contest! Click for the top entries.

Arun 'Triple A' Event Video, Q&A, and Slides

Arun 'Triple A' Event Video, Q&A, and Slides

Missed the Arun 'Triple A' event or want to revisit it? We've got you covered! Check out the video, Q&A, and slides now.

Join THE global Microsoft Power Platform event series.

Join THE global Power Platform event series.

Attend for two days of expert-led learning and innovation on topics like AI and Analytics, powered by Dynamic Communities.

Community Summit North America

Community Summit North America

Innovate, Collaborate, Grow. The top training and networking event across the globe for Microsoft Business Applications

Top Solution Authors
Top Kudoed Authors