cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
SLR71
Frequent Visitor

Get data from multiple pages on a website - no page # in URL

Hi,

I am trying to extract all the pages of data from this URL https://www.cahss.ca/surveillanceDiseaseAlert/equine/ . I am able to bring in the first 10 in a nice table with web connector and extract HTML but I need all the pages. The URL does not change as you move through the pages on the site.

 

I have looked at a number of the suggestions in the forum

https://www.mattmasson.com/2014/11/iterating-over-multiple-pages-of-web-data-using-power-query/

https://exceleratorbi.com.au/using-power-query-extracting-non-tabular-data-web-pages/

https://www.sumproduct.com/thought/referencing-multi-page-data-from-a-web-site-with-a-single-url

 

but all require the URL to have a page number reference which mine does not have.

 

Any help would be appreciated.

Thanks

1 ACCEPTED SOLUTION
SLR71
Frequent Visitor

Hello

Using just the first line of code from https://www.mattmasson.com/2014/11/iterating-over-multiple-pages-of-web-data-using-power-query/ as an example, I tried: 

 

= Web.Page(Web.Contents("https://www.cahss.ca/surveillanceDiseaseAlert/equine/"))

This resulted in a table that I could expand with all the pages required.

 

As soon as I ask for help . . . the brain kicks in.

View solution in original post

2 REPLIES 2
SLR71
Frequent Visitor

Hello

Using just the first line of code from https://www.mattmasson.com/2014/11/iterating-over-multiple-pages-of-web-data-using-power-query/ as an example, I tried: 

 

= Web.Page(Web.Contents("https://www.cahss.ca/surveillanceDiseaseAlert/equine/"))

This resulted in a table that I could expand with all the pages required.

 

As soon as I ask for help . . . the brain kicks in.

View solution in original post

This is great! So how do you get the data into excel?

Helpful resources

Announcements
MBAS on Demand

2021 Release Wave 2 Plan

Power Platform release plan for the 2021 release wave 2 describes all new features releasing from October 2021 through March 2022.

July 2021 Update 768x460.png

Check it out!

Click here to read more about the July 2021 Updates

Power Query PA Forum 768x460.png

Check it out!

Did you know that you can visit the Power Query Forum in Power BI and now Power Apps

Top Solution Authors
Top Kudoed Authors