cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Frequent Visitor

Get data from multiple pages on a website - no page # in URL

Hi,

I am trying to extract all the pages of data from this URL https://www.cahss.ca/surveillanceDiseaseAlert/equine/ . I am able to bring in the first 10 in a nice table with web connector and extract HTML but I need all the pages. The URL does not change as you move through the pages on the site.

 

I have looked at a number of the suggestions in the forum

https://www.mattmasson.com/2014/11/iterating-over-multiple-pages-of-web-data-using-power-query/

https://exceleratorbi.com.au/using-power-query-extracting-non-tabular-data-web-pages/

https://www.sumproduct.com/thought/referencing-multi-page-data-from-a-web-site-with-a-single-url

 

but all require the URL to have a page number reference which mine does not have.

 

Any help would be appreciated.

Thanks

1 ACCEPTED SOLUTION
Frequent Visitor

Hello

Using just the first line of code from https://www.mattmasson.com/2014/11/iterating-over-multiple-pages-of-web-data-using-power-query/ as an example, I tried: 

 

= Web.Page(Web.Contents("https://www.cahss.ca/surveillanceDiseaseAlert/equine/"))

This resulted in a table that I could expand with all the pages required.

 

As soon as I ask for help . . . the brain kicks in.

View solution in original post

1 REPLY 1
Frequent Visitor

Hello

Using just the first line of code from https://www.mattmasson.com/2014/11/iterating-over-multiple-pages-of-web-data-using-power-query/ as an example, I tried: 

 

= Web.Page(Web.Contents("https://www.cahss.ca/surveillanceDiseaseAlert/equine/"))

This resulted in a table that I could expand with all the pages required.

 

As soon as I ask for help . . . the brain kicks in.

View solution in original post

Helpful resources

Announcements
secondImage

Happy New Year from Power BI

This is a must watch for a message from Power BI!

December Update

Check it Out!

Click here to read more about the December 2020 Updates!

Community Blog

Check it Out!

Click here to read the latest blog and learn more about contributing to the Power BI blog!

Get Ready for Power BI Dev Camp

Get Ready for Power BI Dev Camp

Mark your calendars and join us for our next Power BI Dev Camp!.

Top Solution Authors
Top Kudoed Authors