Scheduled refresh with mixed media?

[lewdow]

I have numerous reports published which run off a combination of Oracle database connections + OneDrive based CSV files which have been imported via the 'web' connector. 

I've recently added in a scrape of a public domain structured data source (again via the 'web' connector') and now the scheduled refresh won't work...is this expected? How do I address this? 

[Icey]

Hi @lewdow ,

Any errors? Please provide more details, such as some screenshots.

Best Regards,

Icey

[lewdow]

This is the error message - not clear why a personal gateway is needed to be setup however as the OneDrive links work elsewhere without a personal gateway configured, the Oracle link is configured and working - why would I need a personal gateway to refresh a pull from a public URL (plus I can't install a personal gateway on my machine due to organisational IT controls...)?

 I've just tried changing Web.BrowserContent to Web.Contents in PowerQuery but still not luck 😞

[Icey]

Hi @lewdow ,

If your web source is behind a firewall, require a VPN, or are on virtual networks, you need to use gateway to refresh data from it.

Please try to configure gateway for your web source.

Reference: On-premises data gateway FAQ

Best Regards,

Icey

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[lewdow]

The web source is in the public domain...it's this page which is what's confusing

[Icey]

Hi @lewdow ,

So wired.

I try to reproduce the issue by connecting to Excel on-premises, Excel on OneDrive for Business and the web you provided.

The first time, it failed for “Web.BrowserContents”. After changed to "Web.Contents", it succeeded.

Please try to update your gateway to the latest version and try it again.

If the issue is still there and you are a pro user, it is suggested to create a support ticket to get further help.

Best Regards,

Icey

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[lewdow]

Thanks - so should I need a personal gateway installed to refresh a publically available URL then?

[GilbertQ]

It should work with the Standard Mode Gateway too

[GilbertQ]

Hi there

If you look in Power Query Editor what is the data source it is using?

Its it using Web.Contents?

[lewdow]

Hi @GilbertQ , it has the following:

let
    Source = Web.BrowserContents("THE_URL_IS_HERE"),
    #"Extracted Table From Html" = Html.Table(Source, {{"PRODUCT_NAME", ".MedicineDeviceSummary-title"}, {"PRODUCT_IMAGE_URL", ".MedicineDeviceSummary-img", each [Attributes][src]?}}, [RowSelector=".SearchResults-item"]),
    #"Changed Type" = Table.TransformColumnTypes(#"Extracted Table From Html",{{"PRODUCT_NAME", type text}, {"PRODUCT_IMAGE_URL", type text}}),
    #"Inserted Text Between Delimiters" = Table.AddColumn(#"Changed Type", "Text Between Delimiters", each Text.BetweenDelimiters([PRODUCT_NAME], ")", " dose", {0, RelativePosition.FromEnd}, 0), type text),
    #"Reordered Columns" = Table.ReorderColumns(#"Inserted Text Between Delimiters",{"PRODUCT_NAME", "Text Between Delimiters", "PRODUCT_IMAGE_URL"}),
    #"Extracted Text Before Delimiter" = Table.TransformColumns(#"Reordered Columns", {{"Text Between Delimiters", each Text.BeforeDelimiter(_, " capsule"), type text}}),
    #"Changed Type1" = Table.TransformColumnTypes(#"Extracted Text Before Delimiter",{{"Text Between Delimiters", Int64.Type}}),
    #"Renamed Columns" = Table.RenameColumns(#"Changed Type1",{{"Text Between Delimiters", "DOSES"}})
in
    #"Renamed Columns"