cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
zoloturu
Advisor

Best practices for integration Azure Data Lake and Power BI Service?

Dear community,

 

I wanted to see if somebody has implemented integration Azure Data Lake Analytics as a source with visualization in Power BI Service.

A size of tables can be 2-50 GB.

 

Here are some research results done by me:

  • Azure Data Lake Analytics (ADLA) doesn't have the ability to connect to it from external applications to retrieve a data. I saw there is an API, but it allows only to read structure without data. Also, an authentification method is a token, which is already not a good option to connect to it from Power BI. Reference - https://docs.microsoft.com/en-us/rest/api/datalakeanalytics/

 

  • You can add a script to ADLA to store your data in Azure Data Lake Store (ADLS). And then you will be able to refresh it from Power BI Desktop, in the meantime, it is not possible from Power BI Service, that's why it is not an option as well:

adla pbi service refresh error.PNGerror,

          

  • You can replace ADLS in previous option with Azure Blob Storage (ABS). And finally, you can refresh such Power BI report in Service. But what is strange, sometimes I received an error for time out, but very rarely. See it below blob refresh error.PNGerror

 

What other options which you know? More stable or easier ones?

 

Regards,

Ruslan

3 REPLIES 3
Community Support Team
Community Support Team

Re: Best practices for integration Azure Data Lake and Power BI Service?

HI @zoloturu,

 

>>You can add a script to ADLA to store your data in Azure Data Lake Store (ADLS). And then you will be able to refresh it from Power BI Desktop, in the meantime, it is not possible from Power BI Service.

Azure data lake service not need to use gateway to handling refresh operation, you can update its credentials to use on power bi service. 

 

If you mean you are deal with a mixed datasource report which contains azure data lake service, please use personal gateway to handling with this scenario and confirm there are no combine/merge or custom function operate in it.

 

Regards,

Xiaoxin Sheng

 

Community Support Team _ Xiaoxin Sheng
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.



For learning resources/Release notes, please visit: | |
Highlighted
zoloturu
Advisor

Re: Best practices for integration Azure Data Lake and Power BI Service?

Hi @v-shex-msft,

 

Let me explain it more. In this option which you've commented, I try to connect to ADLS from Power BI Desktop, but when I publish this report to Power BI Service I further not able to refresh it in a cloud.

 

Regards,

Ruslan

Community Support Team
Community Support Team

Re: Best practices for integration Azure Data Lake and Power BI Service?

HI @zoloturu,

 

If your report only contains online service without any advanced operations(append/merge, custom funciton, reference other query), you can direct use connection directly mode to link datasource without a gateway.

 

If your datasource contains multiple data sources with both online and on premise datasource at same time, you can use personal gateway to handling these scenario.

 

In addition, you can also turn on below option to use on premise gateway to handling online service(not need to config correspond datasource).

13.PNG

Notice: on premise gateway not support to handling multiple datasource type(online and on premise) with advanced operations.

Combine enterprise gateway and online data sources

 The initial support will enable refreshing datasets that connect to Online and On-prem sources but that do not “mash up” data between them. (i.e. no Merge/Append or other query references involved). 

 

If above still not help, please open a support ticket for better support.

Support Ticket.gifsubmit a support ticket

 

Regards,

Xiaoxin Sheng

Community Support Team _ Xiaoxin Sheng
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.



For learning resources/Release notes, please visit: | |

Helpful resources

Announcements
Virtual Launch Event

Microsoft Business Applications October Virtual Launch Event

Join us for an in-depth look at the new innovations across Dynamics 365 and the Microsoft Power Platform.

Power BI Helps Homeless and Trouble Youth

Power BI Helps Homeless and Trouble Youth

We spoke with Power BI Super User, Greg Deckler, about his charity work

MBAS Gallery

Watch Sessions On Demand!

Continue your learning in our online communities.

Users Online
Currently online: 105 members 1,692 guests