Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
pbinewbie101
Employee
Employee

Can't perform scheduled refresh when connecting Spark database directly to Power BI Report Server

Hey team, my customer wants to connect their Spark database directly to Power BI Report Server with scheduled refresh. But it looks like PBI doesn't support it. Is there any good suggestions for this situation? I have suggested the customer to first connect their data to SQL server/MySQL and then connect to PBI. But the customer doesn't want to do it this way. Also, the customer wants to keep their data on-prem, so I can't leverage Spark connector (Databricks).

 

Many thanks to your answers.

 

 

1 ACCEPTED SOLUTION


@pbinewbie101 wrote:

...do you know will the two options (1) use supported connector; 2) use ODBC ) have a huge impact of response time of data? I am asking because the customer has hundreds of millions of data going through everyday. 

 


No, sorry I have no idea. You'd have to run some tests yourself and see. But that scale might be beyond what is reasonable for PBIRS. If you have to stay on premise I'd suggest looking at using an Analysis Service instance in tabular mode. Then you have the option of creating paritions so you don't need to pull through all the data every time you refresh. You can then create a Power BI Report in live connect mode point at SSAS. 

View solution in original post

3 REPLIES 3
d_gosbell
Super User
Super User

Power BI Report Server only supports scheduled refresh against a subset of the data connectors and Spark is not one of these (see https://docs.microsoft.com/en-us/power-bi/report-server/data-sources). Your only option at the moment would be what you've already suggested and that is to "tunnel" through one of the supported connectors. 

 

I don't have access to a local Spark instance so I can't test this, but PBIRS supports ODBC for scheduled refresh. Have you tried using the ODBC driver? You would need to install the driver on both the PBIRS server and on the workstation building the PBIX report.

Hi @d_gosbell ,

 

Thank you so much for your quick response. Really appreciate it.

 

Please bear me with another follow up questions - do you know will the two options (1) use supported connector; 2) use ODBC ) have a huge impact of response time of data? I am asking because the customer has hundreds of millions of data going through everyday. 

 

 


@pbinewbie101 wrote:

...do you know will the two options (1) use supported connector; 2) use ODBC ) have a huge impact of response time of data? I am asking because the customer has hundreds of millions of data going through everyday. 

 


No, sorry I have no idea. You'd have to run some tests yourself and see. But that scale might be beyond what is reasonable for PBIRS. If you have to stay on premise I'd suggest looking at using an Analysis Service instance in tabular mode. Then you have the option of creating paritions so you don't need to pull through all the data every time you refresh. You can then create a Power BI Report in live connect mode point at SSAS. 

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.