SAP Analytics Cloud - Apache Spark 2.0 Databricks JDBC Drivers

[kinneyryanj]

Hi,

I’m wondering if anyone in the SAP Analytics Cloud user community has had success in connecting to a Databricks instance? We have downloaded the JDBC driver from Databricks and maintained the SAP Cloud Agent with the respective jar file path for the Apache Spark 2.0 driver within the agent. In SAC, while creating a new Connection (SQL Databases type), I can see the Apache Spark 2.0 option now. Upon selection, I enter some Host/Port details about our internal Databricks instance (I have authorization and Databricks token) and I am consistently faced with a message that the Cloud Agent has not been configured correctly – “the database driver is misconfigured. Please contact your on-site SAP Analytics Cloud administrator”.

Any idea if there is documentation on how to achieve this? We have other working SAC connectors to other SQL databases (DB2 z/OS) which were set up in a similar manner without issue. Within our company, other non-SAP BI tools can connect to Databricks via ODBC (i.e. Tableau, Power BI) and I would like to close the gap on the SAC side, if possible.

Any guidance would be appreciated.

Best,

Ryan

[mfoeken]

Hi Ryan,

I assume you already checked if the path to the driver is specified correctly in the DriverConfig.properties file that you defined?

Can you check the Tomcat logs? Anything appearing here while trying to make the connection in SAC?

Kind regards,

Martijn van Foeken | Interdobs

[kinneyryanj]

Thanks Martijn - I have asked our Basis team to provide this information regarding the tomcat logs. Awaiting a response. To be more specific on the requirement, we are trying to use the JDBC drivers here JDBC Drivers Download - Databricks - the SimbaSparkJDBC42-2.6.19.1030 version along with the defined "Apache Spark 2.0" line from the SQL databases connections of the Cloud Agent. Our Apache Spark Version is 7.3 x-scala2.12. We've had success using the same ODBC drivers and other non-SAP BI applications to connect. The idea is to get SAC on the same level as our other non-SAP BI applications and connect to the database, which houses our company's data lake.

[kinneyryanj]

Hi Martijn,

As requested, please find the attached Tomcat log error as well. Does this help?

Thanks,

Ryan

tomcat-logs.png

[mfoeken]

Hi Ryan,

What is the revision of the Cloud Agent you are running? Sure you are referring to the correct path of the driver in the config. file?

Kind regards,

Martijn van Foeken | Interdobs