Skip to Content
0

Vora 1.4 error

Jun 30, 2017 at 01:28 PM

73

avatar image

I have installed Vora 1.4 on CDH 5.11.1 and CentOS 7.3 cluster, using default Spark 1.6.0. Installation went smoothly, all services are up.

When I wanted to do some basic test using shell, I have encountered an issue. Going through these steps:

import org.apache.spark.sql.SapSQLContext
val vc = new SapSQLContext(sc)
val testsql = """
CREATE TABLE table001 (a1 double, a2 int, a3 string)
USING com.sap.spark.engines.relational
OPTIONS (
files "/user/vora/test.csv"
)"""
vc.sql(testsql)

Ends with the following error:
java.lang.NoSuchMethodError: org.apache.spark.sql.catalyst.optimizer.Optimizer: method <init>()V not found

Any help is appreciated!

Thanks.

10 |10000 characters needed characters left characters exceeded
* Please Login or Register to Answer, Follow or Comment.

1 Answer

Christian Kalweit Jul 16, 2017 at 06:41 PM
0

Hi Erik,

https://github.com/SAP/HANAVora-Extensions/blob/master/README.md explains that this is a Spark version problem.

I solved that by using CDH 5.9.

Share
10 |10000 characters needed characters left characters exceeded