Unable to CREATE table in SAP VORA

[former_member288604]

We are trying to create table in Vora, n we are using Spark 1.6, Spark Controller 2.0, HDP 2.4.2 and Vora 1.3.

Issues Facing:

At a time of creating a table from vora spark shell using query,

import org.apache.spark.sql.SapSQLContext

val vc = new SapSQLContext(sc)

val testsql = ("""

drop table if exists nameinfo""")

vc.sql(testsql)

val testsql1 = ("""

CREATE TABLE nameinfo(id int, name string)

USING com.sap.spark.vora

OPTIONS (

format "csv",

csvdelimiter ",",

files "/user/vora/Customer_data.csv"

)""").stripMargin

vc.sql(testsql1)

we are unable to create a table and we are getting the following issue:

(ref vora-issuelog.png attachement) vora-v2server-log.txt

After freeing the buffer there’s nothing happening in the shell and the table doesn’t get created.

But if we create a table using this query,

import org.apache.spark.sql.SapSQLContext

val vc = new SapSQLContext(sc)

val testsql = ("""

drop table if exists nameinfo""")

vc.sql(testsql)

val testsql1 = ("""

CREATE TABLE nameinfo(id int, name string)

USING com.sap.spark.vora

vc.sql(testsql1)

The table gets created. Hence we are unable to create table using Options() constructor with files loading from hdfs.

The same issue goes with both Vora UI sql editor as well with Vora spark shell.

[former_member302407]

Hi Shailesh,

Could you please provide your Operating system information.

Also, could you please check if HDFS is in debug mode. You can go to Ambari->HDFS and search for debug keyword. Please change it to INFO.

It would be great if you can also attach VORA Thriftserver log as it will have detailed information.

Thanks.

Vishal

[former_member288604]

Thanks much Vishal for the response 🙂

Actually we just stuck upon some other issue ( not related to this ) because of which the hdp cluster is down, we are working on getting it up and then we would check what you have suggested above.

Will keep you guys posted .

Thanks and kind regards,

S

[former_member288604]

@Vishal Kuchhal , @Jason Hinsperger .

sorry for the delay , Got the HDP up .....

we tried as you guys suggested still but could not create the table with data .

Also, The VoraThriftserver log is 4mb and there is limitation on this platform for an attachment to be just 1mb.. is there any other way I can send it to you ( email , google drive etc )

sharing the system details :

we have 160 gb RAM physical machine on which run 11 VM's . One of the VM's with 31 GB RAM is used for VORA, (its a single node installtion).

please advise .

Thanks and kind regards,

S

[Former Member]

OS is CentOS 7.2

[JasonHinsperger]

From the logs it looks like things are in a bad state. You can try the following:

1) Try creating a table with the same schema but use a different table name.

2) Try dropping the table before issuing the create.

3) Try stopping and restarting the Vora system.

If this is a test cluster, you might also try the Vora "wipeout" option in the Vora Manager. This will delete all of your schema however, so think carefully before doing this.

If things still are not working, post the thriftserver log of any errors that occur executing the drop/create statements.

[JasonHinsperger]

According to the .png file, you are missing the C++ compatibility file in your installation. Check "Installation Prerequisites" in the Vora Install and Admin Guide at https://help.sap.com/viewer/p/SAP_VORA.

[former_member288604]

Thank you so much Jason for replying.

We actually did that after raising the Q&A on the forum 🙂

But still we are facing the issue . Also we just stuck upon some other issue ( not related to this ) because of which the hdp cluster is down, we are working on getting it up and then we would check what Vishal Kuchha has suggested below.

Will keep you guys posted .

Thanks and kind regards,

S