Skip to Content

Unable to CREATE table in SAP VORA

We are trying to create table in Vora, n we are using Spark 1.6, Spark Controller 2.0, HDP 2.4.2 and Vora 1.3.

Issues Facing:

At a time of creating a table from vora spark shell using query,

import org.apache.spark.sql.SapSQLContext

val vc = new SapSQLContext(sc)

val testsql = ("""

drop table if exists nameinfo""")

vc.sql(testsql)

val testsql1 = ("""

CREATE TABLE nameinfo(id int, name string)

USING com.sap.spark.vora

OPTIONS (

format "csv",

csvdelimiter ",",

files "/user/vora/Customer_data.csv"

)""").stripMargin

vc.sql(testsql1)

we are unable to create a table and we are getting the following issue:

(ref vora-issuelog.png attachement) vora-v2server-log.txt

After freeing the buffer there’s nothing happening in the shell and the table doesn’t get created.

But if we create a table using this query,

import org.apache.spark.sql.SapSQLContext

val vc = new SapSQLContext(sc)

val testsql = ("""

drop table if exists nameinfo""")

vc.sql(testsql)

val testsql1 = ("""

CREATE TABLE nameinfo(id int, name string)

USING com.sap.spark.vora

vc.sql(testsql1)

The table gets created. Hence we are unable to create table using Options() constructor with files loading from hdfs.

The same issue goes with both Vora UI sql editor as well with Vora spark shell.

Add comment
10|10000 characters needed characters exceeded

  • Get RSS Feed

2 Answers

  • Jun 27, 2017 at 10:34 PM

    According to the .png file, you are missing the C++ compatibility file in your installation. Check "Installation Prerequisites" in the Vora Install and Admin Guide at https://help.sap.com/viewer/p/SAP_VORA.

    Add comment
    10|10000 characters needed characters exceeded

    • Thank you so much Jason for replying.

      We actually did that after raising the Q&A on the forum :)

      But still we are facing the issue . Also we just stuck upon some other issue ( not related to this ) because of which the hdp cluster is down, we are working on getting it up and then we would check what Vishal Kuchha has suggested below.

      Will keep you guys posted .

      Thanks and kind regards,

      S

  • avatar image
    Former Member
    Jun 28, 2017 at 01:12 PM

    Hi Shailesh,

    Could you please provide your Operating system information.

    Also, could you please check if HDFS is in debug mode. You can go to Ambari->HDFS and search for debug keyword. Please change it to INFO.

    It would be great if you can also attach VORA Thriftserver log as it will have detailed information.

    Thanks.

    Vishal

    Add comment
    10|10000 characters needed characters exceeded

    • From the logs it looks like things are in a bad state. You can try the following:

      1) Try creating a table with the same schema but use a different table name.

      2) Try dropping the table before issuing the create.

      3) Try stopping and restarting the Vora system.

      If this is a test cluster, you might also try the Vora "wipeout" option in the Vora Manager. This will delete all of your schema however, so think carefully before doing this.

      If things still are not working, post the thriftserver log of any errors that occur executing the drop/create statements.