Hi
I'm really new in ESP and I try to make my first own project.
I have a CSV file for input and a HANA DB for output.
When I start the project, the CSV file cannot be converted.
It is really a very simple scenario and should be solved easy.
Can anybody help?
Thanks and regards
Maic
Here is the CCL
------------------------------------------------------------------------------------------------------------
CREATE SCHEMA schemaCSV (
Id long ,
Tabelle string ,
Zeilen long ,
DataUsedKB long ,
IndexUsedKB long ,
Fragmentierung decimal(34, 0 ) ,
Timestamp bigdatetime ) ;
CREATE SCHEMA schemaHANA (
Id long ,
Tabelle string ,
Zeilen long ,
DataUsedKB long ,
IndexUsedKB long ,
Fragmentierung decimal(34, 0 ) ,
Timestamp bigdatetime ) ;
CREATE INPUT WINDOW iwCSV SCHEMA schemaCSV PRIMARY KEY ( Id ) KEEP 1 HOURS ;
CREATE OUTPUT WINDOW owHANA SCHEMA schemaHANA PRIMARY KEY ( Id ) KEEP 1 HOURS
AS
SELECT
iwCSV.Id Id ,
iwCSV.Tabelle Tabelle ,
iwCSV.Zeilen Zeilen ,
iwCSV.DataUsedKB DataUsedKB ,
iwCSV.IndexUsedKB IndexUsedKB ,
iwCSV.Fragmentierung Fragmentierung ,
iwCSV.Timestamp Timestamp FROM iwCSV ;
ATTACH INPUT ADAPTER iaCSV TYPE toolkit_file_csv_input
TO iwCSV
PROPERTIES
propertyset = 'File/Hadoop CSV Input' ,
dir = 'E:/transfer' ,
file = 'import.csv' ,
csvDelimiter = ';' ,
csvHasHeader = TRUE ;
ATTACH OUTPUT ADAPTER oaHANA TYPE hana_out
TO owHANA
PROPERTIES
service = 'ght' ,
sourceSchema = 'GIAIOT' ,
table = 'SQLSERVER.z_fragment.data::fragment' ,
useUpserts = TRUE ,
permutation = 'Tabelle=Tabelle:Zeilen=Zeilen:DataUsedKB=DataUsedKB:IndexUsedKB=IndexUsedKB:Fragmentierung=Scan:Timestamp=Timestamp:Id=Id'
;
------------------------------------------------------------------------------------------------------------
Here is the log file.
------------------------------------------------------------------------------------------------------------
07-28-2016 10:42:13.078 INFO [main] (Framework.main) start E:\Sybase\ESP-5_1/adapters/framework/instances/file_csv_input/adapter_config.xml
07-28-2016 10:42:13.421 INFO [main] (AdapterConfig.load) E:\Sybase\ESP-5_1\adapters\framework\config\custommodulesdefine.xml
07-28-2016 10:42:13.452 INFO [main] (XmlUtils$1.resolveResource) E:\Sybase\ESP-5_1/adapters/framework/config/parametersdefine.xsd
07-28-2016 10:42:13.515 INFO [main] (XmlUtils$1.resolveResource) E:\Sybase\ESP-5_1/adapters/framework/config/standard_module_parametersdefine.xsd
07-28-2016 10:42:13.889 INFO [main] (PortAllocator.allocateFromDataCenter) Trying to get global lock ...
07-28-2016 10:42:13.905 INFO [main] (PortAllocator.allocateFromDataCenter) Success to get global lock.
07-28-2016 10:42:13.967 INFO [main] (AdapterController.sendCommand) start E:\Sybase\ESP-5_1\adapters\framework\instances\file_csv_input\adapter_config.xml
07-28-2016 10:42:15.059 INFO [main] (Log.initialized) Logging initialized @2739ms
07-28-2016 10:42:15.137 INFO [Thread-0] (Server.doStart) jetty-9.2.0.v20140526
07-28-2016 10:42:15.199 INFO [Thread-0] (ContextHandler.doStart) Started o.e.j.s.ServletContextHandler@4c8cf3d0{/,null,AVAILABLE}
07-28-2016 10:42:15.262 INFO [Thread-0] (AbstractConnector.doStart) Started ServerConnector@679bdcca{HTTP/1.1}{172.16.1.21:19082}
07-28-2016 10:42:15.262 INFO [Thread-0] (Server.doStart) Started @2956ms
07-28-2016 10:42:16.151 INFO [main] (AdapterController.executeStart) Adapter controller is started.
07-28-2016 10:42:16.151 INFO [main] (AdapterController.executeStart) Starting adapter
07-28-2016 10:42:16.182 WARN [main] (AdapterConfig.getAdapterName) The adapter name File/Hadoop CSV Input configured in adapter runtime configuration file is different from the adapter name iaCSV configured in the project. The later one iaCSV will be used as adapter name.
07-28-2016 10:42:16.182 INFO [main] (EspProjectInfo.connect) Login to default project ...
07-28-2016 10:42:16.182 INFO [main] (EspProjectInfo.connect) defaultSessionId = LOCAL_a0fb9265819cc198dc042c25f2d90f1b_1
07-28-2016 10:42:16.182 INFO [main] (EspProjectInfo.connect) defaultHostName = localhost
07-28-2016 10:42:16.182 INFO [main] (EspProjectInfo.connect) defaultPortNumber = 54409
07-28-2016 10:42:16.198 INFO [main] (EspProjectInfo.connect) defaultSSL = false
07-28-2016 10:42:16.369 INFO [main] (ModuleWrapper.initQue) Buffer Size for module MyInStream_Publisher is 10240.
07-28-2016 10:42:16.369 INFO [main] (ModuleWrapper.initParallelParameters) Parallel setting of module MyInStream_Publisher is true.
07-28-2016 10:42:16.369 INFO [main] (EspPublisher.init) EspPublisher is initializing
07-28-2016 10:42:16.369 INFO [main] (EspPublisher.init) Transaction buffer size is 1.
07-28-2016 10:42:16.385 INFO [main] (EspProjectInfo.connect) Login to default project ...
07-28-2016 10:42:16.385 INFO [main] (EspProjectInfo.connect) defaultSessionId = LOCAL_a0fb9265819cc198dc042c25f2d90f1b_1
07-28-2016 10:42:16.385 INFO [main] (EspProjectInfo.connect) defaultHostName = localhost
07-28-2016 10:42:16.385 INFO [main] (EspProjectInfo.connect) defaultPortNumber = 54409
07-28-2016 10:42:16.385 INFO [main] (EspProjectInfo.connect) defaultSSL = false
07-28-2016 10:42:16.416 INFO [main] (ModuleWrapper.initQue) Buffer Size for module FileInputTransporter is 10240.
07-28-2016 10:42:16.416 INFO [main] (ModuleWrapper.initParallelParameters) Parallel setting of module FileInputTransporter is true.
07-28-2016 10:42:16.416 INFO [main] (TransporterWrapper.init) Before initializing the Transporter module FileInputTransporter
07-28-2016 10:42:16.432 INFO [main] (TransporterWrapper.init) After initializing the Transporter module FileInputTransporter
07-28-2016 10:42:16.432 INFO [main] (ModuleWrapper.initQue) Buffer Size for module CsvStringToEspFormatter is 10240.
07-28-2016 10:42:16.432 INFO [main] (ModuleWrapper.initParallelParameters) Parallel setting of module CsvStringToEspFormatter is true.
07-28-2016 10:42:16.432 INFO [main] (FormatterWrapper.init) Before initializing the Formatter module CsvStringToEspFormatter
07-28-2016 10:42:16.447 INFO [main] (FormatterWrapper.init) After initializing the Formatter module CsvStringToEspFormatter
07-28-2016 10:42:16.463 INFO [main] (ModuleWrapper.start) Before starting module MyInStream_Publisher
07-28-2016 10:42:16.479 INFO [main] (EspPublisher.start) Publisher of stream iwCSV is started
07-28-2016 10:42:16.479 INFO [main] (ModuleWrapper.start) After module MyInStream_Publisher started
07-28-2016 10:42:16.479 INFO [main] (ModuleWrapper.start) Before starting module FileInputTransporter
07-28-2016 10:42:16.479 INFO [main] (ModuleWrapper.start) After module FileInputTransporter started
07-28-2016 10:42:16.479 INFO [Thread-17] (EspConnectorWrapper.run) Running EspConnector Module MyInStream_Publisher
07-28-2016 10:42:16.479 INFO [main] (AdapterController.executeStart) Address 172.16.1.21:19082 is used to accept the control command.
07-28-2016 10:42:16.479 INFO [main] (AdapterController.executeStart) Adapter started
07-28-2016 10:42:16.479 INFO [main] (AdapterController.executeStart) Starting adapter controller
07-28-2016 10:42:16.479 INFO [Thread-18] (FormatterWrapper.run) Running Formatter module CsvStringToEspFormatter
07-28-2016 10:42:16.479 INFO [Thread-19] (TransporterWrapper.run) Before running the Transporter module FileInputTransporter
07-28-2016 10:42:16.494 INFO [Thread-19] (CharFetcher.read) Reach the end of file import.csv
07-28-2016 10:42:16.494 INFO [Thread-19] (Adapter.requestCommand) E:\Sybase\ESP-5_1\adapters\framework\instances\file_csv_input\adapter_config.xml
07-28-2016 10:42:16.494 INFO [Thread-19] (PortAllocator.queryFromDataCenter) Trying to get global lock ...
07-28-2016 10:42:16.494 INFO [Thread-19] (PortAllocator.queryFromDataCenter) Success to get global lock.
07-28-2016 10:42:16.494 INFO [Thread-19] (AdapterController.sendCommand) stop E:\Sybase\ESP-5_1\adapters\framework\instances\file_csv_input\adapter_config.xml
07-28-2016 10:42:16.512 ERROR [Thread-18] (CSVInputFormatter.parseCSV) Exception is thrown
java.lang.StringIndexOutOfBoundsException: String index out of range: 20
at java.lang.String.substring(String.java:1950)
at com.sybase.esp.adapter.framework.common.BigDatetimeFormat.parse(BigDatetimeFormat.java:152)
at com.sybase.esp.adapter.formatters.csv.CSVInputFormatter.parseCSV(CSVInputFormatter.java:318)
at com.sybase.esp.adapter.formatters.csv.CSVInputFormatter.convert(CSVInputFormatter.java:207)
at com.sybase.esp.adapter.framework.wrappers.FormatterWrapper.processRow(FormatterWrapper.java:375)
at com.sybase.esp.adapter.framework.wrappers.FormatterWrapper.run(FormatterWrapper.java:260)
at java.lang.Thread.run(Thread.java:812)
07-28-2016 10:42:16.513 ERROR [Thread-18] (CSVInputFormatter.convert) Error code:402005, Severity : 3 (Error)
Error message:CSV Formatter failed to convert a string: 1;EDI40;200441;431200;3560;99.99257885;1468907355000.
Error description:CSV Formatter failed to convert a string: 1;EDI40;200441;431200;3560;99.99257885;1468907355000.
07-28-2016 10:42:16.553 INFO [qtp2129442232-19] (AdapterControllerStub.stop) Stopping adapter
07-28-2016 10:42:16.553 INFO [qtp2129442232-19] (PortAllocator.queryFromDataCenter) Trying to get global lock ...
07-28-2016 10:42:16.555 INFO [qtp2129442232-19] (PortAllocator.queryFromDataCenter) Success to get global lock.
07-28-2016 10:42:16.555 INFO [qtp2129442232-19] (AdapterController.sendCommand) status E:\Sybase\ESP-5_1\adapters\framework\instances\file_csv_input\adapter_config.xml
07-28-2016 10:42:16.566 INFO [qtp2129442232-19] (AdapterController.executeStatus) Adapter status: Running
07-28-2016 10:42:16.577 INFO [Thread-19] (TransporterWrapper.run) After running the Transporter module FileInputTransporter
07-28-2016 10:42:16.577 INFO [Thread-21] (Adapter.stop) Before stopping module FileInputTransporter
07-28-2016 10:42:16.578 INFO [Thread-21] (ModuleWrapper.stop) Input buffer of FileInputTransporter contained 1 rows at max.
07-28-2016 10:42:16.578 INFO [Thread-21] (ModuleWrapper.stop) Before stopping module FileInputTransporter
07-28-2016 10:42:16.578 INFO [Thread-21] (ModuleWrapper.stop) After module FileInputTransporter stopped
07-28-2016 10:42:16.578 INFO [Thread-21] (Adapter.stop) After module FileInputTransporter stopped
07-28-2016 10:42:16.578 INFO [Thread-21] (Adapter.stop) Before stopping module CsvStringToEspFormatter
07-28-2016 10:42:16.578 INFO [Thread-21] (ModuleWrapper.stop) Input buffer of CsvStringToEspFormatter contained 0 rows at max.
07-28-2016 10:42:17.579 INFO [Thread-21] (Adapter.stop) After module CsvStringToEspFormatter stopped
07-28-2016 10:42:17.579 INFO [Thread-21] (Adapter.stop) Before stopping module MyInStream_Publisher
07-28-2016 10:42:17.579 INFO [Thread-21] (ModuleWrapper.stop) Input buffer of MyInStream_Publisher contained 0 rows at max.
07-28-2016 10:42:18.582 INFO [Thread-21] (ModuleWrapper.stop) Before stopping module MyInStream_Publisher
07-28-2016 10:42:18.582 INFO [Thread-21] (EspPublisher.stop) Totally 0 rows are published by module MyInStream_Publisher, 0 success.
07-28-2016 10:42:18.582 INFO [Thread-21] (EspPublisher.stop) Publisher of stream iwCSV is stopped
07-28-2016 10:42:18.582 INFO [Thread-21] (ModuleWrapper.stop) After module MyInStream_Publisher stopped
07-28-2016 10:42:18.582 INFO [Thread-21] (Adapter.stop) After module MyInStream_Publisher stopped
07-28-2016 10:42:18.582 INFO [Thread-21] (ModuleWrapper.destroy) Before destroying module FileInputTransporter
07-28-2016 10:42:18.582 INFO [Thread-21] (ModuleWrapper.destroy) After module FileInputTransporter destroyed
07-28-2016 10:42:18.582 INFO [Thread-21] (FormatterWrapper.destroy) Before destroying module CsvStringToEspFormatter
07-28-2016 10:42:18.582 INFO [Thread-21] (FormatterWrapper.destroy) After module CsvStringToEspFormatter destroyed
07-28-2016 10:42:18.582 INFO [Thread-21] (ModuleWrapper.destroy) Before destroying module MyInStream_Publisher
07-28-2016 10:42:18.582 INFO [Thread-21] (EspPublisher.destroy) Publisher of stream iwCSV is destroyed
07-28-2016 10:42:18.582 INFO [Thread-21] (ModuleWrapper.destroy) After module MyInStream_Publisher destroyed
07-28-2016 10:42:18.785 INFO [Thread-21] (ContextHandler.doStop) Stopped o.e.j.s.ServletContextHandler@4c8cf3d0{/,null,UNAVAILABLE}
07-28-2016 10:42:18.800 INFO [Thread-21] (AbstractConnector.doStop) Stopped ServerConnector@679bdcca{HTTP/1.1}{172.16.1.21:19082}