Skip to Content
0
Dec 19, 2022 at 09:30 PM

How to write a Long field to a delimited text file?

452 Views

In Data Services, I have a result set that I want to output to a delimited text file using a File Format object. It contains a field defined in Oracle as a CLOB and processed in Data Services as the type Long.

If the content of the Long field is greater than the number of bytes specified in the DSConfig.txt setting Max_Long_Data_In_Memory (ie, 2048), then instead of the field's text, I get a strange text value that seems to be made up like this:

<database-host-url>_<database-service-name>_<repo_schema_name>_<a-series-of-numbers>_Long_<export-file-name>.txt

If I increase the value of Max_Long_Data_In_Memory, then the job that outputs the files begins to fail. The failures are inconsistent and unpredictable. The error message is always something like this:

... received a bad system message. Message text from the child process is
<}S6==========================================================

(I presume this is a seg fault, or some such memory-related error.)

I have tried opening a support ticket with SAP, but they were unable to provide a solution.

I have ensured that there is plenty of disk space available on the file system location indicated in the DSConfig.txt setting pageable_cache_dir.

I am running SAP Data Services 14.2.14 on Windows Server 2016 Datacenter and an Oracle 19c database.

Does anyone out there have any information that would help me understand the problem, or find a solution?