Hi,
We have the following challenge:
We need to process large files with file content conversion in PI 7.3
We cannot just forward the binary flatfiles towards the target in blocks as is possible in PI 7.3 since we need payload access.
The messages are big and cause outofmemory errors and lead to instability of the platform when we try to process them as one message with FCC
We tried to use the FCC option recordset per message but that option still seems to want to convert the entire file to XML before split.
We have a flatfile file structure where we have one header, a number of detail records and a trailer:
Header
Detail1
Detail 2
...
Detail n
Trailer
Question 1:
Should the recordsets per message function without reading the entire message first?
Question 2:
Is there another way of splitting the input message before offering it to FCC? Maybe a Java bean that does this?
If we were able to split the message before processing that would really help.\
Thanks!
Tom