Skip to Content
0

Large File split into multiple files in PI/PO [File - File (Passthrough)]

Nov 30, 2017 at 04:09 PM

363

avatar image
Former Member

Hi All,

Scenario Flow: File (NFS) to File (NFS) [Passthrough Interfaces] in Single stack

I have placed single file in source folder and file size should be 14MB, then it should be split into multiple files based on 2MB file size, So out files are 7 , each file has 2MB with Time Stamp.

file-sender-channel-01.pngfile-sender-channel-02.pngfiel-receiver-channel.pngholding-status.png

10 |10000 characters needed characters left characters exceeded
* Please Login or Register to Answer, Follow or Comment.

8 Answers

Evgeniy Kolmakov Nov 30, 2017 at 04:57 PM
1

Hi Suresh!

I see two ways to achieve your requirement: FCC with Recordsets per Message option or manual splitting using custom adapter module or java mapping.

Regards, Evgeniy.

Share
10 |10000 characters needed characters left characters exceeded
ambuj mishra Dec 01, 2017 at 12:22 PM
0

It seems like, there is one file/message stuck in your queue, may be from previous testing. Can you find that message and cancel it?

Rest of the files then, should be processed sequentially.

Show 1 Share
10 |10000 characters needed characters left characters exceeded
Former Member

Thanks Mishra!

But Single File(14MB) is not splitted in to multiple files (each file has 2MB).

As of now, this scenario is not working.

0
avatar image
Former Member Dec 01, 2017 at 10:33 AM
-1

Ariel M. Bravo Ayala@: i have done so many ways, but its same issue.

Question: Scenario Flow: File (NFS) to File (NFS) [Passthrough Interfaces] in Single stack

I have placed single file in source folder and file size should be 14MB, then it should be split into multiple files based on 2MB file size, So out files are 7 , each file has 2MB with Time Stamp.

what kind of steps we need to fallow, please provide the screenshots if possible.

Thanks for Advance!

Thanks

Suresh

Share
10 |10000 characters needed characters left characters exceeded
Ariel M. Bravo Ayala Nov 30, 2017 at 04:53 PM
0

Suresh, Talking about your question presented in your answer:

The queue name it is only required when you select the exactly once in order processing method. This queue name will guarantee that the messages are delivered in an strictly FIFO sequence. You can assign this name at your own will.

SAP Help states:

EOIO (Exactly Once In Order)

Messages are delivered with the same queue names (supplied by the application) in the same sequence that they were sent from the sender system. Message processing is asynchronous in this case.

https://help.sap.com/saphelp_nw73/helpdata/en/f9/17888f490846a9972628525cc28aac/frameset.htm

Show 1 Share
10 |10000 characters needed characters left characters exceeded

As Ariel already mentioned, this would be a possible solution if you would transport huge files.

If you select EOIO, you will get a new field on advanced tab where you can choose to chunk the messages in parts of predefined size (5MB to 50MB).
But you will not be able to do a mapping if you choose this way. You can only use it to transport huge files from source to target without overloading the memory of the PI server. At the end, the message will be the same size.

regards

Chris

0
Evgeniy Kolmakov Dec 01, 2017 at 05:54 PM
0

Hi!

As far as I know, there's no standard way to split the source file into pieces when using file adapter. See my first answer: either convert your source file into xml structure in sender adapter using Recordsets per message and convert it back to flat file in receiver adapter or use adapter module or java mapping to split source file manualy.

Regards, Evgeniy.

Show 1 Share
10 |10000 characters needed characters left characters exceeded
Former Member

Thanks Evgeniy!

let me try, If any possible, i will post updated Solution :)

Thanks

Suresh

0
avatar image
Former Member Nov 30, 2017 at 04:16 PM
0

Kindly let me know, what should we will provide "Queue Name" in sender channel parameter and how should define Queue name.

FYI- i have placed dummy file.

Share
10 |10000 characters needed characters left characters exceeded
avatar image
Former Member Dec 01, 2017 at 08:45 AM
0

Thanks for your reply!

@Evgeniy Kolmakov : Its just pass through interface , No-FCC.

@ Ariel M. Bravo Ayala: Currently its showing holding status in monitoring, Files are still scheduled.

kindly provide the solution or Approach for this kind of scenario.

Show 1 Share
10 |10000 characters needed characters left characters exceeded

Suresh, a queue behaves in a way that if a message fails, the whole queue is stopped until the message is successfully delivered or cancelled. This guarantees the sequence to be preserved. Two options here: restart the queue or simply change the name of the queue, so a new and empty one will be in place. Br.

0
avatar image
Former Member Dec 07, 2017 at 10:59 AM
0

Hi Venkat,

Please check following links. Check the PI version you are having.

https://blogs.sap.com/2011/12/26/fileftp-adapter-large-file-transfer-chunk-mode/

I guess you are expecting multiple file but the receiver channel will merge those chunks in EOIO mode. I don't have the system access now but check if it is possible to create separate files for the chunks.

Regards

Jitender

Share
10 |10000 characters needed characters left characters exceeded