Issue with split of file

[former_member190358]

Hello SAP Gurus,

I have file to multiple idoc scenario , where i am not using any message mapping or FCC.

However the file size is huge (60 MB) , so i want to divide the data and process it.

So can i use the advanced mode of sender file adapter and use " data sent in chunks " or shall i go ahead with Record set per-message.

Can you pls provide some links for the configuration of this.

Regards,

Ravi

[baskar_gopalakrishnan2 · Accepted solution]

>So can i use the advanced mode of sender file adapter and use " data sent in chunks " or shall i go ahead with Record set per-message.

Specify in Recordset per message. I also recommend this. For configuration you need to configure fieldNames,fieldSeparator,endSepartor parmeters in addition to recordset per message.

refer this help link

http://help.sap.com/saphelp_nw04/helpdata/en/2c/181077dd7d6b4ea6a8029b20bf7e55/content.htm

[former_member190358 · Accepted solution]

Hello Bhaskar,

As i said earlier, that there is no mapping used .

And so i am using file adapter . Now how can i use record set per message ?

Regards,

Ravi

[Former Member · Accepted solution]

Hi Ravi,

As per your requirement, you are not having any design objects, just transfering file. If you are using PI 7.3 then better go for Advanced mode 'Data sent in chunks'. It will send the data as per the size mentioned in the property. But kindly check at the receiver channel to append/add time stamp etc, to avoid overwriting of thr file at the target end.

Regards,

Nutan

[former_member190358 · Accepted solution]

Hello Nutan,

Yes you are correct . There are no Design objects in my scenario because it is one file have 50000 record of idocs and then through PI this gets divided into multiple idocs .

I am using PI 7.1 .and Data sent in chunks is not working . yesterday i tested one file and it got failed .

So now whats the option.

Regards,

Ravi

[anupam_ghosh2 · Accepted solution]

Hi Ravi,

What is the Operating system of PI server? You can use scripts to split the files into pieces before PI starts processing it. In case of Unix its Shell acripts and in case of Windows its batch files.

Regards

Anupam

[former_member190358 · Accepted solution]

Hello Anup,

Actually, i am receive the XML IDOC and want to use recordset for XML file .. is it possible ?

Second question is , if i want to divide the file before it comes to PI for processing, then how can i do it ?

Regards,

Ravi

[Former Member · Accepted solution]

Actually, i am receive the XML IDOC and want to use recordset for XML file .. is it possible ?

you can use port type is " XML Port " , that is used to convert IDOC into Xml format .

step by step please refer below doc :

http://www.saptechnical.com/Tutorials/ALE/IDOCToXML/IDOCToXML.htm

Second question is , if i want to divide the file before it comes to PI for processing, then how can i do it ?

might be that is possiable with Message Packaging concept.

[former_member190358 · Accepted solution]

Hello Bhavani,

I am already receiving the file in IDOC XML format.

i dont want to convert the file , rather if someone can help me to split the XML file as the size of the file is 50 MB..

Regards,

Ravi

[anupam_ghosh2 · Accepted solution]

Hi Ravi,

If the file is XML file then its really difficult to split it using scripts. In this case you need java code to parse and split it. This java code will be called and exceuted by the script. This happens in this way,

Script always runs in background. It detects if any file has been uploaded for splitting. It then calls a java code which reads the file and splits the file after certain end tag of xml structure.( When I say this I must acknowledge this is not going to be easy, but seems to be only solution to your problem.). After spilitting the java code creates files and puts in folder from where PI picks them up for further processing. Here you need to give time gap or name the new files in alphabetical order so that PI picks up the file on sequentially on basis of name. (Finally instead of calling a script you add all the above functionality to a java code which will run in infinite loop within PI server.)

Regards

Anupam

Edited by: anupamsap on Feb 11, 2012 3:51 AM

[former_member190358 · Accepted solution]

Hello Everyone,

i have designed the split as per Michal's Blog first and then i used BPM and its working fine.

Thanks very much

[Former Member]

shall i go ahead with Record set per-message.

as per my knowledge ,better to use "Recordsets per message" in comm.channel only

for ex:

Recordset Structure: Row,5000

Recordset per Message: 1

It will divide your file into 5000 records and generate separate messages.

Can you pls provide some links for the configuration of this.

http://www.sdn.sap.com/irj/scn/weblogs?blog=/pub/wlg/2737

[rajasekhar_reddy14]

I would suggest you to use record set per message option, i had done similar kind of requirement and used Record set per message option it worked reallly stable manner.

Give appropriate number in Record set per message option.

Regards,

Raj