How to process large data files in XI ? 100 MB files ?

[Former Member]

Hi All

At present we have a scenario as follows

It is File to IDoc ....Problem is the size of the file

We need to transfer 100mb file to SAP R/3 system ? So this huge data how to

process ?

Adv thanx and regards

Rakesh

[Former Member · Accepted solution]

Hi,

In general, an extra sizing for XI memory consumption is not required. The total memory of the SAP Web Application Server should be sufficient except in the case of large messages (>1MB).

To determine the memory consumption for processing large messages, you can use the following rules of thumb:

Allocate 3 MB per process (for example, the number of parallel messages per second may be an indicator)

Allocate 4 kB per 1kB of message size in the asynchronous case or 9 kB per 1kB message size in the synchronous case

Example: asynchronous concurrent processing of 10 messages with a size of 1MB requires 70 MB of memory

(3MB + 4 * 1MB) * 10 = 70 MB With mapping or content-based routing where an internal representation of the message payload may be necessary, the memory requirements can be much higher (possibly exceeding 20 kBytes per 1kByte

message, depending on the type of mapping).

The size of the largest message thus depends mainly on the size of the available main memory. On a normal 32Bit operating system, there is an upper boundary of approximately 1.5 to 2 GByte per process, limiting the respective largest message size.

please check these links..

/community [original link is broken]:///people/michal.krawczyk2/blog/2006/06/08/xi-timeouts-timeouts-timeouts

/people/shabarish.vijayakumar/blog/2006/04/03/xi-in-the-role-of-a-ftp

Please let me know , your problem is solved or not..

Regards

Chilla..

[Former Member · Accepted solution]

Hi

Add these following links to the above list...

It will explain clearly about the Volume and sizes you can paa through XI

http://help.sap.com/saphelp_nw04/helpdata/en/cd/5af7c0c994e24fb0d0088443513de2/content.htm

/people/sravya.talanki2/blog/2005/11/29/night-mare-processing-huge-files-in-sap-xi

regards

prasad

[prabhu_s2]

probabaly you can try to collect the idoc first and then process it...for this you can refer to the blog

<a href="/people/sravya.talanki2/blog/2005/12/09/xiidoc-message-packages:///people/sravya.talanki2/blog/2005/12/09/xiidoc-message-packages

<a href="/people/pooja.pandey/blog/2005/07/27/idocs-multiple-types-collection-in-bpm:///people/pooja.pandey/blog/2005/07/27/idocs-multiple-types-collection-in-bpm

also the process is dependant on sizing. but this is done at the initialisation phase of XI box

[Former Member]

Hi,

Plz check the following threads, it may help u.

/people/michal.krawczyk2/blog/2006/06/08/xi-timeouts-timeouts-timeouts

regards