Godzilla of all files extraction

[Former Member]

Hi everyone,

If we have to extract a monster of a flat file (with millions of records) into BW, how would we do it without affecting the performance of the system? Hope to hear from someone soon.

T & R,

Sanjay

[Former Member]

Hi Sanjay

Please check following-

1. Try to break down the flat file with millions of records into smaller files with reasonable amount of data using some paramters such as month, fiscal period or company code etc.

2. Load these files on application server preferably with sequence maintained. Ex.Files for Jan06, Feb06. Mar06 etc.

3. Create multiple infopackages and maintain the file path of application server and in Infopackage choose option to run in backgound.Select radio button "schdule later in background in schedule tab of Infopackage->

Scheduling options->Immediate-> Save.

4. Create process chain for these infopackages and subsequent processes such as ODS activation.

5.Schedule process chain for the duration when there is minimal load on BW server and maximum background & dialogue processes are available.

Hope it helps.

Regards

Pradip

[Former Member]

HI Sanjay

Pradip's task list is quite useful and I would recommend that you follow his steps.

But in addition, do remember to make a small setting.

At your infopackage level, press shift + f8 and you will get an option where you can select the number of records. By default it would be 1000. Change it to atleast 10,000. SAP recommends that it should be between 10 to 50000. In case the system, doesnt accept the new records, go to table ROOSPRMS ( i hope thats the one) and edit the setting there from 1000 to 10,000. In case you have any issues with this, let me know.

With this change, your number of data packs would be less and with each data pack, the no of records would be much more than 1000 !!!

Prakash

[Former Member]

Hi Sanjay,

I am sure quite a few people have done such extractions. Just as a precaution You need to ensure there are no other processes running in the BW system. I think then you should be fine.

Bye

Dinesh