Flat file performance issue

[Former Member]

I would need to load a flat file into a cube, it has about 600,000 records. Is that too many records to be loaded from one flat file into a cube, if it is not, what other alternatives do I have.

Rashmi

[former_member184494 · Accepted solution]

Rashmi,

600,000 records is not very big - depending on your server.

Also in the performance tab of the cube - click on the create indexex ( Batch ) and then select drop indexes on load and rebuild indexes after completion of load - this will speed up your data loads.

Arun

P.S we routinly load more than 10 million records into our BI system everyday into DSO's and Cubes

[Former Member]

hi,

most probably u can load that much of record's in to an cube. one cube can

contain maximum of 100GB records.

otherwise,

you can load half part of the record in to one cube, another part of record in to

other cube with primary key(same key)

using multiprovider you can mingle these records in to your query.

if helpful provide points

regards

harikrishna.N

[Former Member]

600000- is not a big amount to load into BW.

1. Load from Application Server.

2. try load using ASCII file which will improve performence of data load compare to CSV.

Nagesh Ganisetti.

[Former Member]

Keep ASCII format. SAP recommends ASCII is more efficient than CSV.

Ravi Thothadri

[Former Member]

There are few things that u can do to improve data load performance from a flat file

1) Parallel loading : Try segregating the data into multiple files and load them using different InfoPackages

2) Loading data from Application server, rather than client (i think u must be doing this)

-kiran