performance of BW data loading

[Former Member]

Hello

Can somebody help me with the fundamentals of BW data loading performance.

What is the optimum method we have to follow to make system work better.

we have 30 work process in the server.

how many should be BGD procee, how many should be DIA

how loading should be designed.

Is there a best practice document available on this

regards

Meps

[Former Member]

Dear Meyyappan,

I saw this link,.. should be useful for you regarding Data Load Performance...

Data Load Performance:

-

---

https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/3a699d90-0201-0010-bc99-d5c...

Thanks,

Raj

[Former Member]

hi,

well, everyone's mentioned their own .02 cents on this, but i suppose i'd also like to mention that in one of our messages to SAP, they mentioned that, on average, you should be loading approx. 1M records per hour.

i don't know if that's impossible to meet for certain cases, but at least you have a benchmark to follow this way.

ryan.

[Former Member]

The main key to Dialog processes vs Background processes are two things:

1) How many loads you'll be doing in parallel.

2) What you've set the number of parallel loads to in the SBIW setting for "Control parameters for data transfer from source system".

Each background process has the ability to call up to the max setting in that table in RFC's to load data. Where I work we have this set as high as 12 in some places meaning that one background process load can use 12 DIA processes to load IDOCS.

How you size this though is based on #1 and the deeper question of how quickly you need the data loaded vs. your hardware restrictions.

Remember that your BW system is considered a Source System for internal loads so you'll need to configure a setting internally as well as for external source systems. Note 409641 talks more of how to size these settings.

It's a big subject! Good Luck!

-bill smallwood

[Former Member]

Hello Bill,

Exellent explanation.

1. The SBIW setting is emty in our system. So what is the default.

2. We have 25 Background process and 10 DIA process (I think this is incorrect).

3. I wanted our load to run fast atleast 10 loads in parallel

totaly we have 38 process available.

what is the appropriate that we should have during business hours and during data loading hours.

what is the correct procedure to schedule the load.

Is there any difference between loading info objects, ODS or cubes. now loads are pathetic. please give me some suggestion and soem inputs. so I can have that as my base to read some documents and ensure we have a healthy system.

Thanks for your help....

Regards

Meps

[Ashwin]

Hi Meps!

I think the load schduling will depend on the data targets you are loading. The configuring your system parameter depends on various factors. actually this is clearly explained along with the impact of different settings on the daloading and tools for analysing the performance. you can check the chapter 5 of the document that u sent to you to find out how to configure various setting of your system based on the loading requirements.

hope this helps

with regards

ashwin

[Former Member]

Make sure there is always sufficient DIA, that is, at least 1 DIA more than all other work processes altogether, for example, 8 DIA for a total of 15 work processes (see also note 74141).

TIP: 2 UPD process are sufficient in BW, BW does not need any UP2.

[Former Member]

Hi Meyyappan,

BW Data loading performance can be evaluated and optimised by using lot of options.

It mainly consists of:

-Collection & Extraction

SAP Content / Generic Extraction

-Transfer

Transfer of Data from Source System to BW Staging

-Staging

PSA

-Transformation

Transfer & Update Rules

-Loading

Master Data

ODS

InfoCubes

Open transaction RSMO and go to the Specific Process under consideration

-Go to detail tab

-Identify Extraction Time

-Identify Transfer Time

-Identify High PSA Loading time

-Transformation Time – Transfer Rules/Update Rules

-Data Load Time

Identify the time taken by various components of Extraction & Loading Process and do the necessary steps.

Please send me your email ID I will share you the document.

Hope this helps.

Please reward with points if this helps.