Skip to Content
author's profile photo Former Member
Former Member

How does SID generation on DSO level affect InfoCube load?

Hi experts,

I am having big performance issue with data load to InfoCube. In the DTP monitor, the step "Conversion of Characteristic Values to SID" takes about 7-8 mins for each data package of 50000 records. I need to load about 20 millions data & this would take ages.

Below illustrates part of the data flow in my scenario:

DSO A   
DSO B   ======>  DSO X =====> Cube 
DSO C   

In the entry layer, I have DSO A, B, and C which contain header, line item records as well as master data. The option "Generate SID upon Activation" is checked for DSO A, B, & C.

Records from these 3 DSOs are consolidated & enriched into DSO X. In order to reduce load time I have unchecked "Generate SID upon Activation" for DSO X.

Data from DSO X will be written to the Cube 1:1 without any additional transformation logic.

My questions:

1. Since I have generated SIDs for the chars in entry layer, why it still takes so much time to for the SID conversion during Cube load?

2. In this case, is it necessary to generated SIDs in DSO X?

Thanks in advance for any advice. I am in desperate need for a solution to this load problem 😔

Regards,

Meng

Add a comment
10|10000 characters needed characters exceeded

Related questions

6 Answers

  • Posted on Aug 29, 2011 at 09:22 PM

    Remove "Generation of SID upon Activation" from DSO A, B & C and then see if it improves the performance.

    Regards,

    Gaurav

    Add a comment
    10|10000 characters needed characters exceeded

    • Former Member

      Hi Gaurav,

      could you please explain briefly why the removal of "Generation of SID upon Activation" from DSO A, B & C could improve performance of data load from DSO X to Cube?

      Thanks very much.

      Regards,

      Meng

  • Posted on Aug 29, 2011 at 09:31 PM

    Hi Joon

    Some questions..

    1. Do you delete and reload this cube every time? If yes, do you delete Dimension Ids as well when delete the cube data ? [ Check in Process Chain settings]

    Deleting dimension table before cube loading increase the time in in step "Conversion of Characteristic Values to SID" as to create dimension ids system needs to read all the SIDs and with a combination of SIDs dimension ids get generated.

    2. Are your Cube dimensions more than 10% of the Fact Table? Or do you have very big dimension table? Please run report SAP_INFOCUBE_DESIGNS to check if you have problem with dimension size. System will show 'bad' dimension in red for a particular cube

    You can also think of Number Range Buffering so create DIM and SIDs faster.

    Generating and not generating SIDs for your DSO X should not have any impact on the DTP load to cube.

    Regards

    Anindya

    Edited by: Anindya Bose on Aug 30, 2011 3:01 AM

    Add a comment
    10|10000 characters needed characters exceeded

  • author's profile photo Former Member
    Former Member
    Posted on Aug 30, 2011 at 02:46 AM

    Hi,

    Generation of SID upon Activation" from DSO is required if you have to do reporting on DSO if not remove it it will improve perfromance.

    Thanks,

    Add a comment
    10|10000 characters needed characters exceeded

  • Posted on Aug 30, 2011 at 04:14 AM

    Hi,

    There are following things which you can do

    1. Remove the setting of SID generation in DSO if you are not reporting on DSO

    2.Check whether you have got multiple processes running at the time of cube loading.

    3. See SM50 got sufficient free processes

    4. Try to put some parallel loads if possible

    5. If it is 3.x system load the data without PSA.

    6. Check with basis in case there is any memory issue

    I hope above helps.

    Thanks and regards

    Add a comment
    10|10000 characters needed characters exceeded

    • Yes Meng..

      If you look at my first post I said the same thing .

      Let's say we have one dimension Material and we have 2 characteristics 0Material 0Prodh4 ( Product Line) under Material dimension.

      Now to have a dimension id you need combination of SIDs of Material and Product Line . During loading to cube system checks the SIDs of a characteristics from master data table in the "Conversion of Characteristics to SID" steps and generate the Dimension ids. This is the steps which is taking time in your case.

      Basically there can be two reasons.

      1. DIM ids are not present ( If you Right Click on the cube---->Delete Data , it will pop up another window to confirm whether you want to keep dimension ids or not , if you select 'No" Dimension ids will be deleted. )

      2. Your dimension table is very large , in that case to read the dimension table and fill accordingly will take much time.

      You can run report SAP_INFOCUBE_DESIGNS from SE38/SA38. This will give you the information whether you have bad dimension modeling.

      Generating SIDs for DSO is only relevant if you are reporting on that DSO.

      If you want to know why do we generate SIDs for DSO while its a flat structure you can look at the below thread

      Regards

      Anindya

  • author's profile photo Former Member
    Former Member
    Posted on Aug 30, 2011 at 06:45 AM

    Hi,

    Load Master Data and activate it before before loading Transaction data... Reverse SID creation will degrade load performance.

    -


    Thanks

    BVR

    Add a comment
    10|10000 characters needed characters exceeded

  • author's profile photo Former Member
    Former Member
    Posted on Oct 15, 2013 at 01:08 PM

    Hi All,

    Simillar to the above topic, i have one doubt.

    In my case we uncheck the SID generatin upon activation option for a DSO to reduce to activation time, since there is no report developed on it.

    After one yr we got one new requirement which leads to devloped a report on this DSO. Now we planned to check the SID generation upon activation option.

    Here my doubt is after the changes moved to production system data reload is required.

    Add a comment
    10|10000 characters needed characters exceeded

Before answering

You should only submit an answer when you are proposing a solution to the poster's problem. If you want the poster to clarify the question or provide more information, please leave a comment instead, requesting additional details. When answering, please include specifics, such as step-by-step instructions, context for the solution, and links to useful resources. Also, please make sure that you answer complies with our Rules of Engagement.
You must be Logged in to submit an answer.

Up to 10 attachments (including images) can be used with a maximum of 1.0 MB each and 10.5 MB total.