Skip to Content

Best approach to load data from PSA to cube 3.x flow

Dear Experts,

We have a situation whereby we are required to redesign our complete cube dimensions due to loading performance issue. We have the 3.x flow and Lately it's been taking 7 hours just to load a couple thousand records from PSA to cube and it's been painful.

Now, in order to redesign the cube we will need to delete the cube data and since we have all the data present in PSA we can load from this as starting point. However, we have about 6-7 years of data stored in psa which will need to be loaded to cube.

In this case, since we do not have the convenience of loading via dtp unfortunately I would like to know the fastest or rather the best approach to do so considering the huge amount of data n no.of requests and no. Of datasources as well which provide data to this cube.

Could you please let me know how we can go about this.

Appreciate any help I can get. Thanks much.

Jem

Add a comment
10|10000 characters needed characters exceeded

Related questions

3 Answers

  • Best Answer
    author's profile photo Former Member
    Former Member
    Posted on Jul 05, 2016 at 10:58 PM

    Hi Jemma,

    I think you should approach your problem in several ways.

    1. I think the reason that the load is slow is not because of CUBE modeling, l would think that the slow load is the symptom of information being stored in the PSA, most likely there are millions of records. This is not avisable.

    a) I'm not sure why it is stored all information in PSA since you have it in the CUBE.

    You can delete requests in PSA and mantain only keep the 3 past months and I can assure you the load will be within 1 hr.

    Additional Comment: Please check with your basis team and check for the largest tables in your

    system. If the biggest are PSA or something like /BIC/000003154, you must take action

    DELETING all your PSA's of your biggest models. Create a PSA deletion step in Process Chains.

    2) TIP: I would strongly reccomend to create a copy of your cube and mantain it intact with all information.Connect ORIGINAL CUBE -> COPY CUBE with transformation and do loads per month. YOU NEVER KNOW what can go bad.

    IF you have a MULTIPROVIDER on the TOP of your CUBE, you can mantain ORIGINAL CUBE as the loading and COPY CUBE AS HISTORIC, THIS also will load much faster and should not impact queries or loads.

    b) If you need to re model this cube, you can use function module with Tx se37 RSDU_INFOCUBE_TABLE_SIZES to check for the CUBE and the dimension tables SIZE so you can model it in a better way.

    after remodeling, and having teh COPY CUBE as backup, you can reload all PSA.

    AFTER you finish reloading your cube,

    I would reccomend you to migrate from 3.x to 7. Please check this link as a starting point.

    As you can see there are several points to consider in your issue.

    Step by step you can solve it succesfully. Always take precautions.

    Best Regards.

    Hope it helps. you can contact me directly through gjunoe@hotmail.com

    Regars from Mx.

    Add a comment
    10|10000 characters needed characters exceeded

  • Posted on Jul 05, 2016 at 04:00 PM

    Hello Jemma,

    We are having a similar issue and there are a couple of options:

    You could consider remodeling where you can add/remove objects and adjust in a way such that dimensions are well split. But this does not let you create new/line item dimensions I believe.

    A total data load can also be performed starting from reinitializing the delta.

    This is in my opinion but let's wait for other responses. It will help me understand better too.. 😊

    Thanks,

    Aboli.

    Add a comment
    10|10000 characters needed characters exceeded

  • Posted on Jul 08, 2016 at 06:05 PM

    It may also be a good idea to maintain full data records in either a standard or write optimized DSO and keep 1 - 3 months of data available in the PSA. As Gonzalo stated,keeping a lower amount of records in the PSA would allow for easier and faster delta loads to the cube.

    Thanks,

    James

    Add a comment
    10|10000 characters needed characters exceeded

Before answering

You should only submit an answer when you are proposing a solution to the poster's problem. If you want the poster to clarify the question or provide more information, please leave a comment instead, requesting additional details. When answering, please include specifics, such as step-by-step instructions, context for the solution, and links to useful resources. Also, please make sure that you answer complies with our Rules of Engagement.
You must be Logged in to submit an answer.

Up to 10 attachments (including images) can be used with a maximum of 1.0 MB each and 10.5 MB total.