Skip to Content
author's profile photo Former Member
Former Member

Change the data flow from Full load to delta

Hi Team ,

We have an existing data flow from Datasource ----> Cube1 which is daily drop and full load. Now , the requirement is to change the daily drop and full load to DELTA load. In this process , we have planned to change the data flow to :

1)Datasource -> standard DSO1 ( full load - daily drop)

2)DSO1 --> DSO2 ( Delta load)

3)DSO2 --->DSO2 (Self transformation and write end routine to delete the existing records from cube1)

3)DSO2 --> cube1 (Delta Load)

I need your help to achieve this data flow . and I doubt whether we need to delete records in self transformation of DSO2 by checking to those records in cube 1 or DSO1 . Request you to help me with the data flow.

All the above objects are in 7.4

Thanks,

Venkat

Add a comment
10|10000 characters needed characters exceeded

Related questions

1 Answer

  • Best Answer
    Posted on Nov 16, 2015 at 12:14 PM

    Hi Venkat,

    Two DSO's and self loop transformations may won't be needed.

    please you can design data flow like below and test at dev system for delta loads.

    Data source---->DSO-->cube

    source to Data source - Load Full load info pack

    PSA to DSO - Load full load DTP

    DSO to Cube--Load delta dtp.

    DSO - its overwrite function. So data deletion is not required.

    DSO overwrite functionality works based on key fields which we used at dso deign layer.

    form DSO changlog table we can load delta data to cube.

    Thanks

    Add a comment
    10|10000 characters needed characters exceeded

Before answering

You should only submit an answer when you are proposing a solution to the poster's problem. If you want the poster to clarify the question or provide more information, please leave a comment instead, requesting additional details. When answering, please include specifics, such as step-by-step instructions, context for the solution, and links to useful resources. Also, please make sure that you answer complies with our Rules of Engagement.
You must be Logged in to submit an answer.

Up to 10 attachments (including images) can be used with a maximum of 1.0 MB each and 10.5 MB total.