Change the data flow from Full load to delta

[Former Member]

Hi Team ,

We have an existing data flow from Datasource  ----> Cube1 which is  daily drop and full load. Now , the requirement is to change the daily drop and full load to  DELTA load. In this process , we have planned to change the data flow to  :

1)Datasource  -> standard DSO1 ( full load - daily drop)

2)DSO1  --> DSO2 ( Delta load)

3)DSO2 --->DSO2 (Self transformation and write end routine to delete the existing records from cube1)

3)DSO2 --> cube1 (Delta Load)

I need your help to achieve this data flow . and  I doubt whether we need to delete records in self transformation of DSO2 by checking to those records in cube 1 or DSO1  . Request you to help me with the data flow.

All the above objects are in 7.4

Thanks,

Venkat

[RamanKorrapati · Accepted solution]

Hi Venkat,

Two DSO's and self loop transformations may won't be needed.

please you can design data flow like below and test at dev system for delta loads.

Data source---->DSO-->cube

source to Data source - Load Full load info pack

PSA to DSO - Load full load DTP

DSO to Cube--Load delta dtp.

DSO - its overwrite function. So data deletion is not required.

DSO overwrite functionality works based on key fields which we used at dso deign layer.

form DSO changlog table we can load delta data to cube.

Thanks