Skip to Content
0

How to delete rows from source CDC Oracle table comparing the target HANA table

Dec 21, 2016 at 05:11 AM

88

avatar image

Hi guys,

I am new in data services, and we are doing some CDC between Oracle and SAP Data Services to load data in HANA (Unfortunately no budget at this stage fo SDA).

The steps that I am doing are:

1- Create CDC tables using SAP Data Services with the wizard

2- Run 1st job with a full refresh for the source Oracle table into HANA target table (one time job)

3- Run 2nd delta job to identify duplicates rows between the CDC Oracle source table and HANA target table (obviously some new rows will be in the CDC table that are already loaded in the full refresh) (one time job)

4- Run the 3rd job that will be executed every 15 minutes to have real time data in HANA target table. At the end of this job we are planning to refresh CDC Tables older than more than three days as a backup (recurrent job)

My issue is in step 2:

How can I delete from my source CDC Oracle table the duplicates Insert values ('I' in CDC_MAP_OPERATION) that are already in my target HANA table? We don't want to delete the rows from target.

Obviously, if I run the job, I will have an error because the key value is already in target HANA table.

Thank you

10 |10000 characters needed characters left characters exceeded
* Please Login or Register to Answer, Follow or Comment.

2 Answers

Ravi kiran Pagidi Dec 30, 2016 at 11:19 AM
0

load those duplicate 'I' records to a staging table.. and now make this staging as source in next dataflow and your source CDC table as target and use map operation (normal to delete).

But make sure your requirement is valid before deleting source data. usually we dont delete source data.

Share
10 |10000 characters needed characters left characters exceeded
Ravi kiran Pagidi Dec 30, 2016 at 11:19 AM
0

load those duplicate 'I' records to a staging table.. and now make this staging as source in next dataflow and your source CDC table as target and use map operation (normal to delete).

But make sure your requirement is valid before deleting source data. usually we dont delete source data.

Share
10 |10000 characters needed characters left characters exceeded