Skip to Content
Former Member
Jun 23, 2009 at 01:40 PM

Tuning the validation transform in Data Integrator



We have to bring 21 million records from a table to a new table using validation transform.

We are selecting PK and putting a validation condition "Exists in a table " on it. The secondary table selected is the target table and we are taking Failed records and passing them to the target table.

So here we have a source table, we are taking failed records from validation transform having Existing in a table condition. The table selected here is the target table itself.

Its taking a lot of time.

Please pour in some suggestion to improve its performance. We have to track the changes in daily basis in this table and the source table doesn't have last updated/timstamp.