cancel
Showing results for 
Search instead for 
Did you mean: 

Table Comparison Performance

Former Member
0 Kudos

Anyone has experience with using table comparison transforming for large volume data, e.g. 10M records.

How is the performance?

Any experience and suggestions is welcome.

Accepted Solutions (0)

Answers (1)

Answers (1)

former_member467822
Active Participant
0 Kudos

Performance will depend on a lot of factors, but the two big ones are:

1. how many columns you are using in your compare (more columns will be slower)

2. how you do the compare (sorted input is WAY faster than row comparison)

Without knowing any details about your data or the process you are trying to implement it's difficult to make any additional recommendations. But keep in mind that there are other options - especially for really big data sets.

For example, you can always use a two step process that first deletes existing records matching the incoming set of primary keys, and then do a straight insert of the rows. This will avoid the whole comparison step - and avoid doing updates which are much slower than inserts.

However, this only works if you are replacing the existing records. It wouldn't work if your table compare is part of a type 2 dimension load or something that requires you to track history.

werner_daehn
Active Contributor
0 Kudos

[https://wiki.sdn.sap.com:443/wiki/display/BOBJ/TableComparison(sorted+input)]

[https://wiki.sdn.sap.com:443/wiki/display/BOBJ/TableComparison(cache+mode)]

[https://wiki.sdn.sap.com:443/wiki/display/BOBJ/TableComparison(rowbyrow+setting)]