Is there any way to update the target table without table comparsion transformation. TC is taking so much of time for upsert operation or any other optimization technique to improve the performance of the TC and Map opeation.
Join two tables or use update command in a script after the dataflow. But both the methods are not efficient as TC. What comparison method are you using in TC?
Yes, you have to. Thats the fastest way for doing TC when you are dealing with 36 million records. Add a query transform before TC and put orderby for source records.
I guess once you move to sorted comparsion , your problem will be solved. Cache comparsion cannot handle 36 million records. No need to join any tables. Retain the same structure, change TC to sorted and add a query before TC to orderby.
Use sorted comparison and uncheck "detect deleted rows" and check "input keys contain duplicates"
Could you pls explain the bit about "detect deleted rows" and "input keys contain duplicates" option as well Detect all rows,Detect row with larger key values. with some examples....
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.