Skip to Content

Table Comparison taking too long to compare

Hello Experts,

I have a dataflow which is having Table A (4900000 records) LEFT joined with 3 other tables (max records 800000) followed by a table comparison ,map operation and target table. All the tables are created in Hana Database.

Now every time I execute my job,this dataflow takes almost 35 minutes to execute and load the data into target. Tried lot of tuning techniques but doesn't seem to make much difference.

Thanks in advance.

Ankit

Add comment
10|10000 characters needed characters exceeded

  • Get RSS Feed

1 Answer

  • Best Answer
    Jan 16 at 09:03 AM

    Which is the Comparison method used in the TC transform.

    Are your Source tables from a same Datastore or different one?

    Try using a Data Transfer transform after the Query transform with Transfer Type as Table.

    Below is the data flow:

    Source(LOJ)>Query_Transform>Data_Transfer>TC>MO>Target Table

    You can also go with the Bulk Loader options on the HANA Target table which is mentioned in the below article. As you have TC and MO in the data flow Bulk Loader should improve the performance.

    https://wiki.scn.sap.com/wiki/display/EIM/Bulk+Loading

    Regards

    Arun Sasi

    Add comment
    10|10000 characters needed characters exceeded

    • Ankit, I assume that there are Primary Keys(s) on the HANA target table. Check if you can rebuild the indexes on the Target table. If there are more than 1 indexes then it is possible that the indexes are fragmented. This might help from the performance perspective. Check with your DBA if you dont have rights to rebuild the indexes

      Regards

      Arun Sasi