Skip to Content

JDBC Receiver UPDATE_INSERT Performance issues

Hi experts,

We are using JDBC receiver adapter to update SQL database table with UPDATE_INSERT mode. There are around 200000 records in total which should be posted to target table. We are facing major performance issue with UPDATE_INSERT operations and JDBC channel is taking around 2 hours to post 10,000 records at a time.

We are on XI3.0 SP19 so there is no 'maximum concurrency' option available to increase parallelism for JDBC channel.

Also we confirmed with the target DB team and they are using primary key cluster index on SQL database tables.

Is there any other configuration that we can do to improve JDBC receiver adapter performance specially in case of UPDATE_INSERT command?

Please help..its urgent..

Thanks,

Minal Vaidya

Add a comment
10|10000 characters needed characters exceeded

Assigned Tags

Related questions

3 Answers

  • Best Answer
    Posted on May 24, 2012 at 09:49 AM

    hi,

    there are many things which can be a cause of that :

    a) you're sending 10,000 records in multiple calls instead of one (you can try both approaches to check which one works better)

    b) if your DB is pretty far from PI (in server placement terms) you can also try to use a local adapter engine - next to DB

    10000 calls should not take more then a few minutes for sure - as this is nothing

    Regards,

    Michal Krawczyk

    Add a comment
    10|10000 characters needed characters exceeded

  • Posted on May 24, 2012 at 03:34 PM

    Few cents.. Plus if your database tables are not indexed then it would certainly cause the delay for your sql operation even for 500 records. Advice DBA for checking any index problem in database level. Insert 10k records is not a large volume records. Certainly PI can handle much more than this. As Raja said, you might change your structure and move to SP also. Take help from DBA team. This would help to some extent for sure.

    Add a comment
    10|10000 characters needed characters exceeded

  • author's profile photo Former Member
    Former Member
    Posted on Jul 24, 2014 at 08:27 AM

    Hi Minal,

    have u resoved your performance problem?

    I have a similiar one now. very urgent!

    Thanks

    Christine

    Add a comment
    10|10000 characters needed characters exceeded

Before answering

You should only submit an answer when you are proposing a solution to the poster's problem. If you want the poster to clarify the question or provide more information, please leave a comment instead, requesting additional details. When answering, please include specifics, such as step-by-step instructions, context for the solution, and links to useful resources. Also, please make sure that you answer complies with our Rules of Engagement.
You must be Logged in to submit an answer.

Up to 10 attachments (including images) can be used with a maximum of 1.0 MB each and 10.5 MB total.