Skip to Content
author's profile photo
Former Member

Reading a huge volume of records with JDBC

Hi, I was wondering if there was any way to make it so XI can handle reading millions of entries from a DB2 query, thanks.

Add comment
10|10000 characters needed characters exceeded

  • Follow
  • Get RSS Feed

1 Answer

  • Posted on Aug 21, 2007 at 02:16 PM

    That largely depends upon the XI hardware sizing.

    I hope by query u meant SQL query in sender JDBC adapter.



    Add comment
    10|10000 characters needed characters exceeded

    • Former Member Former Member

      Hey Paul,

      This is really tricky scenario... there is one more option...but rather than JDBC adapter we can use File Adapter here...

      SQL BCP Command allows you to create with "N"number of records file where you can specify starting row and ending row..and you can call this command in Stored Procedure ( which will keep a track on starting row number n endding row number).

      You have to write a stored procedure(sp) for creating "n" number of files on application server / ftp server using SQL BCP command..( Writing SP would be tricky again)..

      You can call stored procedure using script before calling File Adapter...which will create files from database and file adapter will just pickup. 😊

      Also then again you can write a script to delete this files after running file adapter.

      Just another thought...if possible. 😊