Skip to Content

JDBC Sender Adapter limitation for reading data from table

Hello All,

Currently i am working on SAP PI/PO 7.5 single stack version.

Requirement:

Need to read 5 year data from a table, table have entries in lacs.

So firstly whole data should be copied to third party database table with one to one mapping, then scenario will work normally using polling interval. table will have approx 10 columns.

Queries:

1) Is any way we can read data in a slots/chunks like 1000 entries at a time for single message?

2) There is one parameter for defining Max size of message, but how to calculate message size as per message entries?

3) what will be impact if will use Select * query for reading data at once?

4) what is JDBC adapter limitations for reading data?

Kindly advise for these doubts.

Regards,

Karan Kholakiya

Add comment
10|10000 characters needed characters exceeded

  • Get RSS Feed

1 Answer

  • Best Answer
    Dec 06, 2016 at 01:56 AM

    Hi Karan!

    Take a look at these documents, it might help:

    https://launchpad.support.sap.com/#/notes/0001253826

    https://archive.sap.com/documents/docs/DOC-16231

    For fetching records in chunks you could use special syntax in your query like "Select Top n" for MS SQL Server or "select * from (SELECT column FROM table ) WHERE ROWNUM <= n" for Oracle. But you should consider updating the same recordset with some "processed" flag in your source database.

    Regards, Evgeniy.

    Add comment
    10|10000 characters needed characters exceeded