Skip to Content

Error In Extracting data from ODATA service in CPI DS for larger batch sizes

HI Experts,

We are consuming data from ODATA service in CPI DS where the interface works only if we put the batch size = 5 (Tasks take very large amount of time)but fails if i specify the larger batch size in the adapter options in ODATA datastore.

Below is the error:-

2019-06-04 15:39:41 (E)(3064:1056) RUN-58105 |Data flow RT_T_S4HANA_TO_IBP_KF_INVENTORYTURNS_RTFTEST_RT_DF_KF_INVENTORYTURNS Error preparing to read <TurnOverSet1>: <Exception occurs when executing 'begin' method of the adapter operation with ID [44]. no JSON format expected , or ]>. 2019-06-04 15:39:41 (E)(6548:9164) RUN-58105 |Data flow RT_T_S4HANA_TO_IBP_KF_INVENTORYTURNS_RTFTEST_RT_DF_KF_INVENTORYTURNS Error preparing to read <TurnOverSet1>: <Exception occurs when executing 'begin' method of the adapter operation with ID [44]. no JSON format expected , or ]>.

The interface worked only once or twice with Batch size = 200 (which is default.)


Please suggest.






Add a comment
10|10000 characters needed characters exceeded

Related questions

3 Answers

  • Posted on Jun 04, 2019 at 04:44 PM

    I would recommend a few changes in the adapter config in the Agent Configuration tool.

    1. Set trace mode to True for OData Adapter

    2. Increase the JVM max memory size (-Xmx256m to -Xmx1024m).

    If the difference is evident in some batch sizes and not others I could imagine that this is a performance/resource issue, so increase the available memory when batch sizes are larger.

    If issue still occurs after that see if you can find some more detailed errors from the adapter trace file %DS_COMMON_DIR%/adapters/log/ODataAdapter_trace.txt and post the error here for follow up.

    Thanks,

    Jeff

    Add a comment
    10|10000 characters needed characters exceeded

  • Posted on Jun 14, 2019 at 09:49 AM

    HI Jeff,

    Thanks for your reply.

    As suggested by you, we have made the below changes in the agent configuration tool

    1. Set trace mode to True for OData Adapter

    2. Increase the JVM max memory size (-Xmx256m to -Xmx1024m).

    After running the task in CPI DS , we do not see any increased performance with the smaller batch size = 5 as now also it takes around 2 hours to process around 25000 records.

    when we specify larger batch sizes like 50, 100 then the task just finishes after fetching between 50 to 500 records which is actually strange as it normally extracts thousands of records with batch size as 5.

    Also the task fails with Batch size = 200 with the error as specified in the initial post.

    Please suggest.

    Thanks,

    Shubham

    Add a comment
    10|10000 characters needed characters exceeded

  • Posted on Jun 17, 2019 at 07:00 AM

    Hi Jeff,

    Please share your views on the above Query.

    Thanks,

    Shubham.

    Add a comment
    10|10000 characters needed characters exceeded

Before answering

You should only submit an answer when you are proposing a solution to the poster's problem. If you want the poster to clarify the question or provide more information, please leave a comment instead, requesting additional details. When answering, please include specifics, such as step-by-step instructions, context for the solution, and links to useful resources. Also, please make sure that you answer complies with our Rules of Engagement.
You must be Logged in to submit an answer.

Up to 10 attachments (including images) can be used with a maximum of 1.0 MB each and 10.5 MB total.