Skip to Content

ODATA flow is failing, while processing big amount of records.

Hello Dear Experts.

We are experiencing issue with replication of custom BO "Potential.BO", which is happening from CRM OP to C4C through HCI.

Flow is designed to process records in bulk via OData.

As you can see it is using GET method to fetch all records in "Potential.BO" using OData, ContentEnricher to save ObjectID of existing entry

and POST method to Insert or Update mass update records.

Flow was working fine unless record count of Potential.BO reached > 400k. And currently not able to process even 10 records because it is failing at the "ODATA GET/Content Enricher" step.

We are getting following error: Premature end of Content-Length delimited message body (expected: 197700989; received: 83449354, cause: org.apache.http.ConnectionClosedException: Premature end of Content-Length delimited message body (expected: 197700989; received: 83449354

It seems there is a limitation of received message length. Record count of Potential.BO planned to be even higher, because more records will be loaded from CRM. Current record count is more than 800k.

- Is there a way to call GET method only for those records which we received from CRM, igoring others (in bulk)?

- We have tried to use Looping Process Call, but it was not suitable together with Enricher.

- Is there a way to save multiple records at a time without using ObjectID, but some other custom Key?

We cannot process records one-by-one, because performance is critical for customer, meaning we cannot use SOAP or ODATA to process less records at a time. Could you please review flow and provide feedback of possible alternative solutions?

iflow.png (17.3 kB)
iflow.png (20.0 kB)
Add comment
10|10000 characters needed characters exceeded

0 Answers