SAP Cloud SDK: OData request processing has been abnormally terminated

[sonchka777]

Hi experts,

I am using API_MATERIAL_DOCUMENT_SRV for SAP Cloud SDK Neo Java EE application. I can only read around 10000 materials (there are >500000 materials available). If I increase the number, for ex. 20000, I get an error message – RAISE_SHORTDUMP. The OData request processing has been abnormally terminated.

I have increased the timeout value in web.xml, but that didn't help.

Is there any way to change the size limit to read all the data or at least more than 10000?

Thanks and best,

Sona

[mkuhr-test · Accepted solution]

You could use top & skip in order to work around that. So first read the top 10000 items, then skip 10000 and again read 10000, then skip 20000 and so on until you got all.

[sonchka777 · Accepted solution]

It slows down the process, but still a nice workaround, thanks!

[mkuhr-test · Accepted solution]

Well you are requesting a lot of items. Processing time will probably exceed the additional time taken by the top & skip thing. Thus I wouldn't expect a huge drop in performance.

In general this concept is called pagination. Usually the server doesn't even allow to access that many items at once but sends only a subset. This would be called server side pagination. E.g. SuccessFactors OData APIs all start pagination at 1000 items, so they never return more than that at once. However, in your case the server seems to prefer breaking down instead so you have to do the pagination your self 😉

[gregorw · Accepted solution]

Dear sonchka777 don't forget to accept the correct answer. Working in packages when transfering huge amounts of data is a good idea.