APD shortdum - Join causes error TSV_TNEW_BLOCKS_NO_ROLL_MEMORY

Hello Experts,

Our APD process is shortdumping in Production system due to high memory consumption - TSV_TNEW_BLOCKS_NO_ROLL_MEMORY.

This is happening despite unticking the box in "Performance settings"--> Process All Data in the Main Memory.

The issue is caused by JOIN transformation which first reads data from two sources, then sorts it for each case and then merge. It seems the whole data set is stored in the memory (heap memory + extended memory) which eventually runs out.

SAP recommends using InfoSets instead of JOINS as they operate on the database server rather than application server. However, we have some logic before we join data.

Is there anything we can do to improve APD performance / memory management?

Kind regards,

Roman