Skip to Content
0
Jan 10, 2019 at 03:21 PM

Predictive Analytics. Container killed by YARN for exceeding memory limits

68 Views

Hi,

I am trying to train a model in Predictive Analytics using Native Spark Modeling (I have already trained another small model and it worked fine), but the training fails and I get the following error message in the IDBM logs:

ERROR YarnScheduler:74 - Lost executor 1 on 404-39-c02.rt1.altiscale.com: Container killed by YARN for exceeding memory limits. 1.6 GB of 1.5 GB physical memory used.

I understand this is happening because I don't have enough memory, right? do I need to modify a configuration file to fix this?

Thank you