Error: container xxxx is running beyond physical memory limits

Symptom

While running a query in Hive an error is returned which contains the following phrase:

container xxxx is running beyond physical memory limits

Cause

This error can occur because the container hosting the Application Master is requesting more memory than is permitted per the settings in the cluster configuration.

Action

It will be necessary to increase the following two values and retry the query:

  • yarn.app.mapreduce.am.resource.mb
  • yarn.app.mapreduce.am.command-opts

Make sure that yarn.app.mapreduce.am.command-opts < yarn.app.mapreduce.am.resource.mb.

 
Have more questions? Submit a request

Comments

Powered by Zendesk