How To: Increase the Heap Space when there are OOM errors

Description:

This article describes the measures to be taken when OutOfMemory errors are seen while executing commands on the QDS Analyze page.

 

How To:

  • Make sure that Hive on Master is enabled for the account where the command is run
  • Use the template given below and use appropriate tuning parameters within the node bootstrap script
  • Attach the node bootstrap script with the cluster
  • Restart the cluster

 

Code Snippet:

 

HUSTLER_HOME=/usr/lib/hustler

source ${HUSTLER_HOME} /bin/qubole-bash-lib.sh

is_master=`nodeinfo is_master`

if [[ "$is_master" == "1" ]]; then

echo "export HADOOP_CLIENT_OPTS=\"\$HADOOP_CLIENT_OPTS -Xmx6512m\"" >> /usr/lib/hive1.2/bin/hive-config.sh

fi

Have more questions? Submit a request

Comments

Powered by Zendesk