Error: the requested URL returned error

Symptom

While running a job in Hive or Spark an error message is returned with the following phrase:

the requested URL returned error

This may be accompanied by additional phrases such as:

  • Retrying exception reading mapper output
  • Retrying exception reading mapper logs

Cause

This error is likely occurring because of either a task or the driver running out of memory.

Action

If the job is in Hive consider increasing the size of the Mapper tasks or increasing the size of the slave node instances if the available resources are already fully utilized. Please refer to the How To: Hive Tuning KBase article for details on tuning Spark. If the job is in Spark consider increasing the driver memory if possible or increasing the size of the slave nodes if the available resources are already fully utilized. Please refer to the How To: Spark Tuning KBase article for details on tuning Spark. 

Have more questions? Submit a request

Comments

Powered by Zendesk