NullPointerException(NPE) in Notebook

Symptom:

When you execute a paragraph in notebook, you might encounter NullPointerException(NPE). Stack trace will look like below: 

java.lang.NullPointerException
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:40)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:35)
at org.apache.zeppelin.spark.SparkInterpreter.createSparkContext_2(SparkInterpreter.java:509)
at org.apache.zeppelin.spark.SparkInterpreter.createSparkContext(SparkInterpreter.java:498)
at org.apache.zeppelin.spark.SparkInterpreter.getSparkContext(SparkInterpreter.java:205)
at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:913)
.....
 
Cause:
You have configured more executor memory or giving more spark.executor.cores than the node can allocate.
 
Action:
You can confirm this in interpreter logs. Move to top right in Notebook, click on Interpreters and goto Logs. You will see stack trace and logs which show you are requesting more memory.
 
Caused by: java.lang.IllegalArgumentException: Required executor memory (61440+2560 MB) is above the max threshold (56448 MB) of this cluster!
 
Please reduce executor memory to less than 90% of slave node can support. 
 
 
 
Have more questions? Submit a request

Comments

Powered by Zendesk