While running a Spark job an error message is returned with the following phrase:
Job aborted due to stage failure
There are multiple possible causes for this issue - it is necessary to look at the remaining error text to identify the cause and then the possible resolution.
If the error is due to one of the following please attempt the respective action:
|java.io.IOException: No space left on device||Increase the amount of disk storage backing the Slave Node Instances|
|java.lang.NullPointerException||Review the incoming data and code as a NULL is returned when a value is expected by the code.|
|java.io.FileNotFoundException||The desired directory either does not exist or cannot be accessed given the current security configuration.|