Submitting a Hadoop Command or a Hive Command to a specific Cluster using Python SDK/ REST API

SDK Examples:

Hive Command:
{code}
qds.py --token '<API TOKEN>' hadoopcmd run streaming <Parameters> --cluster-label=LABEL
{code}

Hadoop Command:
{code}
qds.py --token '' hadoopcmd run --cluster-label=<LABEL> streaming -files 's3://paid-qubole/HadoopAPIExamples/WordCountPython/mapper.py,s3://paid-qubole/HadoopAPIExamples/WordCountPython/reducer.py' -mapper mapper.py -reducer reducer.py -numReduceTasks 1 -input 's3://paid-qubole/default-datasets/gutenberg' -output '<s3 location for output>'
{code}

REST API:

Use Cluster label as "label":
{Code}
curl -i -X POST -H "X-AUTH-TOKEN: $AUTH_TOKEN" -H "Content-Type: application/json" -H "Accept: application/json" -d '{"label":"","sub_command": ...
{Code}

Have more questions? Submit a request

Comments

Powered by Zendesk