How To: Install Pig 11

Description

This article describes how to install Pig 11 in an AWS Cluster launched by Qubole.

Prerequisites:

  • AWS Console Access
  • Qubole Control Panel Access

How To:

  • Create a file named node_bootstrap.sh (name it as per your convention) with the content:

mkdir -p /media/ephemeral1/pig11
hadoop dfs -get s3://paid-qubole/pig11/pig.tar.gz /media/ephemeral1/pig11/
tar -xvf /media/ephemeral1/pig11/pig.tar.gz -C /media/ephemeral1/pig11/

  • Edit the specific Qubole cluster at Control Panel and pass the name of the Bootstrap file into the location at "Node Bootstrap File" and place the file in the appropriate location in AWS S3.
  • You need to provide complete path of pig as shown in the example below:

 

/media/ephemeral1/pig11/pig/bin/pig s3n://<BucketName>/<subfolder>/<PigfileName>.pig

Have more questions? Submit a request

Comments

Powered by Zendesk