How To: Running Giraph

Buiding Giraph:

To create the jar files, here are the steps:

    export JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk-
    tar -xvf apache-maven-3.2.2-bin.tar.gz
    cd giraph

    mvn install -DskipTests -X

Use Already Built JAR:

create a

mkdir -p /media/ephemeral0/
cd /media/ephemeral0/
hadoop dfs -get s3://paid-qubole/giraph/giraph-qubole.tar.gz ./    
tar -xvf giraph-qubole.tar.gz


Running Jobs:

1.Sample Shortest Path job:

Run as a shell command :

hadoop dfs -put /media/ephemeral0/giraph/tiny_text.txt /tmp
export JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk-
hadoop jar /media/ephemeral0/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif -vip /tmp/tiny_text.txt -vof -op /tmp/out1 -w 1    

2. Page Ranker benchmark job:

hadoop jar /media/ephemeral0/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar org.apache.giraph.benchmark.PageRankBenchmark  -e 1 -s 3 -v -V 5000 -w 1


Have more questions? Submit a request


Powered by Zendesk