← Back to team overview

savanna-all team mailing list archive

How to run hadoop jobs



I installed savanna from the git repository. I can create cluster but only with admin, when I try to create cluster with non-admin user it gives me an error:

(keystone_arindam)]# http $SAVANNA_URL/clusters X-Auth-Token:$AUTH_TOKEN  < cluster_create.json
Content-Length: 111
Content-Type: application/json
Date: Sat, 13 Jul 2013 16:47:25 GMT

    "error_code": 500,
    "error_message": "Error occurred during validation",
    "error_name": "INTERNAL_SERVER_ERROR"

The hadoop daemons are not started automatically so I could not run the test job.

hadoop@cluster-1-master-001:/usr/share/hadoop$ hadoop jar hadoop-examples.jar pi 10 100
Exception in thread "main" java.io.IOException: Error opening job jar: hadoop-examples.jar
        at org.apache.hadoop.util.RunJar.main(RunJar.java:90)
Caused by: java.io.FileNotFoundException: hadoop-examples.jar (No such file or directory)
        at java.util.zip.ZipFile.open(Native Method)
        at java.util.zip.ZipFile.<init>(ZipFile.java:214)
        at java.util.zip.ZipFile.<init>(ZipFile.java:144)
        at java.util.jar.JarFile.<init>(JarFile.java:153)
        at java.util.jar.JarFile.<init>(JarFile.java:90)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:88)
hadoop@cluster-1-master-001:/usr/share/hadoop$ start-all.sh
mkdir: cannot create directory `/mnt/log': Permission denied
chown: cannot access `/mnt/log/hadoop/hadoop/': No such file or directory
starting namenode, logging to /mnt/log/hadoop/hadoop//hadoop-hadoop-namenode-cluster-1-master-001.out
/usr/sbin/hadoop-daemon.sh: line 136: /mnt/log/hadoop/hadoop//hadoop-hadoop-namenode-cluster-1-master-001.out: No such file or directory
head: cannot open `/mnt/log/hadoop/hadoop//hadoop-hadoop-namenode-cluster-1-master-001.out' for reading: No such file or directory
hadoop@localhost's password:

when I try to start hadoop manually, it asks for a password. How to do it? Am I missing something?



Follow ups