Skip to content

louvain invalid input exception #85

@justinmaojones

Description

@justinmaojones

I've installed hadoop 2.5.2, giraph 1.1.0, and sotera dga locally on my machine without cloudera. I've successfully run the hbse example. I have been unable to get the louvain example to complete successfully. It seems that it completes the calculations that go into $OUTPUTDIR/giraph_0, but then throws an invalid input exception when it cannot find $OUTPUTDIR/giraph_1:

Processing /home/justinmaojones/bigdataproject/louvain_example/output/giraph_0 and /home/justinmaojones/bigdataproject/louvain_example/output/giraph_1
15/04/18 17:29:34 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
15/04/18 17:29:34 INFO mapreduce.JobSubmitter: Cleaning up the staging area file:/tmp/hadoop-justinmaojones/mapred/staging/nobody717318776/.staging/job_local717318776_0003
org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/home/justinmaojones/bigdataproject/louvain_example/output/giraph_1

To execute the louvain job I use the following command:

 ./bin/dga-yarn-giraph louvain /tmp/dga/louvain/input/ ~/bigdataproject/louvain_example/output/ -ca io.edge.reverse.duplicator=true -ca giraph.SplitMasterWorker=false

I can't seem to figure out why this isn't working. Is this a bug or an installation/configuration issue?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions