我正在尝试让Giraph在一个纱线集群(Hadoop 2.5.2)上运行,但是我是否被这个错误卡住了:
Could not find or load main class org.apache.giraph.yarn.GiraphApplicationMaster我已经尝试了所有我能找到的关于这个主题的消息,但都没有用。我的命令行是这样的:
hadoop jar /home/prhodes/giraph/giraph-examples/target/giraph-examples-1.2.0-SNAPSHOT-for-hadoop-2.5.2-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/prhodes/input/tiny_graph.txt -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/prhodes/giraph_output/shortestpaths -w 4 -yj /home/prhodes/giraph/giraph-examples/target/giraph-examples-1.2.0-SNAPSHOT-for-hadoop-2.5.2-jar-with-dependencies.jar,/home/prhodes/giraph/giraph-core/target/giraph-1.2.0-SNAPSHOT-for-hadoop-2.5.2-jar-with-dependencies.jar我已经检查了这些jars是否位于集群中每个节点上的这些位置。此外,我还验证了jar文件确实包含GiraphApplicationMaster.class。然而,它仍然抱怨找不到GiraphApplicationMaster。
有没有其他可能导致这个问题的原因,或者有什么解决办法?还有其他的建议或想法吗?
发布于 2015-03-26 23:19:00
我用命令解决了这个问题:
cp $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-for-hadoop-2.6.0-jar-with-dependencies.jar $HADOOP_HOME/share/hadoop/yarn/lib/
cp $GIRAPH_HOME/giraph-examples/target/ $HADOOP_HOME/share/hadoop/yarn/lib/然后,运行您的作业
https://stackoverflow.com/questions/29001491
复制相似问题