blocks|key|5474985|text|这基本上是因为FLUME_HOME..|type|unstyled|depth|inlineStyleRanges|entityRanges|data|5474986|尝试此命令|5474987|5474988|+$未设置FLUME_HOME|blockquote|5474989|5474990|entityMap^0|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|K|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|L|8|@]|9|@]|A|$]]|$1|D|3|-4|5|6|7|M|8|@]|9|@]|A|$]]|$1|E|3|F|5|G|7|N|8|@]|9|@]|A|$]]|$1|H|3|-4|5|6|7|O|8|@]|9|@]|A|$]]|$1|I|3|-4|5|6|7|P|8|@]|9|@]|A|$]]]|J|$]]

It is basically because of FLUME_HOME..

Try this command

<blockquote>
 $ unset FLUME_HOME
</blockquote>

blocks|key|5475061|text|我知道这个问题已经有将近一年的时间了，但是我看到了！|type|unstyled|depth|inlineStyleRanges|entityRanges|data|5475062|当您使用sudo+bin/flume-ng设置agnet时...确保指定代理配置所在的文件。|5475063|--conf-file+flume_Agent.conf+->+-f+conf/flume_Agent.conf|5475064|这就成功了！|5475065|entityMap^0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|J|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|K|8|@]|9|@]|A|$]]|$1|D|3|E|5|6|7|L|8|@]|9|@]|A|$]]|$1|F|3|G|5|6|7|M|8|@]|9|@]|A|$]]|$1|H|3|-4|5|6|7|N|8|@]|9|@]|A|$]]]|I|$]]

I know its been almost a year for this question, but I saw it! 

When you set your agnet using sudo bin/flume-ng.... make sure to specify the file where the agent configuration is. 

--conf-file flume_Agent.conf -> -f conf/flume_Agent.conf 

This did the trick!

blocks|key|5474963|text|在/flume-ng-dist/target/apache-flume-1.5.0.1-bin/apache-flume-1.5.0.1-bin中构建后，在/bin文件夹中运行+flume+-ng在此中运行flume-ng|type|unstyled|depth|inlineStyleRanges|offset|length|style|BOLD|entityRanges|data|5474964|entityMap^0|1|1Z|26|4|2G|A|2V|8|0^^$0|@$1|2|3|4|5|6|7|H|8|@$9|I|A|J|B|C]|$9|K|A|L|B|C]|$9|M|A|N|B|C]|$9|O|A|P|B|C]]|D|@]|E|$]]|$1|F|3|-4|5|6|7|Q|8|@]|D|@]|E|$]]]|G|$]]

look like you run flume-ng in /bin folder
flume after build in
/flume-ng-dist/target/apache-flume-1.5.0.1-bin/apache-flume-1.5.0.1-bin
run flume-ng in this

blocks|key|5475028|text|我想你是想在windows上运行cygwin的flume吧？如果是这样的话，我也有类似的问题。问题可能出在flume-ng脚本上。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|5475029|在bin/flume-ng中找到以下行：|5475030|+$EXEC+java+$JAVA_OPTS+$FLUME_JAVA_OPTS+"${arr_java_props[@]}"+-cp+"$FLUME_CLASSPATH"+\
++-Djava.library.path=$FLUME_JAVA_LIBRARY_PATH+"$FLUME_APPLICATION_CLASS"+$*|code-block|syntax|javascript|5475031|并将其替换为|5475032|$EXEC+java++$JAVA_OPTS+$FLUME_JAVA_OPTS+"${arr_java_props[@]}"+-cp+`cygpath+-wp+"$FLUME_CLASSPATH"`+\
++-Djava.library.path=`cygpath+-wp+$FLUME_JAVA_LIBRARY_PATH`+"$FLUME_APPLICATION_CLASS"+$*|5475033|请注意，路径已替换为windows目录。Java无法从cygdrive路径中找到库路径，因此我们必须在适用的情况下将其转换为正确的windows路径|5475034|entityMap^0|0|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|Q|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|R|8|@]|9|@]|A|$]]|$1|D|3|E|5|F|7|S|8|@]|9|@]|A|$G|H]]|$1|I|3|J|5|6|7|T|8|@]|9|@]|A|$]]|$1|K|3|L|5|F|7|U|8|@]|9|@]|A|$G|H]]|$1|M|3|N|5|6|7|V|8|@]|9|@]|A|$]]|$1|O|3|-4|5|6|7|W|8|@]|9|@]|A|$]]]|P|$]]

I suppose you are trying to run flume from cygwin on windows? If that is the case, I had a similar issue. The problem might be with the flume-ng script.

Find the following line in bin/flume-ng:

<pre><code> $EXEC java $JAVA_OPTS $FLUME_JAVA_OPTS "${arr_java_props[@]}" -cp "$FLUME_CLASSPATH" \
 -Djava.library.path=$FLUME_JAVA_LIBRARY_PATH "$FLUME_APPLICATION_CLASS" $*
</code></pre>

and replace it with this

<pre><code>$EXEC java $JAVA_OPTS $FLUME_JAVA_OPTS "${arr_java_props[@]}" -cp `cygpath -wp "$FLUME_CLASSPATH"` \
 -Djava.library.path=`cygpath -wp $FLUME_JAVA_LIBRARY_PATH` "$FLUME_APPLICATION_CLASS" $*
</code></pre>

Notice that the paths have been replaced with the windows directories. Java would not be able to find the library paths from the cygdrive paths and we would have to convert it to the correct windows paths wherever applicable

blocks|key|3363592|text|也许您正在使用源文件，您应该首先编译源代码并生成二进制代码，然后在二进制文件目录中，您可以执行:flume+bin/flume-ng--conf./conf/+-f+conf/flume.conf+-Dflume.root.logger=DEBUG，console+-n+agent1。所有这些信息你都可以遵循：https://cwiki.apache.org/confluence/display/FLUME/Getting%2BStarted|type|unstyled|depth|inlineStyleRanges|offset|length|style|BOLD|entityRanges|data|3363593|entityMap|0|LINK|mutability|MUTABLE|url|https://cwiki.apache.org/confluence/display/FLUME/Getting%2BStarted^0|1U|24|4C|1T|0|0^^$0|@$1|2|3|4|5|6|7|N|8|@$9|O|A|P|B|C]]|D|@$9|Q|A|R|1|S]]|E|$]]|$1|F|3|-4|5|6|7|T|8|@]|D|@]|E|$]]]|G|$H|$5|I|J|K|E|$L|M]]]]

Maybe you are using the source files, you first should compile the source code and generate the binary code, then inside the binary files directory, you can execute: bin/flume-ng agent --conf ./conf/ -f conf/flume.conf -Dflume.root.logger=DEBUG,console -n agent1. All these information you can follow: <a href="https://cwiki.apache.org/confluence/display/FLUME/Getting+Started" rel="nofollow">https://cwiki.apache.org/confluence/display/FLUME/Getting+Started</a>

blocks|key|3363608|text|我之前也遇到过同样的问题，只是因为FLUME_CLASSPATH没有设置|type|unstyled|depth|inlineStyleRanges|entityRanges|data|3363609|entityMap^0|0^^$0|@$1|2|3|4|5|6|7|D|8|@]|9|@]|A|$]]|$1|B|3|-4|5|6|7|E|8|@]|9|@]|A|$]]]|C|$]]

I got same issue before, it's simply due to FLUME_CLASSPATH not set

blocks|key|2301690|text|最好的调试方法是查看java命令是否被触发，并确保flume库包含在CLASSPATH+(-cp)中。|type|unstyled|depth|inlineStyleRanges|offset|length|style|BOLD|CODE|entityRanges|data|2301691|在下面的命令中，它寻找/lib/*，这就是flume-ng-*.jar所在的位置，但它是不正确的，因为在/lib中，在-cp+'/staging001/Flume/server/conf://lib/*:/lib/*'这一行中没有任何东西。它必须是${FLUME_HOME}/lib。|2301692|usr/lib/jvm/java-1.8.0-ibm-1.8.0.3.20-1jpp.1.el7_2.x86_64/jre/bin/java+-Xms100m+-Xmx500m+$'-Dcom.sun.management.jmxremote\r'+\
-Dflume.monitoring.type=http+\
-Dflume.monitoring.port=34545+\
-cp+'/staging001/Flume/server/conf://lib/*:/lib/*'+\
-Djava.library.path=+org.apache.flume.node.Application+\
-f+/staging001/Flume/server/conf/flume.conf+-n+client|code-block|syntax|javascript|2301693|因此，如果您查看flume-ng+script，就会发现有FLUME_CLASSPATH设置，如果没有设置，则基于FLUME_HOME进行设置。|2301694|#+prepend+$FLUME_HOME/lib+jars+to+the+specified+classpath+(if+any)
if+[+-n+"${FLUME_CLASSPATH}"+]+;+then
++FLUME_CLASSPATH="${FLUME_HOME}/lib/*:$FLUME_CLASSPATH"
else
++FLUME_CLASSPATH="${FLUME_HOME}/lib/*"
fi|2301695|因此，请确保设置了这两个环境中的任何一个。使用FLUME_HOME设置(我使用的是systemd)|2301696|Environment=FLUME_HOME=/staging001/Flume/server/|2301697|下面是运行java+exec的代码。|2301698|/usr/lib/jvm/java-1.8.0-ibm-1.8.0.3.20-1jpp.1.el7_2.x86_64/jre/bin/java+-Xms100m+-Xmx500m+\
$'-Dcom.sun.management.jmxremote\r'+\
-Dflume.monitoring.type=http+\
-Dflume.monitoring.port=34545+\
-cp+'/staging001/Flume/server/conf:/staging001/Flume/server/lib/*:/lib/*'+\
-Djava.library.path=+org.apache.flume.node.Application+\
-f+/staging001/Flume/server/conf/flume.conf+-n+client|2301699|entityMap|0|LINK|mutability|MUTABLE|url|https://github.com/apache/flume/blob/d9c9a7dd9a6889ecf6b9dc88fb8e02ccc1cd5167/bin/flume-ng#L343^0|P|6|Y|9|19|3|0|B|6|L|E|1G|4|1N|1E|3G|H|0|0|8|8|T|F|1L|A|H|6|0|0|0|N|A|15|7|0|0|0|0^^$0|@$1|2|3|4|5|6|7|17|8|@$9|18|A|19|B|C]|$9|1A|A|1B|B|D]|$9|1C|A|1D|B|D]]|E|@]|F|$]]|$1|G|3|H|5|6|7|1E|8|@$9|1F|A|1G|B|D]|$9|1H|A|1I|B|D]|$9|1J|A|1K|B|D]|$9|1L|A|1M|B|D]|$9|1N|A|1O|B|D]]|E|@]|F|$]]|$1|I|3|J|5|K|7|1P|8|@]|E|@]|F|$L|M]]|$1|N|3|O|5|6|7|1Q|8|@$9|1R|A|1S|B|D]|$9|1T|A|1U|B|D]|$9|1V|A|1W|B|D]]|E|@$9|1X|A|1Y|1|1Z]]|F|$]]|$1|P|3|Q|5|K|7|20|8|@]|E|@]|F|$L|M]]|$1|R|3|S|5|6|7|21|8|@$9|22|A|23|B|D]|$9|24|A|25|B|D]]|E|@]|F|$]]|$1|T|3|U|5|K|7|26|8|@]|E|@]|F|$L|M]]|$1|V|3|W|5|6|7|27|8|@]|E|@]|F|$]]|$1|X|3|Y|5|K|7|28|8|@]|E|@]|F|$L|M]]|$1|Z|3|-4|5|6|7|29|8|@]|E|@]|F|$]]]|10|$11|$5|12|13|14|F|$15|16]]]]

the best way to debug is see the java command being fired and make sure that flume lib is included in the <code>CLASSPATH</code> (<code>-cp</code>), 

As in following command its looking for <code>/lib/*</code>, thats where the <code>flume-ng-*.jar</code> are, but its incorrect because there's nothing in <code>/lib</code>, in this line <code>-cp '/staging001/Flume/server/conf://lib/*:/lib/*'</code>. It has to be <code>${FLUME_HOME}/lib</code>.

<pre><code>usr/lib/jvm/java-1.8.0-ibm-1.8.0.3.20-1jpp.1.el7_2.x86_64/jre/bin/java -Xms100m -Xmx500m $'-Dcom.sun.management.jmxremote\r' \
-Dflume.monitoring.type=http \
-Dflume.monitoring.port=34545 \
-cp '/staging001/Flume/server/conf://lib/*:/lib/*' \
-Djava.library.path= org.apache.flume.node.Application \
-f /staging001/Flume/server/conf/flume.conf -n client
</code></pre>

So, if you look at the <code>flume-ng</code> <a href="https://github.com/apache/flume/blob/d9c9a7dd9a6889ecf6b9dc88fb8e02ccc1cd5167/bin/flume-ng#L343" rel="nofollow noreferrer">script</a>, 
There's <code>FLUME_CLASSPATH</code> setup, which if absent it is setup based on <code>FLUME_HOME</code>.

<pre><code># prepend $FLUME_HOME/lib jars to the specified classpath (if any)
if [ -n "${FLUME_CLASSPATH}" ] ; then
 FLUME_CLASSPATH="${FLUME_HOME}/lib/*:$FLUME_CLASSPATH"
else
 FLUME_CLASSPATH="${FLUME_HOME}/lib/*"
fi
</code></pre>

So make sure either of those environments is set. With <code>FLUME_HOME</code> set, (I'm using <code>systemd</code>)

<pre><code>Environment=FLUME_HOME=/staging001/Flume/server/
</code></pre>

Here's the working java exec.

<pre><code>/usr/lib/jvm/java-1.8.0-ibm-1.8.0.3.20-1jpp.1.el7_2.x86_64/jre/bin/java -Xms100m -Xmx500m \
$'-Dcom.sun.management.jmxremote\r' \
-Dflume.monitoring.type=http \
-Dflume.monitoring.port=34545 \
-cp '/staging001/Flume/server/conf:/staging001/Flume/server/lib/*:/lib/*' \
-Djava.library.path= org.apache.flume.node.Application \
-f /staging001/Flume/server/conf/flume.conf -n client
</code></pre>

I have built a hadoop cluster which 1 master-slave node and the other is slave. And now, I wanna build a flume to get all log of the cluster on master machine. However, when I try to install flume from tarball and I always get:
 Error: Could not find or load main class org.apache.flume.node.Application
So, please help me to find the answer, or the best way to install flume on my cluster.
many thanks!

Error: Could not find or load main class org.apache.flume.node.Application - Install flume on hadoop version 1.2.1

翻译质量差，导致语言生硬或混乱。

没有提供实际的解决方法或示例。

解答不清晰，无法理解或解决问题。

页面排版不美观，阅读体验差。

文章

问答

视频

教程

学习中心

腾讯云实验室

直播

竞赛

腾讯云代码分析专区

腾讯iOA零信任安全管理系统专区

腾讯云架构师技术同盟交流圈

腾讯云数据库专区

腾讯云智能顾问专区

腾讯云原生专区

腾讯混元专区

腾讯云TCE专区

腾讯云Lighthouse专区

腾讯云HAI专区

腾讯云Edgeone专区

腾讯云存储专区

腾讯云智能专区

腾讯轻联专区 

腾讯云开发专区

TAPD专区

腾讯轻量云游戏服专区

EdgeOne AI 安全实战专区

腾讯云最具价值专家

腾讯云架构师技术同盟

腾讯云创作之星

腾讯云开发者先锋

腾讯云代码助手

云原生构建

TAPD 敏捷项目管理

Cloud Studio

SDK中心

API中心

命令行工具

涵盖代码开发、场景应用、自动测试全流程，助你从零构建专属AI助手

一站式MCP教程库，解锁AI应用新玩法

聚焦“写作效率、视觉美观与运行性能”三方面进行全面升级，为您提供更高效、稳定的创作环境

社区富文本&Markdown编辑器全新改版上线，欢迎大家体验!

诚挚邀请您参与本次调研，分享您的真实使用感受与建议。您的反馈至关重要，感谢您的支持与参与！

社区新版编辑器体验调研

我已经构建了一个hadoop集群，其中一个是主从节点，另一个是从节点。现在，我想构建一个flume来获取主机上集群的所有日志。但是，当我尝试从tarball安装flume时，我总是得到:错误:无法找到或加载主类org.apache.flume.node.Application，因此，请帮助我找到答案，或者在我的集群上安装flume的最佳方法。非常感谢！

问错误:无法找到或加载主类org.apache.flume.node.Application -在hadoop1.2.1版上安装flume
EN

回答 7

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问错误:无法找到或加载主类org.apache.flume.node.Application -在hadoop1.2.1版上安装flumeEN

回答 7

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问错误:无法找到或加载主类org.apache.flume.node.Application -在hadoop1.2.1版上安装flume
EN