MAC-Hadoop2.7未能执行目标org.apache.maven.plugins:maven-antrun-plugin:1.7

Question

我试图从源代码中安装Hadoop2.7.2，我得到了以下错误，我搜索了一下，但找不到任何解决方案。

请帮帮忙。

问候

Mac: 10.11.2 (64位)；Java: java版本"1.8.0_60"；protoc -version: libprotoc 2.5.0；maven3.3.9

命令: mvn包-Pdist，本机-DskipTests -Dtar -X

错误消息：

[INFO] Apache Hadoop MapReduce Examples ................... SUCCESS [  2.565 s]
[INFO] hadoop-mapreduce ................................... SUCCESS [  2.230 s]
[INFO] Apache Hadoop MapReduce Streaming .................. SUCCESS [  2.199 s]
[INFO] Apache Hadoop Distributed Copy ..................... SUCCESS [  4.951 s]
[INFO] Apache Hadoop Archives ............................. SUCCESS [  1.168 s]
[INFO] Apache Hadoop Rumen ................................ SUCCESS [  3.008 s]
[INFO] Apache Hadoop Gridmix .............................. SUCCESS [  1.990 s]
[INFO] Apache Hadoop Data Join ............................ SUCCESS [  1.228 s]
[INFO] Apache Hadoop Ant Tasks ............................ SUCCESS [  1.143 s]
[INFO] Apache Hadoop Extras ............................... SUCCESS [  1.574 s]
[INFO] Apache Hadoop Pipes ................................ FAILURE [  0.627 s]
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Azure support ........................ SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] --------------------------------------------------------------  ----------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 05:05 min
[INFO] Finished at: 2016-04-24T11:10:13+08:00
[INFO] Final Memory: 154M/1709M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-
 plugin:1.7:run (make) on project hadoop-pipes: An Ant BuildException
has occured: exec returned: 1
[ERROR] around Ant part ...<exec failonerror="true"
dir="/Users/wanwenqing/Hadoop/hadoop-2.7.2-src/hadoop-tools/hadoop-
pipes/target/native" executable="cmake">... @ 5:135 in 
/Users/wanwenqing/Hadoop/hadoop-2.7.2-src/hadoop-tools/hadoop-  
pipes/target/antrun/build-main.xml
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with
 the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debuglogging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions,  

我尝试过安装libssl-dev，但是brew安装找不到libssl-dev。

Answer 1

在macOS上编译Hadoop本机库时，我也遇到了这个问题。解决方案：

1. 打开发生错误的文件build-main.xml： vim /Users/wanwenqing/Hadoop/hadoop-2.7.2-src/hadoop-tools/hadoop- pipes/target/antrun/build-main.xml
2. 查找错误行并执行： cmake /Users/wanwenqing/Hadoop/hadoop-2.7.2-src/hadoop-tools/hadoop-pipes/src/ -DJVM_ARCH_DATA_MODEL = 64 然后，您将看到错误的具体原因： Could NOT find OpenSSL, try to set the path to OpenSSL root folder in the System variable OPENSSL_ROOT_DIR (missing: OPENSSL_INCLUDE_DIR), suggesting that not found openssl suggested that the need to add environment variables
3. 因此，添加以下系统变量： export OPENSSL_ROOT_DIR=/usr/local/Cellar/openssl/1.0.2k (注意这是openssl安装目录，我使用brew安装的openssl) export OPENSSL_INCLUDE_DIR=/usr/local/Cellar/openssl/1.0.2k/include 然后再次执行： cmake /Users/wanwenqing/Hadoop/hadoop-2.7.2-src/hadoop-tools/hadoop-pipes/src/ -DJVM_ARCH_DATA_MODEL = 6

如果没有错误，可以重新运行mvn编译器命令来构建hadoop本机lib。

参考资料：http://www.itdadao.com/articles/c15a1007838p0.html