tez上的蜂巢抛出java.lang.NoSuchMethodError

Question

我已经部署了tez并配置了hive来处理tez。

简单查询在还原器阶段失败。

它抛出此错误：

状态:运行(使用App id application_1469020577348_0014在纱线集群上执行)

顶点状态全部完成运行挂起失败终止

Map 1成功0 0 0

减速器2失效1 0 0 1 4 0

顶点: 01/02 >>-时间: 12.15秒

状态:失败顶点失败，attempt_1469020577348_0014_1_01_000000_0:java.lang.Exception: 2，vertexId=vertex_1469020577348_0014_1_01，diagnostics=[任务失败，taskId=task_1469020577348_0014_1_01_000000，diagnostics=[TaskAttempt 0失败，info=[错误:运行任务时出错(失败)：vertexName=Reducer java.util.concurrent.ExecutionException: java.lang.NoSuchMethodError: org.apache.hadoop.mapred.TaskID: method (Ljava/lang/String;ILorg/apache/hadoop/mapreduce/TaskType；( I)V未发现于org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:267) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61) at java.security.AccessController.doPrivileged(Native Method)在javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(在org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)，org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)，org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)，java.util.concurrent.FutureTask.run(FutureTask.java:262)，java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)，java.util.concurrent。ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745)由: java.util.concurrent.ExecutionException: java.lang.NoSuchMethodError: org.apache.hadoop.mapred.TaskID: method (Ljava/lang/String)引起；ILorg/apache/hadoop/mapreduce/TaskType;I)V未找到

Answer 1

这个问题是因为你的蜂巢已经用你正在使用的不同版本的tez编译了。

https://issues.apache.org/jira/browse/HIVE-14356