首页
学习
活动
专区
圈层
工具
发布
社区首页 >问答首页 >Cloudera ToolRunner

Cloudera ToolRunner
EN

Stack Overflow用户
提问于 2015-09-15 13:14:28
回答 1查看 407关注 0票数 0

我正在使用Hue访问蜂巢服务。我创建了一个Hive表

代码语言:javascript
复制
create table tablename(colname type,.....) 
row format delimited fields terminated by ',';

我把数据上传得很完美,有30万条记录。但是,在执行如下查询时:

代码语言:javascript
复制
select count(*) from tablename;

它正在创建MapReduce作业,此时我得到以下警告,即如何解决此警告。

警告:未执行Hadoop命令行选项解析。实现工具接口并使用ToolRunner执行应用程序来弥补这一点。

完整日志:

代码语言:javascript
复制
INFO  : Number of reduce tasks determined at compile time: 1
INFO  : In order to change the average load for a reducer (in bytes):
INFO  :   set hive.exec.reducers.bytes.per.reducer=<number>
INFO  : In order to limit the maximum number of reducers:
INFO  :   set hive.exec.reducers.max=<number>
INFO  : In order to set a constant number of reducers:
INFO  :   set mapreduce.job.reduces=<number>
WARN  : Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
INFO  : number of splits:1
INFO  : Submitting tokens for job: job_1442315442114_0017
INFO  : The url to track the job: http://dwiclmaster:8088/proxy/application_1442315442114_0017/
INFO  : Starting Job = job_1442315442114_0017, Tracking URL = http://dwiclmaster:8088/proxy/application_1442315442114_0017/
INFO  : Kill Command = /opt/cloudera/parcels/CDH-5.4.4-1.cdh5.4.4.p0.4/lib/hadoop/bin/hadoop job  -kill job_1442315442114_0017
INFO  : Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
INFO  : 2015-09-15 18:29:06,910 Stage-1 map = 0%,  reduce = 0%
INFO  : 2015-09-15 18:29:15,257 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 1.65 sec
INFO  : 2015-09-15 18:29:21,513 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 3.19 sec
INFO  : MapReduce Total cumulative CPU time: 3 seconds 190 msec
INFO  : Ended Job = job_1442315442114_0017
EN

回答 1

Stack Overflow用户

发布于 2015-09-21 18:46:48

这只是来自MapReduce的警告,因为Hive提交的作业没有实现接口。这是可以安全地忽略的。

更多关于工具转轮的信息。

票数 0
EN
页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接:

https://stackoverflow.com/questions/32587095

复制
相关文章

相似问题

领券
问题归档专栏文章快讯文章归档关键词归档开发者手册归档开发者手册 Section 归档