我正在使用Hue访问蜂巢服务。我创建了一个Hive表
create table tablename(colname type,.....)
row format delimited fields terminated by ',';我把数据上传得很完美,有30万条记录。但是,在执行如下查询时:
select count(*) from tablename;它正在创建MapReduce作业,此时我得到以下警告,即如何解决此警告。
警告:未执行Hadoop命令行选项解析。实现工具接口并使用ToolRunner执行应用程序来弥补这一点。
完整日志:
INFO : Number of reduce tasks determined at compile time: 1
INFO : In order to change the average load for a reducer (in bytes):
INFO : set hive.exec.reducers.bytes.per.reducer=<number>
INFO : In order to limit the maximum number of reducers:
INFO : set hive.exec.reducers.max=<number>
INFO : In order to set a constant number of reducers:
INFO : set mapreduce.job.reduces=<number>
WARN : Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
INFO : number of splits:1
INFO : Submitting tokens for job: job_1442315442114_0017
INFO : The url to track the job: http://dwiclmaster:8088/proxy/application_1442315442114_0017/
INFO : Starting Job = job_1442315442114_0017, Tracking URL = http://dwiclmaster:8088/proxy/application_1442315442114_0017/
INFO : Kill Command = /opt/cloudera/parcels/CDH-5.4.4-1.cdh5.4.4.p0.4/lib/hadoop/bin/hadoop job -kill job_1442315442114_0017
INFO : Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
INFO : 2015-09-15 18:29:06,910 Stage-1 map = 0%, reduce = 0%
INFO : 2015-09-15 18:29:15,257 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.65 sec
INFO : 2015-09-15 18:29:21,513 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 3.19 sec
INFO : MapReduce Total cumulative CPU time: 3 seconds 190 msec
INFO : Ended Job = job_1442315442114_0017发布于 2015-09-21 18:46:48
这只是来自MapReduce的警告,因为Hive提交的作业没有实现接口。这是可以安全地忽略的。
更多关于工具转轮的信息。
https://stackoverflow.com/questions/32587095
复制相似问题