即使在MRv1上运行，sqoop也会尝试连接到yarn

Question

我有一个cloudera集群版本5.3.x，在运行sqoop客户端时使用以下命令

sqoop import --connect jdbc:mysql://HOST/myapplication --username myuser --direct -table=mytable -m 1 --hive-import --append --hive-table myapplication.tableimp --target-dir /user/hive/warehouse/myapplication/tableimp

它在下面的语句中循环。它似乎试图连接到yarn，即使我们的集群上只有MRv1。

INFO client.RMProxy: Connecting to ResourceManager at node/<ipaddress>:8032
INFO ipc.Client: Retrying connect to server: node/<ipaddress>:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
INFO ipc.Client: Retrying connect to server: node/<ipaddress>:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)

我尝试了下面的方法，这是在cloudera上的documented，但仍然没有变化。

alternatives --set sqoop2-tomcat-conf /etc/sqoop2/tomcat-conf.mr1

我可能应该提一下，我在该VM上的/etc/sqoop2位置没有看到tomcat-conf.mr1文件。

Answer 1

hadoop-conf指向纱线配置。使用下面的命令，将其更改为mapreduce配置，修复了它。

[root@node01 bin]# alternatives --config hadoop-conf

There are 4 programs which provide 'hadoop-conf'.

  Selection    Command

-----------------------------------------------

*+ 1           /etc/hadoop/conf.cloudera.yarn

   2           /etc/hadoop/conf.cloudera.hdfs

   3           /etc/hadoop/conf.cloudera.mapreduce

   4           /opt/cloudera/parcels/CDH-5.1.3-1.cdh5.1.3.p0.12/etc/hadoop/conf.empty


Enter to keep the current selection[+], or type selection number: 3