HBase -运行start-hbase.sh时出现完全分布式HBase错误

Question

我正在尝试在完全分布式模式下配置HBase。(使用Ubuntu12.04，Apache Hadoop2.2(在伪模式下运行，HBase版本0.98)下面是我的bashrc设置：

export HBASE_HOME=/usr/local/hbase
export PATH=$PATH:$HBASE_HOME/bin
export PATH=$PATH:$HBASE_HOME/sbin
export HADOOP_HOME=$HADOOP_HOME:$HBASE_HOME/conf

下面是我的/etc/host

192.168.72.12 namenode
192.168.72.12 master
192.168.72.12 regionserver1

hbase-site.xml是

<name>hbase.rootdir</name>
<value>hdfs://namenode:8020/hbase</value>
</property>
<property>
<name>hbase.defaults.for.version.skip</name>
<value>true</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.master</name>
<value>192.168.72.128:60000</value>
</property>

在HBase-env.sh中设置JAVA_HOME也是HBase_Manages_ZK = true

文件区域hbase/conf中的服务器包含

regionserver1

当hadoop集群正在运行，并且当我编写命令start-hbase.sh时，我得到以下错误。

localhost: starting zookeeper, logging to /usr/local/hbase/bin/../logs/hbase-hduser-zookeeper-ubuntu.out
starting master, logging to /usr/local/hbase/logs/hbase-hduser-master-ubuntu.out
localhost: starting regionserver, logging to /usr/local/hbase/bin/../logs/hbase-hduser-regionserver-ubuntu.out
regionserver1: ssh: Could not resolve hostname regionserver1: Name or service not known
#: ssh: Could not resolve hostname #: Name or service not known

我的ssh服务也在运行。请帮我找到解决方案。提前谢谢。

编辑：(新增regionserver日志文件快照

2014-12-13 18:49:12,080 INFO  [regionserver60020-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2014-12-13 18:49:12,081 WARN  [regionserver60020-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2014-12-13 18:49:13,183 INFO  [regionserver60020-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2014-12-13 18:49:13,184 WARN  [regionserver60020-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2014-12-13 18:49:14,114 INFO  [regionserver60020] ipc.RpcServer: Stopping server on 60020
2014-12-13 18:49:14,132 FATAL [regionserver60020] regionserver.HRegionServer: ABORTING region server ubuntu,60020,1418476720081: Initialization of RS failed.  Hence aborting RS.
java.io.IOException: Received the shutdown message while waiting.
    at org.apache.hadoop.hbase.regionserver.HRegionServer.blockAndCheckIfStopped(HRegionServer.java:776)
    at org.apache.hadoop.hbase.regionserver.HRegionServer.initializeZooKeeper(HRegionServer.java:725)
    at org.apache.hadoop.hbase.regionserver.HRegionServer.preRegistrationInitialization(HRegionServer.java:697)
    at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:830)
    at java.lang.Thread.run(Thread.java:744)
2014-12-13 18:49:14,133 FATAL [regionserver60020] regionserver.HRegionServer: RegionServer abort: loaded coprocessors are: []
2014-12-13 18:49:14,133 INFO  [regionserver60020] regionserver.HRegionServer: STOPPED: Initialization of RS failed.  Hence aborting RS.
2014-12-13 18:49:14,152 INFO  [regionserver60020] ipc.RpcServer: Stopping server on 60020
2014-12-13 18:49:14,154 INFO  [regionserver60020] regionserver.HRegionServer: Stopping infoServer
2014-12-13 18:49:14,188 INFO  [regionserver60020] mortbay.log: Stopped SelectChannelConnector@0.0.0.0:60030
2014-12-13 18:49:14,203 ERROR [main] regionserver.HRegionServerCommandLine: Region server exiting
java.lang.RuntimeException: HRegionServer Aborted
    at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:66)
    at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:85)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
    at org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2383)
2014-12-13 18:49:14,215 INFO  [Thread-9] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@61bdbb58
2014-12-13 18:49:14,220 INFO  [Thread-9] regionserver.HRegionServer: STOPPED: Shutdown hook
2014-12-13 18:49:14,224 INFO  [Thread-9] regionserver.ShutdownHook: Starting fs shutdown hook thread.
2014-12-13 18:49:14,229 INFO  [Thread-9] regionserver.ShutdownHook: Shutdown hook finished.

Answer 1

尝试使用Cloudera CDH5和Express Manager发行版。它是免费的，并且节省了很多时间。它完全支持Ubuntu/Debian系统。

我发现分布式集群的ZooKeeper/HDFS/HBase配置非常棘手。例如，您必须通过按正确的顺序重新启动服务来重新启动集群。例如，开始顺序如下：ZooKeeper > HDFS/YARN > HBase。

这里是我的成功故事：我不仅尝试使用HBase，而且还尝试使用Impala、Spark、Ozzie、Hive和Hue来准备环境。此外，在我的例子中，HBase必须使用不属于CHD5的Phoenix模块。我已经成功地使用了单节点集群，手动创建。但是我在集群配置中迷失了方向...我一直在使用xmls、主机名等等。

在我决定花一些时间学习Cloudera的发行版后，我已经安装了CM5包，它们是Cloudera Manager (即CM5)。接下来，我已经启动了web界面，并通过web界面安装了所有需要的deb包(是的，它安装了全套包，如果你不需要它们，这是很大的开销)。就是这样！它是快速和自信的。

接下来是配置。所有这些都是通过web界面实现的。你只需要选择集群中涉及的主机，然后选择你需要的服务，例如HBase等等。分配角色后，Cloudera Manager将启动集群。完成了。这就是全部。

该软件还收集了良好的最佳实践，如监控，配置版本控制，提示和技巧，软件更新等。更重要的是，它允许您非常快速地获得工作群集，之后您可以继续研究如何优化安装过程。

祝好运!

Answer 2

除了在/etc/hosts中添加主机名条目之外，还需要在/etc/hostname中添加条目。

将条目添加到/etc/hostname，然后尝试是否可以ping通regionserver1