配置hbase主节点HMaster启动不起来
2013-02-01 11:33
218 查看
转自:http://www.01yun.com/other_question/20121214/10692.html
配置hbase,主节点HMaster启动不起来。
具体状况是开机以后 HMaster启动了一下。然后就down掉了。然后再也启动不起来。关闭hbase时候。子节点只能关闭zookeeper守护进程,不能关闭存储进程。
日志文件如下(节选部分):错误没有在网上找到过,求指导。pipe坏了该怎么弄啊。
2012-04-11 02:32:57,914 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server Responder: starting
2012-04-11 02:32:57,917 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server listener on 60000: starting
2012-04-11 02:32:58,099 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 0 on 60000: starting
2012-04-11 02:32:58,101 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 1 on 60000: starting
2012-04-11 02:32:58,101 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 2 on 60000: starting
2012-04-11 02:32:58,101 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 3 on 60000: starting
2012-04-11 02:32:58,101 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 4 on 60000: starting
2012-04-11 02:32:58,101 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 60000: starting
2012-04-11 02:32:58,101 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 6 on 60000: starting
2012-04-11 02:32:58,102 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 7 on 60000: starting
2012-04-11 02:32:58,102 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 8 on 60000: starting
2012-04-11 02:32:58,104 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 9 on 60000: starting
2012-04-11 02:32:58,653 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=Master, sessionId=ubuntu,60000,1334136776012
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: revision
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsUser
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsDate
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsUrl
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: date
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsRevision
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: user
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsVersion
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: url
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: version
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: new MBeanInfo
2012-04-11 02:32:59,038 INFO org.apache.hadoop.hbase.metrics: new MBeanInfo
2012-04-11 02:32:59,038 INFO org.apache.hadoop.hbase.master.metrics.MasterMetrics: Initialized
2012-04-11 02:32:59,195 INFO org.apache.hadoop.hbase.master.ActiveMasterManager: Deleting ZNode for /hbase/backup-masters/ubuntu,60000,1334136776012 from backup master directory
2012-04-11 02:32:59,266 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Node /hbase/backup-masters/ubuntu,60000,1334136776012 already deleted, and this is not a retry
2012-04-11 02:32:59,266 INFO org.apache.hadoop.hbase.master.ActiveMasterManager: Master=ubuntu,60000,1334136776012
2012-04-11 02:32:59,877 FATAL org.apache.hadoop.hbase.master.HMaster: Unhandled exception. Starting shutdown.
java.io.IOException: Call to Ubuntu-chaiying0/192.168.17.133:9000 failed on local exception: java.io.IOException: Broken pipe
at org.apache.hadoop.ipc.Client.wrapException(Client.java:1103)
at org.apache.hadoop.ipc.Client.call(Client.java:1071)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
at $Proxy10.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:119)
at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:238)
at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:203)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
at org.apache.hadoop.hbase.util.FSUtils.getRootDir(FSUtils.java:482)
at org.apache.hadoop.hbase.master.MasterFileSystem.(MasterFileSystem.java:94)
at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:458)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:336)
at java.lang.Thread.run(Thread.java:679)
Caused by: java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcher.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:122)
at sun.nio.ch.IOUtil.write(IOUtil.java:93)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:352)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:55)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:146)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:107)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.DataOutputStream.flush(DataOutputStream.java:123)
at org.apache.hadoop.ipc.Client$Connection.sendParam(Client.java:779)
at org.apache.hadoop.ipc.Client.call(Client.java:1047)
... 18 more
2012-04-11 02:32:59,898 INFO org.apache.hadoop.hbase.master.HMaster: Aborting
2012-04-11 02:32:59,898 DEBUG org.apache.hadoop.hbase.master.HMaster: Stopping service threads
2012-04-11 02:32:59,898 INFO org.apache.hadoop.ipc.HBaseServer: Stopping server on 60000
2012-04-11 02:32:59,898 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 0 on 60000: exiting
2012-04-11 02:32:59,898 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 1 on 60000: exiting
2012-04-11 02:32:59,898 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 2 on 60000: exiting
2012-04-11 02:32:59,899 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 3 on 60000: exiting
2012-04-11 02:32:59,899 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 4 on 60000: exiting
2012-04-11 02:32:59,899 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 60000: exiting
2012-04-11 02:32:59,899 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 6 on 60000: exiting
2012-04-11 02:32:59,899 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 7 on 60000: exiting
2012-04-11 02:32:59,899 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 8 on 60000: exiting
2012-04-11 02:32:59,899 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 9 on 60000: exiting
2012-04-11 02:32:59,900 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server listener on 60000
2012-04-11 02:32:59,904 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server Responder
2012-04-11 02:32:59,904 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server Responder
2012-04-11 02:33:00,034 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down
2012-04-11 02:33:00,035 INFO org.apache.zookeeper.ZooKeeper: Session: 0x136a0bf9ffc0000 closed
2012-04-11 02:33:00,035 INFO org.apache.hadoop.hbase.master.HMaster: HMaster main thread exiting
2012-04-11 02:33:00,035 ERROR org.apache.hadoop.hbase.master.HMasterCommandLine: Failed to start master
java.lang.RuntimeException: HMaster Aborted
http://www.01yun.com/other_question/20121214/10692.html
at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:152)
at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:103)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:76)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1637)
http://www.01yun.com/other_question/20121214/10691.html
配置hbase,主节点HMaster启动不起来。
具体状况是开机以后 HMaster启动了一下。然后就down掉了。然后再也启动不起来。关闭hbase时候。子节点只能关闭zookeeper守护进程,不能关闭存储进程。
日志文件如下(节选部分):错误没有在网上找到过,求指导。pipe坏了该怎么弄啊。
2012-04-11 02:32:57,914 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server Responder: starting
2012-04-11 02:32:57,917 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server listener on 60000: starting
2012-04-11 02:32:58,099 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 0 on 60000: starting
2012-04-11 02:32:58,101 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 1 on 60000: starting
2012-04-11 02:32:58,101 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 2 on 60000: starting
2012-04-11 02:32:58,101 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 3 on 60000: starting
2012-04-11 02:32:58,101 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 4 on 60000: starting
2012-04-11 02:32:58,101 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 60000: starting
2012-04-11 02:32:58,101 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 6 on 60000: starting
2012-04-11 02:32:58,102 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 7 on 60000: starting
2012-04-11 02:32:58,102 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 8 on 60000: starting
2012-04-11 02:32:58,104 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 9 on 60000: starting
2012-04-11 02:32:58,653 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=Master, sessionId=ubuntu,60000,1334136776012
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: revision
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsUser
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsDate
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsUrl
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: date
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsRevision
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: user
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsVersion
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: url
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: MetricsString added: version
2012-04-11 02:32:59,037 INFO org.apache.hadoop.hbase.metrics: new MBeanInfo
2012-04-11 02:32:59,038 INFO org.apache.hadoop.hbase.metrics: new MBeanInfo
2012-04-11 02:32:59,038 INFO org.apache.hadoop.hbase.master.metrics.MasterMetrics: Initialized
2012-04-11 02:32:59,195 INFO org.apache.hadoop.hbase.master.ActiveMasterManager: Deleting ZNode for /hbase/backup-masters/ubuntu,60000,1334136776012 from backup master directory
2012-04-11 02:32:59,266 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Node /hbase/backup-masters/ubuntu,60000,1334136776012 already deleted, and this is not a retry
2012-04-11 02:32:59,266 INFO org.apache.hadoop.hbase.master.ActiveMasterManager: Master=ubuntu,60000,1334136776012
2012-04-11 02:32:59,877 FATAL org.apache.hadoop.hbase.master.HMaster: Unhandled exception. Starting shutdown.
java.io.IOException: Call to Ubuntu-chaiying0/192.168.17.133:9000 failed on local exception: java.io.IOException: Broken pipe
at org.apache.hadoop.ipc.Client.wrapException(Client.java:1103)
at org.apache.hadoop.ipc.Client.call(Client.java:1071)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
at $Proxy10.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:119)
at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:238)
at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:203)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
at org.apache.hadoop.hbase.util.FSUtils.getRootDir(FSUtils.java:482)
at org.apache.hadoop.hbase.master.MasterFileSystem.(MasterFileSystem.java:94)
at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:458)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:336)
at java.lang.Thread.run(Thread.java:679)
Caused by: java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcher.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:122)
at sun.nio.ch.IOUtil.write(IOUtil.java:93)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:352)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:55)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:146)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:107)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.DataOutputStream.flush(DataOutputStream.java:123)
at org.apache.hadoop.ipc.Client$Connection.sendParam(Client.java:779)
at org.apache.hadoop.ipc.Client.call(Client.java:1047)
... 18 more
2012-04-11 02:32:59,898 INFO org.apache.hadoop.hbase.master.HMaster: Aborting
2012-04-11 02:32:59,898 DEBUG org.apache.hadoop.hbase.master.HMaster: Stopping service threads
2012-04-11 02:32:59,898 INFO org.apache.hadoop.ipc.HBaseServer: Stopping server on 60000
2012-04-11 02:32:59,898 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 0 on 60000: exiting
2012-04-11 02:32:59,898 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 1 on 60000: exiting
2012-04-11 02:32:59,898 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 2 on 60000: exiting
2012-04-11 02:32:59,899 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 3 on 60000: exiting
2012-04-11 02:32:59,899 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 4 on 60000: exiting
2012-04-11 02:32:59,899 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 60000: exiting
2012-04-11 02:32:59,899 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 6 on 60000: exiting
2012-04-11 02:32:59,899 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 7 on 60000: exiting
2012-04-11 02:32:59,899 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 8 on 60000: exiting
2012-04-11 02:32:59,899 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 9 on 60000: exiting
2012-04-11 02:32:59,900 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server listener on 60000
2012-04-11 02:32:59,904 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server Responder
2012-04-11 02:32:59,904 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server Responder
2012-04-11 02:33:00,034 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down
2012-04-11 02:33:00,035 INFO org.apache.zookeeper.ZooKeeper: Session: 0x136a0bf9ffc0000 closed
2012-04-11 02:33:00,035 INFO org.apache.hadoop.hbase.master.HMaster: HMaster main thread exiting
2012-04-11 02:33:00,035 ERROR org.apache.hadoop.hbase.master.HMasterCommandLine: Failed to start master
java.lang.RuntimeException: HMaster Aborted
http://www.01yun.com/other_question/20121214/10692.html
at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:152)
at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:103)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:76)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1637)
http://www.01yun.com/other_question/20121214/10691.html
相关文章推荐
- tomcat启动不起来的配置
- eclipse启动不起来,eclipse.ini配置问题(支持大内存64bit问题)
- 修改Linux配置文件到导致Linux启动不起来(boot has failed sleeping forever)的解决步骤
- Linux下安装并(单节点)配置启动Kafka
- solr7.2.1+Mysql+jetty单节点启动配置说明
- hadoop集群单独启动死亡节点/hadoop重启不起来
- datenode节点超时时间设置,Hadoop启动不正常,HDFS冗余数据块的自动删除,NameNode安全模式问题,ntp时间服务同步,机架感知配置
- 有一个节点上的zookeeper启动不起来
- 在控制台强行删除节点后 配置目录仍存在 导致Dmgr、NodeAgent无法启动
- Apache Ignite 入门(2) 节点启动时的配置
- eclipse启动不起来,eclipse.ini配置问题(支持大内存64bit问题)
- jenkins中通过JNLP启动slave节点的配置问题
- 启动Hbase后Hmaster节点挂掉的几个原因
- 未配置默认网关导致RAC数据库VIP启动失败,节点重启
- 把AppFuse配置启动起来的步骤
- Hbase 安装配置时HMaster启动后宕机的解决方法
- hbase环境搭建,启动之后HMaster挂掉,或者是集群里,只启动了HMaster节点,HRegionServer节点没有启动的问题
- Hbase启动后,在主节点只有Hmaster,而在slave节点上没有Hregionserver
- Mybatis分页配置,jar配比 myeclipse 配置mybatis分页插件启动不起来且不报错 和 超时之后会报java heap space
- VMware ESX4的HA配置问题----有节点不能启动HA