hadoop2.2 搭建QJM模式HA遇阻,求助贴
2013-11-15 11:37
507 查看
NameNode:10.10.141.14(hostname:hadoop-active)
10.10.141.44(hostname:hadoop-standby)
journalnode:10.10.141.14(hostname:hadoop-active)
10.10.141.44(hostname:hadoop-standby)
10.10.141.22(hostname:hadoop-JN)
NN、Zookeeper、DFSZKFC启动成功
两个NN均为Standby状态
日志如下:
hadoop-hadoop-journalnode-hadoop-active.log:
************************************************************/
hadoop-hadoop-namenode-hadoop-standby.log:
如果需要配置信息 或其他详细信息 欢迎留言交流
—————————————————————————————————————————————————————————————————————————————
问题已经解决 NN格式化不彻底的原因
10.10.141.44(hostname:hadoop-standby)
journalnode:10.10.141.14(hostname:hadoop-active)
10.10.141.44(hostname:hadoop-standby)
10.10.141.22(hostname:hadoop-JN)
NN、Zookeeper、DFSZKFC启动成功
两个NN均为Standby状态
日志如下:
hadoop-hadoop-journalnode-hadoop-active.log:
************************************************************/
2013-11-15 10:26:39,154 INFO org.apache.hadoop.hdfs.qjournal.server.JournalNode: registered UNIX signal handlers for [TERM, HUP, INT] 2013-11-15 10:26:39,333 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 2013-11-15 10:26:39,394 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 2013-11-15 10:26:39,394 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: JournalNode metrics system started 2013-11-15 10:26:39,563 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2013-11-15 10:26:39,682 INFO org.apache.hadoop.hdfs.qjournal.server.JournalNodeHttpServer: Starting web server as: null 2013-11-15 10:26:39,704 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2013-11-15 10:26:39,742 INFO org.apache.hadoop.http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter) 2013-11-15 10:26:39,744 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context journal 2013-11-15 10:26:39,745 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2013-11-15 10:26:39,745 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2013-11-15 10:26:39,753 INFO org.apache.hadoop.http.HttpServer: HttpServer.start() threw a non Bind IOException java.net.BindException: Port in use: 0.0.0.0:8480 at org.apache.hadoop.http.HttpServer.openListener(HttpServer.java:742) at org.apache.hadoop.http.HttpServer.start(HttpServer.java:686) at org.apache.hadoop.hdfs.qjournal.server.JournalNodeHttpServer.start(JournalNodeHttpServer.java:86) at org.apache.hadoop.hdfs.qjournal.server.JournalNode.start(JournalNode.java:138) at org.apache.hadoop.hdfs.qjournal.server.JournalNode.run(JournalNode.java:114) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) at org.apache.hadoop.hdfs.qjournal.server.JournalNode.main(JournalNode.java:273) Caused by: java.net.BindException: Address already in use at sun.nio.ch.Net.bind(Native Method) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:126) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216) at org.apache.hadoop.http.HttpServer.openListener(HttpServer.java:738) ... 7 more 2013-11-15 10:26:39,756 INFO org.apache.hadoop.hdfs.qjournal.server.JournalNode: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down JournalNode at hadoop-active/10.10.141.14 ************************************************************/
hadoop-hadoop-namenode-hadoop-standby.log:
2013-11-15 11:29:53,560 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:hadoop (auth:SIMPLE) cause:org.apache.hadoop.ipc.StandbyException: Operation category JOURNAL is not supported in state standby 2013-11-15 11:29:53,560 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 53310, call org.apache.hadoop.hdfs.server.protocol.NamenodeProtocol.rollEditLog from 10.10.141.14:35622 Call#8 Retry#0: error: org.apache.hadoop.ipc.StandbyException: Operation category JOURNAL is not supported in state standby 2013-11-15 11:29:55,072 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Triggering log roll on remote NameNode hadoop-active/10.10.141.14:53310 2013-11-15 11:29:55,086 WARN org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Unable to trigger a roll of the active NN org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category JOURNAL is not supported in state standby at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:87) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1496) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1030) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.rollEditLog(FSNamesystem.java:5042) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.rollEditLog(NameNodeRpcServer.java:832) at org.apache.hadoop.hdfs.protocolPB.NamenodeProtocolServerSideTranslatorPB.rollEditLog(NamenodeProtocolServerSideTranslatorPB.java:139) at org.apache.hadoop.hdfs.protocol.proto.NamenodeProtocolProtos$NamenodeProtocolService$2.callBlockingMethod(NamenodeProtocolProtos.java:11214) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2048) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2044) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2042) at org.apache.hadoop.ipc.Client.call(Client.java:1347) at org.apache.hadoop.ipc.Client.call(Client.java:1300) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206) at $Proxy10.rollEditLog(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.NamenodeProtocolTranslatorPB.rollEditLog(NamenodeProtocolTranslatorPB.java:139) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.triggerActiveLogRoll(EditLogTailer.java:268) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.access$600(EditLogTailer.java:61) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:310) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:279) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:296) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:456) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:292)
如果需要配置信息 或其他详细信息 欢迎留言交流
—————————————————————————————————————————————————————————————————————————————
问题已经解决 NN格式化不彻底的原因
相关文章推荐
- 攻城狮在路上(陆)-- hadoop分布式环境搭建(HA模式)
- hadoop2.2+HA 集群搭建
- HA 模式下的 Hadoop2.7.4+ZooKeeper3.4.10搭建
- HADOOP集群搭建实战(HA高可靠性模式)
- Hadoop HDFS通过QJM实现高可用HA环境搭建
- hadoop namenode 高可用(HA)搭建指南 QJM方式
- Hadoop HA+Federation 高可用联邦模式搭建指南
- 搭建hadoop伪分布模式(hadoop2.2)
- 第二章:hadoop2+HA+Zookeeper QJM集群搭建实验
- Hadoop HA高可用集群模式搭建指南
- HadoopHA集群搭建
- Ubuntu上搭建Hadoop环境(单机模式+伪分布模式)
- 7台机器的hadoop2.4.1高可用(HA)集群搭建
- Apache Hadoop 2.8 完全分布式集群搭建超详细过程,实现NameNode HA、ResourceManager HA高可靠性
- 独立模式、伪分布模式、hbase和hadoop HA(高可用)完全分布式模式。集成配置
- 虚拟机搭建Hadoop集群(1) ---nat模式
- 第九章 搭建Hadoop 2.2.0版本HDFS的HA配置
- Hadoop2.5+HA+zk3.4.6集群搭建
- 【Hadoop2.7.0、Zookeeper3.4.6、JDK1.7】搭建完全分布式的hadoop,HA部署安装,自动备援
- hadoop-HA搭建