Hadoop中Datanode警告server.common.Storage: Failed to add storage directory
2016-09-11 13:00
369 查看
【说明】本人是Linux和Hadoop新手,刚学不到几天,所以这样的处理方式仅适合于个人学习时使用!namenode日志hadoop-root-datanode-hadoop1.log中Warning信息为: WARN org.apache.hadoop.hdfs.server.common.Storage: Failed to add storage directory [DISK]file:/home/softwares/hadoop-2.7.3/data/tmp/dfs/data/java.io.IOException: Incompatible clusterIDs in /home/softwares/hadoop-2.7.3/data/tmp/dfs/data: namenode clusterID = CID-0e388183-d6d3-4aa2-9105-d71fb3399736; datanode clusterID = CID-679ad508-dd7d-4c2b-9dd1-05ebf03bca00【错误原因】目前没有再次去实验,可能与多次使用格式化命令有关:
bin/hdfs namenode -format
【解决方案】
删除datanode的存储目录,再重建目录格式化。
步骤:
(1)停止namenode:
sbin/stop-dfs.sh
(2)从错误信息:[DISK]file:/home/softwares/hadoop-2.7.3/data/tmp/dfs/data/中,
找到datanode目录:/hadoop-2.7.3/data/tmp/dfs/data
(3)直接删除/hadoop-2.7.3/中的data下的所有目录
(4)重新新建目录后,重新格式化HDFS:
bin/hdfs namenode -format
(5)重新启动HDFS
sbin/start-dfs.sh
以上步骤之后,使用jps命令,查看datanode是否启动成功。
【说明】本人是Linux和Hadoop新手,刚学不到几天,所以这样的处理方式仅适合于个人学习时使用!
相关文章推荐
- hadoop错误java.io.IOException Failed to replace a bad datanode on the existing pipeline due to no more good datanodes being available to try
- hadoop 启动的时候datanode报错 Problem connecting to server
- FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool <registe
- hadoop 启动的时候datanode报错 Problem connecting to server
- 【解决办法】Hadoop2.6.4 datanode 无法启动,错误:All specified directories are failed to load.
- org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool <registering> (storage id unknown) servi
- hadoop异常:hdfs.server.datanode.DataNode: Problem connecting to server: localhost/127.0.0.1:8020
- hadoop 启动的时候datanode报错 Problem connecting to server
- 【zookeeper】data/zookeeper_server.pid: No such file or directory FAILED TO WRITE PID 报错
- 启动hadoop报ERROR org.apache.hadoop.hdfs.server.namenode.FSImage: Failed to load image from FSImageFile
- hadoop 起步的时候datanode报错 Problem connecting to server---转
- Hadoop datanode 无法启动(All specified directories are failed to load.)
- HADOOP :WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: xxx/xxx
- hadoop错误java.io.IOException Failed to replace a bad datanode on the existing pipeline due to no more
- hadoop中master能够启动datanode,但是datanode无法连接namenode 报 17/11/16 03:49:13 WARN ipc.Client: Failed to conn
- bug宝典hadoop篇 org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool <
- Hadoop datanode 无法启动,报错:java.io.IOException: All specified directories are failed to load.
- hadoop 开始时间datanode一个错误 Problem connecting to server
- ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: Cannot lock storage /op
- Microsoft buys Zoomix to add data quality to SQL Server