Hadoop Yarn集群 主节点的 data node没有启动成功
2016-01-17 14:47
696 查看
在启动hadoop集群的时候,jps发现主节点的data node没有启动。
首先查看log
gedit /usr/local/hadoop/logs/hadoop-tizen-datanode-samsung.log
如下:
capacity-scheduler/*.jar
STARTUP_MSG: build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r 15ecc87ccf4a0228f35af08fc56de536e6ce657a; compiled by 'jenkins' on 2015-06-29T06:04Z
STARTUP_MSG: java = 1.7.0_91
************************************************************/
2016-01-17 14:46:59,144 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: registered UNIX signal handlers for [TERM, HUP, INT]
2016-01-17 14:46:59,963 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-17 14:47:00,377 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Invalid dfs.datanode.data.dir /data/hadoop/storage/hdfs/data :
ExitCodeException exitCode=1: chmod: 更改"/data/hadoop/storage/hdfs/data" 的权限: 不允许的操作
at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
at org.apache.hadoop.util.Shell.run(Shell.java:456)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:815)
发现上面的权限问题,因此马上查看该文件的属性
$ ll /data/hadoop/storage/hdfs/data/
总用量 8
drwxrwxrwx 2 root root 4096 1月 17 11:17 ./
drwxrwxrwx 4 root root 4096 1月 17 11:17 ../
发现是777全属性,但是这里仍然报错,说明可能是用户的权限不够,因此执行chown操作
tizen@hp:~$ sudo chown tizen:root /data -R
tizen@hp:~$ ls /data/ -l
总用量 4
drwxrwxrwx 4 tizen root 4096 1月 17 11:17 hadoop
clear环境,format之后重启dfs
首先查看log
gedit /usr/local/hadoop/logs/hadoop-tizen-datanode-samsung.log
如下:
capacity-scheduler/*.jar
STARTUP_MSG: build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r 15ecc87ccf4a0228f35af08fc56de536e6ce657a; compiled by 'jenkins' on 2015-06-29T06:04Z
STARTUP_MSG: java = 1.7.0_91
************************************************************/
2016-01-17 14:46:59,144 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: registered UNIX signal handlers for [TERM, HUP, INT]
2016-01-17 14:46:59,963 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-17 14:47:00,377 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Invalid dfs.datanode.data.dir /data/hadoop/storage/hdfs/data :
ExitCodeException exitCode=1: chmod: 更改"/data/hadoop/storage/hdfs/data" 的权限: 不允许的操作
at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
at org.apache.hadoop.util.Shell.run(Shell.java:456)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:815)
发现上面的权限问题,因此马上查看该文件的属性
$ ll /data/hadoop/storage/hdfs/data/
总用量 8
drwxrwxrwx 2 root root 4096 1月 17 11:17 ./
drwxrwxrwx 4 root root 4096 1月 17 11:17 ../
发现是777全属性,但是这里仍然报错,说明可能是用户的权限不够,因此执行chown操作
tizen@hp:~$ sudo chown tizen:root /data -R
tizen@hp:~$ ls /data/ -l
总用量 4
drwxrwxrwx 4 tizen root 4096 1月 17 11:17 hadoop
clear环境,format之后重启dfs
相关文章推荐
- Node.js_Stream流
- node.js+express制作网页计算器
- Node.js_Buffer缓冲区
- hadoop Yarn 搭建集群时错误 主节点 NameNode 没有启动成功
- INODE校园网客户端一直停在验证成功那一步
- NodeJS实现阿里大鱼短信通知发送
- nodejs
- Leetcode之Reverse Nodes in k-Group (Hard)
- 237. Delete Node in a Linked List
- 在Ubuntu下安装nodejs4.x,并实现开机自动启动forever进程守护nodejs应用后台运行
- 学会看nodeJS报错
- node.js学习:利用express搭建简易网页计算器
- Architecture——the main Nodes of configuration for WCF
- node.js入门示例
- Node.js_Dns模块
- nodeJs-autoMerge
- nodeJs-autoBulid
- Hadoop集群中引入新DataNode节点
- 用Visual Studio Code写Node.j
- Node.js_Path模块