小功告成，在WIN7上配置上了HADOOP，终于可以一窥真容啦
2013-03-19 10:53
281 查看
主要参考文档：
/article/1920604.html
以后，慢慢熟悉具体操作吧。
sky@koala
/home/hadoop-0.20.2
$ cd conf
sky@koala
/home/hadoop-0.20.2/conf
$ dos2unix hadoop-env.sh
dos2unix: converting file hadoop-env.sh to Unix format ...
sky@koala
/home/hadoop-0.20.2/conf
$ cd ..
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop namenode -format
13/03/19 10:19:46 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = koala/192.168.7.9
STARTUP_MSG: args = [-format]
STARTUP_MSG: version = 0.20.2
STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
************************************************************/
13/03/19 10:19:47 INFO namenode.FSNamesystem: fsOwner=sky,Domain,Users,Administrators,Remote,Desktop,Users,Users,Remote,Desktop,Users,Administrators
13/03/19 10:19:47 INFO namenode.FSNamesystem: supergroup=supergroup
13/03/19 10:19:47 INFO namenode.FSNamesystem: isPermissionEnabled=true
13/03/19 10:19:47 INFO common.Storage: Image file of size 101 saved in 0 seconds.
13/03/19 10:19:47 INFO common.Storage: Storage directory \tmp\hadoop-Sky\dfs\name has been successfully formatted.
13/03/19 10:19:47 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at koala/192.168.X.X
************************************************************/
sky@koala
/home/hadoop-0.20.2
$ bin/start-all.sh
starting namenode, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-namenode-koala.out
localhost: starting datanode, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-datanode-koala.out
localhost: cygwin warning:
localhost: MS-DOS style path detected: C:\cygwin\home\hadoop-0.20.2\/build/native
localhost: Preferred POSIX equivalent is: /home/hadoop-0.20.2/build/native
localhost: CYGWIN environment variable option "nodosfilewarning" turns off this warning.
localhost: Consult the user's guide for more details about POSIX paths:
localhost: http://cygwin.com/cygwin-ug-net/using.html#using-pathnames
localhost: starting secondarynamenode, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-secondarynamenode-koala.out
localhost: log4j:ERROR setFile(null,true) call failed.
localhost: java.io.FileNotFoundException: C:\cygwin\home\hadoop-0.20.2\logs\hadoop-sky-secondarynamenode-koala.log (Access is denied)
localhost: at java.io.FileOutputStream.openAppend(Native Method)
localhost: at java.io.FileOutputStream.<init>(FileOutputStream.java:192)
localhost: at java.io.FileOutputStream.<init>(FileOutputStream.java:116)
localhost: at org.apache.log4j.FileAppender.setFile(FileAppender.java:290)
localhost: at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:164)
localhost: at org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:216)
localhost: at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:257)
localhost: at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:133)
starting jobtracker, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-jobtracker-koala.out
localhost: starting tasktracker, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-tasktracker-koala.out
localhost: log4j:ERROR setFile(null,true) call failed.
localhost: java.io.FileNotFoundException: C:\cygwin\home\hadoop-0.20.2\logs\hadoop-sky-tasktracker-koala.log (Access is denied)
localhost: at java.io.FileOutputStream.openAppend(Native Method)
localhost: at java.io.FileOutputStream.<init>(FileOutputStream.java:192)
localhost: at java.io.FileOutputStream.<init>(FileOutputStream.java:116)
localhost: at org.apache.log4j.FileAppender.setFile(FileAppender.java:290)
localhost: at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:164)
localhost: at org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:216)
localhost: at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:257)
localhost: at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:133)
sky@koala
/home/hadoop-0.20.2
$ jps
956 JobTracker
7344 NameNode
6912 Jps
sky@koala
/home/hadoop-0.20.2
$ ps
PID PPID PGID WINPID TTY UID STIME COMMAND
10252 1 12080 9788 ? 1001 10:22:03 /cygdrive/c/Java/jdk1.6.0_43/bin/java
10812 1 11428 956 pty0 1001 10:22:04 /cygdrive/c/Java/jdk1.6.0_43/bin/java
5344 10852 5344 10076 pty0 1001 10:22:28 /usr/bin/ps
10852 1824 10852 12052 pty0 1001 22:50:39 /usr/bin/bash
2032 1 9660 11484 ? 1001 10:22:01 /cygdrive/c/Java/jdk1.6.0_43/bin/java
1824 1 1824 1824 ? 1001 22:50:39 /usr/bin/mintty
7692 1 11428 7344 pty0 1001 10:21:59 /cygdrive/c/Java/jdk1.6.0_43/bin/java
5228 1 10496 8688 ? 1001 10:22:06 /cygdrive/c/Java/jdk1.6.0_43/bin/java
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop fs -mkdir In
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop fs -put *.txt In
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop fs -ls
Found 1 items
drwxr-xr-x - supergroup 0 2013-03-19 10:23 /user/In
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop fs -put *.pdf In
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop fs -ls /user/
Found 1 items
drwxr-xr-x - supergroup 0 2013-03-19 10:28 /user/In
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop fs -ls /user/In
Found 5 items
-rw-r--r-- 1 supergroup 348624 2013-03-19 10:23 /user/In/CHANGES.txt
-rw-r--r-- 1 supergroup 13366 2013-03-19 10:23 /user/In/LICENSE.txt
-rw-r--r-- 1 supergroup 101 2013-03-19 10:23 /user/In/NOTICE.txt
-rw-r--r-- 1 supergroup 38321433 2013-03-19 10:28 /user/In/ObjectLearn.pdf
-rw-r--r-- 1 supergroup 1366 2013-03-19 10:23 /user/In/README.txt
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop dfsadmin -report
Configured Capacity: 104752738304 (97.56 GB)
Present Capacity: 61319459840 (57.11 GB)
DFS Remaining: 61280444416 (57.07 GB)
DFS Used: 39015424 (37.21 MB)
DFS Used%: 0.06%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0
-------------------------------------------------
Datanodes available: 1 (1 total, 0 dead)
Name: 127.0.0.1:50010
Decommission Status : Normal
Configured Capacity: 104752738304 (97.56 GB)
DFS Used: 39015424 (37.21 MB)
Non DFS Used: 43433278464 (40.45 GB)
DFS Remaining: 61280444416(57.07 GB)
DFS Used%: 0.04%
DFS Remaining%: 58.5%
Last contact: Tue Mar 19 10:40:52 CST 2013
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop dfs -lsr /
sky@koala
/home/hadoop-0.20.2
$
/article/1920604.html
以后，慢慢熟悉具体操作吧。
sky@koala
/home/hadoop-0.20.2
$ cd conf
sky@koala
/home/hadoop-0.20.2/conf
$ dos2unix hadoop-env.sh
dos2unix: converting file hadoop-env.sh to Unix format ...
sky@koala
/home/hadoop-0.20.2/conf
$ cd ..
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop namenode -format
13/03/19 10:19:46 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = koala/192.168.7.9
STARTUP_MSG: args = [-format]
STARTUP_MSG: version = 0.20.2
STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
************************************************************/
13/03/19 10:19:47 INFO namenode.FSNamesystem: fsOwner=sky,Domain,Users,Administrators,Remote,Desktop,Users,Users,Remote,Desktop,Users,Administrators
13/03/19 10:19:47 INFO namenode.FSNamesystem: supergroup=supergroup
13/03/19 10:19:47 INFO namenode.FSNamesystem: isPermissionEnabled=true
13/03/19 10:19:47 INFO common.Storage: Image file of size 101 saved in 0 seconds.
13/03/19 10:19:47 INFO common.Storage: Storage directory \tmp\hadoop-Sky\dfs\name has been successfully formatted.
13/03/19 10:19:47 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at koala/192.168.X.X
************************************************************/
sky@koala
/home/hadoop-0.20.2
$ bin/start-all.sh
starting namenode, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-namenode-koala.out
localhost: starting datanode, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-datanode-koala.out
localhost: cygwin warning:
localhost: MS-DOS style path detected: C:\cygwin\home\hadoop-0.20.2\/build/native
localhost: Preferred POSIX equivalent is: /home/hadoop-0.20.2/build/native
localhost: CYGWIN environment variable option "nodosfilewarning" turns off this warning.
localhost: Consult the user's guide for more details about POSIX paths:
localhost: http://cygwin.com/cygwin-ug-net/using.html#using-pathnames
localhost: starting secondarynamenode, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-secondarynamenode-koala.out
localhost: log4j:ERROR setFile(null,true) call failed.
localhost: java.io.FileNotFoundException: C:\cygwin\home\hadoop-0.20.2\logs\hadoop-sky-secondarynamenode-koala.log (Access is denied)
localhost: at java.io.FileOutputStream.openAppend(Native Method)
localhost: at java.io.FileOutputStream.<init>(FileOutputStream.java:192)
localhost: at java.io.FileOutputStream.<init>(FileOutputStream.java:116)
localhost: at org.apache.log4j.FileAppender.setFile(FileAppender.java:290)
localhost: at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:164)
localhost: at org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:216)
localhost: at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:257)
localhost: at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:133)
starting jobtracker, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-jobtracker-koala.out
localhost: starting tasktracker, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-tasktracker-koala.out
localhost: log4j:ERROR setFile(null,true) call failed.
localhost: java.io.FileNotFoundException: C:\cygwin\home\hadoop-0.20.2\logs\hadoop-sky-tasktracker-koala.log (Access is denied)
localhost: at java.io.FileOutputStream.openAppend(Native Method)
localhost: at java.io.FileOutputStream.<init>(FileOutputStream.java:192)
localhost: at java.io.FileOutputStream.<init>(FileOutputStream.java:116)
localhost: at org.apache.log4j.FileAppender.setFile(FileAppender.java:290)
localhost: at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:164)
localhost: at org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:216)
localhost: at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:257)
localhost: at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:133)
sky@koala
/home/hadoop-0.20.2
$ jps
956 JobTracker
7344 NameNode
6912 Jps
sky@koala
/home/hadoop-0.20.2
$ ps
PID PPID PGID WINPID TTY UID STIME COMMAND
10252 1 12080 9788 ? 1001 10:22:03 /cygdrive/c/Java/jdk1.6.0_43/bin/java
10812 1 11428 956 pty0 1001 10:22:04 /cygdrive/c/Java/jdk1.6.0_43/bin/java
5344 10852 5344 10076 pty0 1001 10:22:28 /usr/bin/ps
10852 1824 10852 12052 pty0 1001 22:50:39 /usr/bin/bash
2032 1 9660 11484 ? 1001 10:22:01 /cygdrive/c/Java/jdk1.6.0_43/bin/java
1824 1 1824 1824 ? 1001 22:50:39 /usr/bin/mintty
7692 1 11428 7344 pty0 1001 10:21:59 /cygdrive/c/Java/jdk1.6.0_43/bin/java
5228 1 10496 8688 ? 1001 10:22:06 /cygdrive/c/Java/jdk1.6.0_43/bin/java
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop fs -mkdir In
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop fs -put *.txt In
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop fs -ls
Found 1 items
drwxr-xr-x - supergroup 0 2013-03-19 10:23 /user/In
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop fs -put *.pdf In
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop fs -ls /user/
Found 1 items
drwxr-xr-x - supergroup 0 2013-03-19 10:28 /user/In
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop fs -ls /user/In
Found 5 items
-rw-r--r-- 1 supergroup 348624 2013-03-19 10:23 /user/In/CHANGES.txt
-rw-r--r-- 1 supergroup 13366 2013-03-19 10:23 /user/In/LICENSE.txt
-rw-r--r-- 1 supergroup 101 2013-03-19 10:23 /user/In/NOTICE.txt
-rw-r--r-- 1 supergroup 38321433 2013-03-19 10:28 /user/In/ObjectLearn.pdf
-rw-r--r-- 1 supergroup 1366 2013-03-19 10:23 /user/In/README.txt
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop dfsadmin -report
Configured Capacity: 104752738304 (97.56 GB)
Present Capacity: 61319459840 (57.11 GB)
DFS Remaining: 61280444416 (57.07 GB)
DFS Used: 39015424 (37.21 MB)
DFS Used%: 0.06%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0
-------------------------------------------------
Datanodes available: 1 (1 total, 0 dead)
Name: 127.0.0.1:50010
Decommission Status : Normal
Configured Capacity: 104752738304 (97.56 GB)
DFS Used: 39015424 (37.21 MB)
Non DFS Used: 43433278464 (40.45 GB)
DFS Remaining: 61280444416(57.07 GB)
DFS Used%: 0.04%
DFS Remaining%: 58.5%
Last contact: Tue Mar 19 10:40:52 CST 2013
sky@koala
/home/hadoop-0.20.2
$ bin/hadoop dfs -lsr /
sky@koala
/home/hadoop-0.20.2
$
内容来自用户分享和网络整理，不保证内容的准确性，如有侵权内容，可联系管理员处理 
相关文章推荐
- 通过http 协议 可以访问 Hadoop 50070 端口，hadoop 里面配置的servlet 是什么容器呢 ？
- vdceye x64 版本终于可以往hadoop里面写视频数据了
- win7下 iis7 配置可以让局域网内其它用户访问
- win7（64位）平台下Cygwin+Eclipse搭建Hadoop单机开发环境 （一） Cygwin（64位）的安装 + ssh的配置
- win7中配置eclipse连接Ubuntu内的hadoop
- hadoop elcipse/intelliJ win7配置详解
- win7中配置eclipse连接Ubuntu内的hadoop
- Hadoop2.6.0在Win7下的配置
- Win7（64位）上编译、安装、配置、运行hadoop-Ver2.5.2---单机版配置运行
- hadoop入门级配置笔记（v1.2.1,win7 64位系统）
- win7使用伪分布模式配置Hadoop2.2
- Win7 自定义路径配置路径 cygwin部署hadoop
- 在win7中配置eclipse连接Ubuntu内的hadoop
- 1、JAVA-SE环境配置及测试 -- 终于开始学习Java了，希望可以坚持下去。
- 解决root用户ssh配置无密码登陆/hadoop用户照仿可以实现相同功能:hadoop用户登录并且把命令的所有root换成home/hadoop
- Win7_64下Eclipse配置Hadoop2.6.3
- Spark1.6.0 Hadoop2.6.0 单机win7下配置（Intellij IDEA）
- Anaconda3.4.2配置pyspark环境，win7无hadoop
- 在win7下配置 hadoop开发环境