windows搭建hadoop集群的一系列错误
2012-09-27 20:15
387 查看
1.最恶心我的错误
$ bin/hadoop jar hadoop-0.19.2-examples.jar wordcount in out
10/07/15 04:19:08 INFO mapred.FileInputFormat: Total input paths to process : 1
10/07/15 04:19:10 INFO mapred.JobClient: Running job: job_201007150342_0006
10/07/15 04:19:11 INFO mapred.JobClient: map 0% reduce 0%
10/07/15 04:19:33 INFO mapred.JobClient: Task Id : attempt_201007150342_0006_m_
00003_0, Status : FAILED
java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTrack
r/jobcache/job_201007150342_0006/attempt_201007150342_0006_m_000003_0/work/tmp
oes not exist.
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSy
tem.java:420)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem
java:244)
at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:520
at org.apache.hadoop.mapred.Child.main(Child.java:143)
10/07/15 04:19:43 INFO mapred.JobClient: Task Id : attempt_201007150342_0006_m_
00003_1, Status : FAILED
java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTrack
r/jobcache/job_201007150342_0006/attempt_201007150342_0006_m_000003_1/work/tmp
oes not exist.
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSy
tem.java:420)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem
java:244)
at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:520
at org.apache.hadoop.mapred.Child.main(Child.java:143)
10/07/15 04:19:52 INFO mapred.JobClient: Task Id : attempt_201007150342_0006_m_
00003_2, Status : FAILED
java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTrack
r/jobcache/job_201007150342_0006/attempt_201007150342_0006_m_000003_2/work/tmp
oes not exist.
解决办法:设置一下缓存就可以了
,在mapred-site.xml 修改
<property>
<name>mapred.child.tmp</name>
<value>/hadoop/run/temp</value>
</property>
$ bin/hadoop jar hadoop-0.19.2-examples.jar wordcount in out
10/07/15 04:19:08 INFO mapred.FileInputFormat: Total input paths to process : 1
10/07/15 04:19:10 INFO mapred.JobClient: Running job: job_201007150342_0006
10/07/15 04:19:11 INFO mapred.JobClient: map 0% reduce 0%
10/07/15 04:19:33 INFO mapred.JobClient: Task Id : attempt_201007150342_0006_m_
00003_0, Status : FAILED
java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTrack
r/jobcache/job_201007150342_0006/attempt_201007150342_0006_m_000003_0/work/tmp
oes not exist.
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSy
tem.java:420)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem
java:244)
at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:520
at org.apache.hadoop.mapred.Child.main(Child.java:143)
10/07/15 04:19:43 INFO mapred.JobClient: Task Id : attempt_201007150342_0006_m_
00003_1, Status : FAILED
java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTrack
r/jobcache/job_201007150342_0006/attempt_201007150342_0006_m_000003_1/work/tmp
oes not exist.
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSy
tem.java:420)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem
java:244)
at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:520
at org.apache.hadoop.mapred.Child.main(Child.java:143)
10/07/15 04:19:52 INFO mapred.JobClient: Task Id : attempt_201007150342_0006_m_
00003_2, Status : FAILED
java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTrack
r/jobcache/job_201007150342_0006/attempt_201007150342_0006_m_000003_2/work/tmp
oes not exist.
解决办法:设置一下缓存就可以了
,在mapred-site.xml 修改
<property>
<name>mapred.child.tmp</name>
<value>/hadoop/run/temp</value>
</property>
相关文章推荐
- hadoop-HA集群搭建,启动DataNode,检测启动状态,执行HDFS命令,启动YARN,HDFS权限配置,C++客户端编程,常见错误
- hadoop集群搭建-Windows (hadoop cluster on Windows)
- windows eclipse hadoop 集群开发环境搭建(分布式模式)
- ubuntu14-Hadoop2.7.2完全分布式集群搭建操作时遇到的错误
- hadoop集群搭建的常见错误
- hadoop集群搭建的常见错误
- Hadoop-2.8.0集群搭建、hadoop源码编译和安装、host配置、ssh免密登录、hadoop配置文件中的参数配置参数总结、hadoop集群测试,安装过程中的常见错误
- 使用Docker在本地搭建Hadoop分布式集群 的错误总结(持续更新)
- 手动搭建搭建Hadoop虚拟机集群与windows远程开发环境
- hadoop Yarn 搭建集群时错误 主节点 NameNode 没有启动成功
- Hadoop集群搭建的常见错误
- Linux 搭建Hadoop集群错误锦集
- windows下搭建hadoop集群
- Windows 7平台利用Vmware Workstation 11虚拟机搭建Hadoop 2.7.4基于Ubuntu kylin 14.04集群环境
- Hadoop集群搭建之SSH无密码登录配置错误解析
- Windows下虚拟机搭建Hadoop集群
- windows下idea中搭建hadoop开发环境,向远程hadoop集群提交mapreduce任务
- windows下在eclipse上远程连接hadoop集群调试mapreduce错误记录
- hadoop多节点集群搭建过程中错误:No such file or directoryhdfs,logs提示出现出现^M的解决办法
- Windows上运行Eclipse使用virtualbox搭建的Ubuntu的hadoop集群服务