您的位置:首页 > 运维架构

windows搭建hadoop集群的一系列错误

2012-09-27 20:15 387 查看
1.最恶心我的错误

$ bin/hadoop jar hadoop-0.19.2-examples.jar wordcount in out

10/07/15 04:19:08 INFO mapred.FileInputFormat: Total input paths to process : 1

10/07/15 04:19:10 INFO mapred.JobClient: Running job: job_201007150342_0006

10/07/15 04:19:11 INFO mapred.JobClient: map 0% reduce 0%

10/07/15 04:19:33 INFO mapred.JobClient: Task Id : attempt_201007150342_0006_m_

00003_0, Status : FAILED

java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTrack

r/jobcache/job_201007150342_0006/attempt_201007150342_0006_m_000003_0/work/tmp

oes not exist.

at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSy

tem.java:420)

at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem

java:244)

at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:520

at org.apache.hadoop.mapred.Child.main(Child.java:143)

10/07/15 04:19:43 INFO mapred.JobClient: Task Id : attempt_201007150342_0006_m_

00003_1, Status : FAILED

java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTrack

r/jobcache/job_201007150342_0006/attempt_201007150342_0006_m_000003_1/work/tmp

oes not exist.

at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSy

tem.java:420)

at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem

java:244)

at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:520

at org.apache.hadoop.mapred.Child.main(Child.java:143)

10/07/15 04:19:52 INFO mapred.JobClient: Task Id : attempt_201007150342_0006_m_

00003_2, Status : FAILED

java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTrack

r/jobcache/job_201007150342_0006/attempt_201007150342_0006_m_000003_2/work/tmp

oes not exist.

解决办法:设置一下缓存就可以了
,在mapred-site.xml 修改

<property>

<name>mapred.child.tmp</name>

<value>/hadoop/run/temp</value>

</property>
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息