hive在执行任务的时候提示java.io.FileNotFoundException: File does not exist: hdfs://Master:9000/usr/local/apach
2016-04-27 18:33
447 查看
1、错误信息
2、进行的操作
在hdfs的上创建如下目录:
4、但是还不知道问题个根本原因,为啥子呢?
Number of reduce tasks determined at compile time: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer=<number> In order to limit the maximum number of reducers: set hive.exec.reducers.max=<number> In order to set a constant number of reducers: set mapreduce.job.reduces=<number> java.io.FileNotFoundException: File does not exist: hdfs://Master:9000/usr/local/apache-hive-1.2.1-bin/lib at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1072) at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1064) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1064) at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:288) at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:224) at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestamps(ClientDistributedCacheManager.java:99) at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestampsAndCacheVisibilities(ClientDistributedCacheManager.java:57) at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:265) at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:301) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:389) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282) at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:562) at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:557) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:557) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:548) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:431) at org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:137) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:75) Job Submission failed with exception 'java.io.FileNotFoundException(File does not exist: hdfs://Master:9000/usr/local/apache-hive-1.2.1-bin/lib)' FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
2、进行的操作
在hdfs的上创建如下目录:
hdfs://Master:9000/usr/local/apache-hive-1.2.1-bin/lib3、问题解决
4、但是还不知道问题个根本原因,为啥子呢?
相关文章推荐
- java--集合框架的Hashset和Treeset
- SpringMVC 接收ajax发送的数组对象
- Java实现快速排序递归和非递归
- java概述
- Java小实例内存分析
- springmvc(四) Action中业务控制方法多种形式
- JAVA——生产者与消费者以及JDK1.5以后新特性
- Spring MVC @ModelAttribute
- 正则表达式知识详解之多行模式 (java版示例)
- Unable to load configuration--struts-default.xml:40:72
- Java对象深复制、浅复制
- 【排序算法】简单选择排序(java实现)
- java的自动装箱和自动拆箱
- java中接口与抽象类的区别
- java的native方法
- Java 设计模式-原型模式
- Spring 注释 @Autowired 和@Resource 的区别
- spring3 mvc controller映射date类型
- Java单例模式的实现
- 快速搭建SpringMVC4.0