您的位置:首页 > 运维架构

解决新手hadoop2.7.3在window10 提交工作至远程服务上失败的问题

2017-04-16 23:02 573 查看
错误1   Stack trace: ExitCodeException exitCode=1: /bin/bash: line 0: fg: no job control                 修改hadoop源码 在项目的当前路径的YARNRunner.java中                   390 行     将这行代码vargs.add(Environment.JAVA_HOME.$() + "/bin/java");         替换为 vargs.add("$JAVA_HOME/bin/java");                    增加方法                 private void replaceEnvironment(Map<String, String> environment) {                   String tmpClassPath = environment.get("CLASSPATH");                   tmpClassPath=tmpClassPath.replaceAll(";", ":");                   tmpClassPath=tmpClassPath.replaceAll("%PWD%", "\\$PWD");                   tmpClassPath=tmpClassPath.replaceAll("%HADOOP_MAPRED_HOME%", "\\$HADOOP_MAPRED_HOME");                   tmpClassPath= tmpClassPath.replaceAll("\\\\", "/" );                   environment.put("CLASSPATH",tmpClassPath);                 }                         在466行添加代码   replaceEnvironment(environment);错误二  用户权限检查问题在当前提交任务的机器上配置环境变量 HADOOP_USER_NAME = albert  //hdfs有权限的用户 groupadd supergroupusermod -a -G supergroup albert把这个用户添加到hdfs的超级用户组中错误三Error: Couldnot find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster在mapred-site.xml中增加如下陪配置
<property>
<name>mapreduce.application.classpath</name>
<value>
/opt/hadoop-2.6.0/etc/hadoop,
/opt/hadoop-2.6.0/share/hadoop/common/*,
/opt/hadoop-2.6.0/share/hadoop/common/lib/*,
/opt/hadoop-2.6.0/share/hadoop/hdfs/*,
/opt/hadoop-2.6.0/share/hadoop/hdfs/lib/*,
/opt/hadoop-2.6.0/share/hadoop/mapreduce/*,
/opt/hadoop-2.6.0/share/hadoop/mapreduce/lib/*,
/opt/hadoop-2.6.0/share/hadoop/yarn/*,
/opt/hadoop-2.6.0/share/hadoop/yarn/lib/*
</value>
</property>
<property>
<name>mapreduce.jobhistory.address</name>
<value>master:10020</value>
</property>
<property>
<name>mapreduce.jobhistory.webapp.address</name>
<value>master:19888</value>
</property>
修改yarn-site.xml
<property><name>yarn.application.classpath</name><value>/opt/hadoop-2.6.0/etc/hadoop,/opt/hadoop-2.6.0/share/hadoop/common/*,/opt/hadoop-2.6.0/share/hadoop/common/lib/*,/opt/hadoop-2.6.0/share/hadoop/hdfs/*,/opt/hadoop-2.6.0/share/hadoop/hdfs/lib/*,/opt/hadoop-2.6.0/share/hadoop/mapreduce/*,/opt/hadoop-2.6.0/share/hadoop/mapreduce/lib/*,/opt/hadoop-2.6.0/share/hadoop/yarn/*,/opt/hadoop-2.6.0/share/hadoop/yarn/lib/*</value></property>
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: 
相关文章推荐