ubuntu 14.04 install hadoop 3.0.0 alpha1
2016-09-12 20:42
288 查看
1.
Hadoop install web site: http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html
Follow the steps and it gets work. But for the Pseudo-Distributed mode, need following point 4.
2.
Hadoop download web site: http://www.apache.org/dyn/closer.cgi/hadoop/common/
3. Java install: sudo apt-get install oracle-java8-installer
Java 1.8 supports Hadoop 3.0.0 alpha1 (both run and build)
update Java alternatives:
sudo update-alternatives --config java
sudo update-alternatives --config javac
4. configure ssh to pdsh default connection ( or can't start namenode and datanode, it will report connection issue).
create file rcmd_default at /etc/pdsh
5.
Hadoop example build web site: http://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html
Follow the steps to build the code. JAVA 1.8 is good. OPENJDK 1.7 reports build warning and can't run the hadoop example.
6. run the built example, need add the package name of the class. Or the java will report can't find the class.
Hadoop install web site: http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html
Follow the steps and it gets work. But for the Pseudo-Distributed mode, need following point 4.
2.
Hadoop download web site: http://www.apache.org/dyn/closer.cgi/hadoop/common/
3. Java install: sudo apt-get install oracle-java8-installer
Java 1.8 supports Hadoop 3.0.0 alpha1 (both run and build)
update Java alternatives:
sudo update-alternatives --config java
sudo update-alternatives --config javac
4. configure ssh to pdsh default connection ( or can't start namenode and datanode, it will report connection issue).
create file rcmd_default at /etc/pdsh
5.
Hadoop example build web site: http://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html
Follow the steps to build the code. JAVA 1.8 is good. OPENJDK 1.7 reports build warning and can't run the hadoop example.
6. run the built example, need add the package name of the class. Or the java will report can't find the class.
相关文章推荐
- 详解HDFS Short Circuit Local Reads
- Hadoop_2.1.0 MapReduce序列图
- 使用Hadoop搭建现代电信企业架构
- 单机版搭建Hadoop环境图文教程详解
- hadoop常见错误以及处理方法详解
- hadoop 单机安装配置教程
- hadoop的hdfs文件操作实现上传文件到hdfs
- hadoop实现grep示例分享
- Apache Hadoop版本详解
- linux下搭建hadoop环境步骤分享
- hadoop client与datanode的通信协议分析
- hadoop中一些常用的命令介绍
- Hadoop单机版和全分布式(集群)安装
- 用PHP和Shell写Hadoop的MapReduce程序
- hadoop map-reduce中的文件并发操作
- Hadoop1.2中配置伪分布式的实例
- hadoop上传文件功能实例代码
- java结合HADOOP集群文件上传下载
- Hadoop 2.x伪分布式环境搭建详细步骤
- Java访问Hadoop分布式文件系统HDFS的配置说明