测试集群模式安装实施Hadoop

测试集群模式安装实施Hadoop

1. 集群架构

在VMware中安装三台CentOS虚拟机server1，server2，server3，其中server1作为Hadoop集群的NomeNode和JobTracker，server2和server3作为DataNode和TaskTracker. 为简便将DNS、NFS也安装在server1之上。

2.安装DNS

使用yum安装bind
[root@server1
admin]# yum install
bind*

安装完成后检查，
[root@server1
admin]# rpm -qa |
grep '^bind'
bind-dyndb-ldap-1.1.0-0.9.b1.el6_3.1.x86_64
bind-chroot-9.8.2-0.10.rc1.el6_3.6.x86_64
bind-libs-9.8.2-0.10.rc1.el6_3.6.x86_64
bind-sdb-9.8.2-0.10.rc1.el6_3.6.x86_64
bind-utils-9.8.2-0.10.rc1.el6_3.6.x86_64
bind-devel-9.8.2-0.10.rc1.el6_3.6.x86_64
bind-9.8.2-0.10.rc1.el6_3.6.x86_64

安装已经齐全

修改配置文件
修改/etc/named.conf，将127.0.0.1,localhost 改成any
[root@server1 etc]# vim
named.conf

options {
listen-on
port 53 { any; };
listen-on-v6
port 53 { ::1; };
directory "/var/named";
dump-file "/var/named/data/cache_dump.db";
statistics-file
"/var/named/data/named_stats.txt";
memstatistics-file
"/var/named/data/named_mem_stats.txt";
allow-query { any;
};
recursion
yes;

dnssec-enable
yes;
dnssec-validation
yes;
dnssec-lookaside
auto;

bindkeys-file
"/etc/named.iscdlv.key";
managed-keys-directory
"/var/named/dynamic";
};

修改/etc/named.rfc1912.zones, 加入以下内容
zone "myhadoop.com" IN {
type
master;
file
"myhadoop.com.zone";
allow-update
{ none; };
};
zone "1.168.192.in-addr.arpa" IN {
type
master;
file
"1.168.192.in-addr.zone";
allow-update
{ none; };
};

在目录/var/named下创建文件myhadoop.com.zone、1.168.192.in-addr.zone

修改myhadoop.com.zone为

$TTL 86400
@ IN
SOA server1.myhadoop.com.
chizk.root.myhadoop.com. (
0 ;
serial (d.adams)
1D ;
refresh
1H ;
retry
1W ;
expire
3H
) ; minimum
@ IN
NS server1.myhadoop.com.
server1.myhadoop.com. IN
A 192.168.1.201
server2.myhadoop.com. IN
A 192.168.1.202
server3.myhadoop.com. IN
A 192.168.1.203

修改1.168.192.in-addr.zone为
$TTL 86400
@ IN
SOA server1.myhadoop.com.
chizk.root.myhadoop.com. (
0 ;
serial
1D ;
refresh
1H ;
retry
1W ;
expire
3H
) ;
minimum
@ IN
NS server1.myhadoop.com.
201 IN
PTR
server1.myhadoop.com.
202 IN
PTR
server2.myhadoop.com.
202 IN
PTR server3.myhadoop.com.
修改这两个文件的所有者

[root@server1 named]# chown root.named
myhadoop.com.zone
[root@server1 named]# chown root.named
1.168.192.in-addr.zone

在/etc/resolv.conf中添加以下配置
nameserver 192.168.1.201

用同样的方法修改server2、server3中的/etc/resolv.conf文件

启动DNS
[root@server1 named]# service named
start
Starting
named: [ OK ]

设置为开机自动启动
[root@server1 admin]# chkconfig named
on

测试DNS查询
[root@server1 admin]# nslookup
server1.myhadoop.com
Server: 192.168.1.201
Address: 192.168.1.201#53

Name: server1.myhadoop.com
Address: 192.168.1.201

[root@server1 admin]# nslookup
server2.myhadoop.com
Server: 192.168.1.201
Address: 192.168.1.201#53

Name: server2.myhadoop.com
Address: 192.168.1.202

[root@server1 admin]# nslookup
server3.myhadoop.com
Server: 192.168.1.201
Address: 192.168.1.201#53

Name: server3.myhadoop.com
Address: 192.168.1.203

查询成功，同时在server2，server3中测试，查询都成功

3.安装NFS

查看NFS和rpcbind包是否已安装

[root@server1 admin]# rpm -qa | grep
nfs
nfs4-acl-tools-0.3.3-5.el6.x86_64
nfs-utils-1.2.2-7.el6.x86_64
nfs-utils-lib-1.1.5-1.el6.x86_64
[root@server1 admin]# rpm -qa | grep
rpcbind
rpcbind-0.2.0-8.el6.x86_64

可见已经安装完全，若没有安装使用yum安装即可。

修改文件/etc/exports, 加入以下内容
/home/admin *(sync,rw)

启动NFS
[root@server1 admin]# service nfs
start
Starting NFS
services: [ OK ]
Starting NFS
quotas: [ OK ]
Starting NFS
daemon: [ OK ]
Starting NFS
mountd: [ OK ]

设置为开机自动启动
[root@server1 admin]# chkconfig nfs
on

启动rpcbind
[root@server1 admin]# service rpcbind
start
Starting
rpcbind: [ OK ]

设置为自动启动
[root@server1 admin]# chkconfig rpcbind
on

输出挂载点
[root@server1 admin]# showmount -e
localhost
Export list for localhost:
/home/admin *

修改/home/admin的权限，为方便设置为777
[root@server1 home]# chmod 777
/home/admin

在server2中挂载server1中的/home/admin

[root@server2 home]# mount
server1.myhadoop.com:/home/admin/ /home/admin_share/

测试访问
[root@server2 home]# cd admin_share/
[root@server2 admin_share]# cat test.txt
aaaa,111
bbbb,222
cccc,333
dddd,444
可见访问成功

修改server2的/etc/fstab 文件，设置自动挂载，在末尾添加如下行：
server1.myhadoop.com:/home/admin /home/admin_share nfs defaults
1 1

同理在server3中挂载server1的/home/admin，并测试

4. 共享密钥文件

为server1，server2，server3的admin用户各自生成登录密钥
[admin@server1 ~]$ ssh-keygen -t
rsa
Generating public/private rsa key pair.
Enter file in which to save the key
(/home/admin/.ssh/id_rsa):
/home/admin/.ssh/id_rsa already exists.
Overwrite (y/n)? y
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in
/home/admin/.ssh/id_rsa.
Your public key has been saved in
/home/admin/.ssh/id_rsa.pub.
The key fingerprint is:
46:56:64:8f:83:13:e0:f3:17:cb:b9:7d:d5:fc:9f:52
admin@server1
The key's randomart image is:
+--[ RSA 2048]----+
| ....+ |
| . =
o |
| o
= +
. |
| =
o
= ..|
| S
= +|
| .
.
o E.|
| .
. o .|
| o o|
| ...|
+-----------------+
[admin@server2 ~]$ ssh-keygen -t
rsa
[admin@server3 ~]$ ssh-keygen -t
rsa

在server1中将id_rsa.pub 复制为authorized_keys
[admin@server1 ~]$ cp .ssh/id_rsa.pub
.ssh/authorized_keys

在server2，server3中建立共享密钥到本地的软连接
[admin@server2 ~]$ ln -s
/home/admin_share/.ssh/authorized_keys ~/.ssh/authorized_keys
[admin@server3 ~]$ ln -s
/home/admin_share/.ssh/authorized_keys ~/.ssh/authorized_keys

将server2，server3的密钥分别追加到authorized_keys
[admin@server2 ~]$ cat .ssh/id_rsa.pub
>>
.ssh/authorized_keys
[admin@server3 ~]$ cat .ssh/id_rsa.pub
>>
.ssh/authorized_keys

测试配置
[admin@server1 ~]$ ssh
server1.myhadoop.com
The authenticity of host 'server1.myhadoop.com
(192.168.1.201)' can't be established.
RSA key fingerprint is
a9:f3:7f:55:56:3a:a7:d7:9e:23:1e:86:a5:eb:90:dc.
Are you sure you want to continue connecting (yes/no)?
yes
Warning: Permanently added
'server1.myhadoop.com,192.168.1.201' (RSA) to the list of known
hosts.
Last login: Sun Jan 27 10:02:12 2013 from
server1

同样方法测试其他机器，测试成功

5. 安装Hadoop
在server1上，hadoop中配置core-site.xml 为以下格式：

<?xml
version="1.0"?>
<?xml-stylesheet type="text/xsl"
href="configuration.xsl"?>

<!-- Put site-specific property overrides in
this file. -->

<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://server1.myhadoop.com:9000</value>
</property>
</configuration>

配置mapred-site.xml:

<?xml
version="1.0"?>
<?xml-stylesheet type="text/xsl"
href="configuration.xsl"?>

<!-- Put site-specific property overrides in
this file. -->

<configuration>
<property>
<name>mapred.job.tracker</name>
<value>server1.myhadoop.com:9001</value>
</property>
<property>
<name>mapred.job.tracker.map.tasks.maximum</name>
<value>50</value>
</property>
<property>
<name>mapred.job.tracker.reduce.tasks.maximum</name>
<value>50</value>
</property>
</configuration>

配置master为
server1.myhadoop.com

配置slaves为
server2.myhadoop.com
server3.myhadoop.com

建立文本文件serverlist.txt，里面包含所有需要分发Hadoop的机器域名，在这里为server2，server3，即内容为
[admin@server1 ~]$ cat serverlist.txt
server2.myhadoop.com
server3.myhadoop.com

生成Hadoop的Shell脚本
[admin@server1 ~]$ cat serverlist.txt |
awk '{print "scp -rp /home/admin/hadoop-0.20.2/
admin@"$1":/home/admin/"}' >
distributeHadoop.sh

内容如下
[admin@server1 ~]$ cat
./distributeHadoop.sh
scp -rp /home/admin/hadoop-0.20.2/
admin@server2.myhadoop.com:/home/admin/
scp -rp /home/admin/hadoop-0.20.2/
admin@server3.myhadoop.com:/home/admin/

运行脚本
[admin@server1
~]$ ./distributeHadoop.sh

检查server2 、server3，复制成功

格式化namenode
[admin@server1 logs]$ hadoop namenode
-format

启动Hadoop
[admin@server1
~]$ ./hadoop-0.20.2/bin/start-all.sh

starting namenode, logging to
/home/admin/hadoop-0.20.2/bin/../logs/hadoop-admin-namenode-server1.out
server2.myhadoop.com: starting datanode, logging to
/home/admin/hadoop-0.20.2/bin/../logs/hadoop-admin-datanode-server2.out
server3.myhadoop.com: starting datanode, logging to
/home/admin/hadoop-0.20.2/bin/../logs/hadoop-admin-datanode-server3.out
server1.myhadoop.com: starting secondarynamenode, logging
to
/home/admin/hadoop-0.20.2/bin/../logs/hadoop-admin-secondarynamenode-server1.out
starting jobtracker, logging to
/home/admin/hadoop-0.20.2/bin/../logs/hadoop-admin-jobtracker-server1.out
server2.myhadoop.com: starting tasktracker, logging to
/home/admin/hadoop-0.20.2/bin/../logs/hadoop-admin-tasktracker-server2.out
server3.myhadoop.com: starting tasktracker, logging to
/home/admin/hadoop-0.20.2/bin/../logs/hadoop-admin-tasktracker-server3.out

检查server1、server2、server3，启动成功
[admin@server1
logs]$ jps
6481 NameNode
6612 SecondaryNameNode
6681 JobTracker
6749 Jps

[admin@server2
logs]$ jps
14869 TaskTracker
14917 Jps
14795 DataNode

[admin@server3
logs]$ jps
16354 TaskTracker
16396 Jps
16280 DataNode