Hbase安装_完全分布式安装

[hadoop@master conf]$ vim hbase-site.xml

<configuration>

<property>

<name>hbase.rootdir</name>

<value>hdfs://master:9000/hbase</value>

</property>

<property>

<name>hbase.cluster.distributed</name>

<value>true</value>

</property>

<property>

<name>hbase.zookeeper.quorum</name>

<value>slave1,slave2</value>

</property>

<property>

<name>hbase.zookeeper.property.dataDir</name>

<value>/home/hadoop/tmp/zookeeper</value>

</property>

</configuration>

[hadoop@master conf]$ vim regionservers

slave1

slave2

将hbase拷贝到slave1 和slave2

[hadoop@master ~]$ scp -r hbase-0.94.16-security slave1:~

[hadoop@master ~]$ scp -r hbase-0.94.16-security slave2:~

到slave1机器

[hadoop@slave1 ~]$ ln -s hbase-0.94.16-security/ hbase

[hadoop@slave1 ~]$

到slave2机器

[hadoop@slave2 ~]$ ln -s hbase-0.94.16-security/ hbase

到master机器

[hadoop@master ~]$ scp .bashrc slave1:~

.bashrc 100% 350 0.3KB/s 00:00

[hadoop@master ~]$ scp .bashrc slave2:~

.bashrc 100% 350 0.3KB/s 00:00

[hadoop@master ~]$

到两个slave执行

[hadoop@slave1 ~]$ . .bashrc

[hadoop@slave2 ~]$ . .bashrc

配置完毕，启动hbase

[hadoop@master ~]$ start-hbase.sh

slave1: starting zookeeper, logging to /home/hadoop/hbase/logs/hbase-hadoop-zookeeper-slave1.out

slave2: starting zookeeper, logging to /home/hadoop/hbase/logs/hbase-hadoop-zookeeper-slave2.out

starting master, logging to /home/hadoop/hbase/logs/hbase-hadoop-master-master.out

slave1: starting regionserver, logging to /home/hadoop/hbase/logs/hbase-hadoop-regionserver-slave1.out

slave2: starting regionserver, logging to /home/hadoop/hbase/logs/hbase-hadoop-regionserver-slave2.out

[hadoop@master ~]$ jps

7528 Jps

5946 NameNode

7385 HMaster

6189 JobTracker

6108 SecondaryNameNode

在slave1

[hadoop@slave1 ~]$ jps

5485 Jps

5317 HRegionServer

5229 HQuorumPeer

4000 TaskTracker

3916 DataNode

[hadoop@slave1 ~]$

错误原因

如果启动hbase集群出现regionserver无法启动，日志报告如下类似错误时，说明是集群的时间不同步，只需要同步即可解决。

FATAL org.apache.hadoop.hbase.regionserver.HRegionServer: ABORTING region server 10.210.78.22,60020,1344329095415: Unhandled exceptio

n: org.apache.hadoop.hbase.ClockOutOfSyncException: Server 10.210.78.22,60020,1344329095415 has been rejected; Reported time is too far out of sync with mast

er. Time difference of 90358ms > max allowed of 30000ms

org.apache.hadoop.hbase.ClockOutOfSyncException: org.apache.hadoop.hbase.ClockOutOfSyncException: Server 10.210.78.22,60020,1344329095415 has been rejected;

Reported time is too far out of sync with master. Time difference of 90358ms > max allowed of 30000ms

......

Caused by: org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hbase.ClockOutOfSyncException: Server 10.210.78.22,60020,1344329095415 has been rejected;

Reported time is too far out of sync with master. Time difference of 90358ms > max allowed of 30000ms

Linux 修改日期时间

date -s "2008-08-08 12:00:00"

修改完后,记得执行clock -w，把系统时间写入CMOS

hadoop@master ~]$ hbase shell

HBase Shell; enter 'help<RETURN>' for list of supported commands.

Type "exit<RETURN>" to leave the HBase Shell

Version 0.94.16, r1557241, Fri Jan 10 20:10:24 UTC 2014

hbase(main):001:0> status

2 servers, 0 dead, 1.0000 average load

hbase(main):002:0> status 'detailed'

version 0.94.16

0 regionsInTransition

master coprocessors: []

2 live servers

slave1:60020 1414092860979

requestsPerSecond=0, numberOfOnlineRegions=1, usedHeapMB=33, maxHeapMB=48

-ROOT-,,0

numberOfStores=1, numberOfStorefiles=1, storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0, storefileIndexSizeMB=0, readRequestsCount=33, writeRequestsCount=1, rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN

slave2:60020 1414092857315

requestsPerSecond=0, numberOfOnlineRegions=1, usedHeapMB=30, maxHeapMB=48

.META.,,1

numberOfStores=1, numberOfStorefiles=0, storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0, storefileIndexSizeMB=0, readRequestsCount=0, writeRequestsCount=0, rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN

0 dead servers

Web监控页面
http://192.168.1.222:60010
创建表

hbase(main):004:0> create 'mmm','a','b';

hbase(main):005:0* list

0 row(s) in 1.2720 seconds

TABLE

mmm

1 row(s) in 0.0220 seconds

hbase(main):007:0> describe 'mmm'

DESCRIPTION ENABLED

'mmm', {NAME => 'a', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => ' true

NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'NO

NE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS =>

'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_DISK

=> 'true', BLOCKCACHE => 'true'}, {NAME => 'b', DATA_BLOCK_ENCODING

=> 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSION

S => '3', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '214748

3647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMOR

Y => 'false', ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true'}

1 row(s) in 0.1310 seconds

如果这里创建表后使用list出现卡机，重启hadoop和hbase

如果还是不行，则

增加conf/hdfs-site.xml里面的xceivers参数，至少要有4096

<property>

<name>dfs.datanode.max.xcievers</name>

<value>4096</value>

</property>

继续重启

在hbase-site.xml添加配置
<property>
<name>hbase.master.maxclockskew</name>
<value>180000</value>
<description>Time difference of regionserver from master</description>
</property>