您的位置:首页 > 大数据 > Hadoop

Hbase+HDFS单机版配置

2013-09-23 10:49 267 查看


环境:
ubuntu 13.04 ,hadoop-1.2.1+hbase-0.94.11

ubuntu 的/etc/hosts的文档修改如下,避免某些域名被映射成,127.0.1.1。

127.0.0.1 localhost

127.0.0.1 shallon-ThinkPad-X230

127.0.0.1 ubuntu.ubuntu-domain ubuntu

1、hadoop的配置
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more core-site.xml

<?xml version="1.0"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>

<property>

<name>fs.default.name</name>

<value>hdfs://shallon-ThinkPad-X230:9000/hbase</value>

</property>

<property>

<name>hadoop.tmp.dir</name>

<value>/home/hadoop/hadoop-${user.name}</value>

<description>A base for other temporary directories.</description>

</property>

</configuration>

hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more masters

shallon-ThinkPad-X230

hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more slaves

shallon-ThinkPad-X230

hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more hdfs-site.xml

<?xml version="1.0"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>

<property>

<name>dfs.replication</name>

<value>1</value>

</property>

</configuration>

启动hadoop的文件HDFS:
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/bin$ ./start-dfs.sh

hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/bin$ jps

1493 NameNode

1780 DataNode

2226 SecondaryNameNode

尝试访问dfs。
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1$ bin/hadoop dfs -ls /

Found 3 items

drwxr-xr-x - hadoop supergroup 0 2013-09-22 22:05 /hbase

drwxr-xr-x - hadoop supergroup 0 2013-09-22 15:54 /home

drwxr-xr-x - hadoop supergroup 0 2013-08-30 15:18 /user

2、Hbase 配置
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/conf$ vi hbase-site.xml
<configuration>

<property>

<name>hbase.rootdir</name>

<value>hdfs://shallon-ThinkPad-X230:9000/hbase</value>

</property>

<property>

<name>hbase.cluster.distributed</name>

<value>true</value>

</property>

</configuration>

黑体部分与上面配置的HDFS根路径匹配。指向本地配置的HDFS

hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/bin$ ./start-hbase.sh

hadoop@localhost's password:

localhost: starting zookeeper, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-zookeeper-shallon-ThinkPad-X230.out

starting master, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-master-shallon-ThinkPad-X230.out

hadoop@shallon-thinkpad-x230's password:

shallon-ThinkPad-X230: starting regionserver, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-regionserver-shallon-ThinkPad-X230.out

查看HBase的启动进程

hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11$ jps

1493 NameNode

1780 DataNode

2226 SecondaryNameNode

20273 Jps

14163 HMaster

14081 HQuorumPeer

14655 HRegionServer


查看hbase的master的状态

http://localhost:60010/

Master: localhost:60000

Local logs, Thread Dump, Log
Level, Debug dump,

Attributes

Attribute NameValueDescription
HBase Version0.94.11, r1513697HBase version and revision
HBase CompiledWed Aug 14 04:54:46 UTC 2013, jenkinsWhen HBase version was compiled and by whom
Hadoop Version1.0.4, r1393290Hadoop version and revision
Hadoop CompiledThu Oct 4 20:40:32 UTC 2012, hortonfoWhen Hadoop version was compiled and by whom
HBase Root Directoryhdfs://shallon-ThinkPad-X230:9000/hbaseLocation of HBase home directory
Zookeeper Quorumlocalhost:2181Addresses of all registered ZK servers. For more, see zk dump.
HMaster Start TimeMon Sep 23 10:06:53 CST 2013Date stamp of when this HMaster was started
HMaster Active TimeMon Sep 23 10:06:53 CST 2013Date stamp of when this HMaster became active
Load average3Average number of regions per regionserver. Naive computation.
HBase Cluster ID4d409e24-108f-41bb-ad32-a49977445601Unique identifier generated for each HBase cluster
Coprocessors[]Coprocessors currently loaded loaded by the master

使用HBase的创建表和查询数据

hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/bin$ ./hbase shell

HBase Shell; enter 'help<RETURN>' for list of supported commands.

Type "exit<RETURN>" to leave the HBase Shell

Version 0.94.11, r1513697, Wed Aug 14 04:54:46 UTC 2013

hbase(main):003:0> create 'test', 'cf'
0 row(s) in 1.2200 seconds
hbase(main):003:0> list 'test'
..
1 row(s) in 0.0550 seconds
hbase(main):004:0> put 'test', 'row1', 'cf:a', 'value1'
0 row(s) in 0.0560 seconds
hbase(main):005:0> put 'test', 'row2', 'cf:b', 'value2'
0 row(s) in 0.0370 seconds
hbase(main):006:0> put 'test', 'row3', 'cf:c', 'value3'
0 row(s) in 0.0450 seconds


hbase(main):001:0> scan 'test'

ROW COLUMN+CELL

row1 column=cf:a, timestamp=1379858801692, value=value1

row2 column=cf:b, timestamp=1379858810975, value=value2

row3 column=cf:c, timestamp=1379858822233, value=value3

3 row(s) in 1.3100 seconds

查看HBase Root Directory的文件内容

http://localhost:50075/browseDirectory.jsp?dir=/&namenodeInfoPort=50070

Contents of directory
/hbase

Goto :

Go to parent directory

NameTypeSizeReplicationBlock SizeModification TimePermissionOwnerGroup
-ROOT-dir2013-09-22 22:02rwxr-xr-xhadoopsupergroup
.META.dir2013-09-22 16:32rwxr-xr-xhadoopsupergroup
.corruptdir2013-09-22 22:02rwxr-xr-xhadoopsupergroup
.logsdir2013-09-23 10:06rwxr-xr-xhadoopsupergroup
.oldlogsdir2013-09-23 10:07rwxr-xr-xhadoopsupergroup
.tmpdir2013-09-23 10:06rwxr-xr-xhadoopsupergroup
hbase.idfile0.04 KB364 MB2013-09-22 16:32rw-r--r--hadoopsupergroup
hbase.versionfile0 KB364 MB2013-09-22 16:32rw-r--r--hadoopsupergroup
testdir2013-09-22 22:05rwxr-xr-xhadoop
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: