Hbase+HDFS单机版配置
2013-09-23 10:49
267 查看
环境:ubuntu 13.04 ,hadoop-1.2.1+hbase-0.94.11
ubuntu 的/etc/hosts的文档修改如下,避免某些域名被映射成,127.0.1.1。
127.0.0.1 localhost
127.0.0.1 shallon-ThinkPad-X230
127.0.0.1 ubuntu.ubuntu-domain ubuntu
1、hadoop的配置
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more core-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://shallon-ThinkPad-X230:9000/hbase</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/hadoop/hadoop-${user.name}</value>
<description>A base for other temporary directories.</description>
</property>
</configuration>
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more masters
shallon-ThinkPad-X230
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more slaves
shallon-ThinkPad-X230
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more hdfs-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
启动hadoop的文件HDFS:
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/bin$ ./start-dfs.sh
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/bin$ jps
1493 NameNode
1780 DataNode
2226 SecondaryNameNode
尝试访问dfs。
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1$ bin/hadoop dfs -ls /
Found 3 items
drwxr-xr-x - hadoop supergroup 0 2013-09-22 22:05 /hbase
drwxr-xr-x - hadoop supergroup 0 2013-09-22 15:54 /home
drwxr-xr-x - hadoop supergroup 0 2013-08-30 15:18 /user
2、Hbase 配置
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/conf$ vi hbase-site.xml
<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://shallon-ThinkPad-X230:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
</configuration>
黑体部分与上面配置的HDFS根路径匹配。指向本地配置的HDFS
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/bin$ ./start-hbase.sh
hadoop@localhost's password:
localhost: starting zookeeper, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-zookeeper-shallon-ThinkPad-X230.out
starting master, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-master-shallon-ThinkPad-X230.out
hadoop@shallon-thinkpad-x230's password:
shallon-ThinkPad-X230: starting regionserver, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-regionserver-shallon-ThinkPad-X230.out
查看HBase的启动进程
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11$ jps
1493 NameNode
1780 DataNode
2226 SecondaryNameNode
20273 Jps
14163 HMaster
14081 HQuorumPeer
14655 HRegionServer
查看hbase的master的状态
http://localhost:60010/
Master: localhost:60000
Local logs, Thread Dump, LogLevel, Debug dump,
Attributes
Attribute Name | Value | Description |
---|---|---|
HBase Version | 0.94.11, r1513697 | HBase version and revision |
HBase Compiled | Wed Aug 14 04:54:46 UTC 2013, jenkins | When HBase version was compiled and by whom |
Hadoop Version | 1.0.4, r1393290 | Hadoop version and revision |
Hadoop Compiled | Thu Oct 4 20:40:32 UTC 2012, hortonfo | When Hadoop version was compiled and by whom |
HBase Root Directory | hdfs://shallon-ThinkPad-X230:9000/hbase | Location of HBase home directory |
Zookeeper Quorum | localhost:2181 | Addresses of all registered ZK servers. For more, see zk dump. |
HMaster Start Time | Mon Sep 23 10:06:53 CST 2013 | Date stamp of when this HMaster was started |
HMaster Active Time | Mon Sep 23 10:06:53 CST 2013 | Date stamp of when this HMaster became active |
Load average | 3 | Average number of regions per regionserver. Naive computation. |
HBase Cluster ID | 4d409e24-108f-41bb-ad32-a49977445601 | Unique identifier generated for each HBase cluster |
Coprocessors | [] | Coprocessors currently loaded loaded by the master |
使用HBase的创建表和查询数据
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/bin$ ./hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.94.11, r1513697, Wed Aug 14 04:54:46 UTC 2013
hbase(main):003:0> create 'test', 'cf' 0 row(s) in 1.2200 seconds hbase(main):003:0> list 'test' .. 1 row(s) in 0.0550 seconds hbase(main):004:0> put 'test', 'row1', 'cf:a', 'value1' 0 row(s) in 0.0560 seconds hbase(main):005:0> put 'test', 'row2', 'cf:b', 'value2' 0 row(s) in 0.0370 seconds hbase(main):006:0> put 'test', 'row3', 'cf:c', 'value3' 0 row(s) in 0.0450 seconds
hbase(main):001:0> scan 'test'
ROW COLUMN+CELL
row1 column=cf:a, timestamp=1379858801692, value=value1
row2 column=cf:b, timestamp=1379858810975, value=value2
row3 column=cf:c, timestamp=1379858822233, value=value3
3 row(s) in 1.3100 seconds
查看HBase Root Directory的文件内容
http://localhost:50075/browseDirectory.jsp?dir=/&namenodeInfoPort=50070
Contents of directory
/hbase
Goto :Go to parent directory
Name | Type | Size | Replication | Block Size | Modification Time | Permission | Owner | Group |
-ROOT- | dir | 2013-09-22 22:02 | rwxr-xr-x | hadoop | supergroup | |||
.META. | dir | 2013-09-22 16:32 | rwxr-xr-x | hadoop | supergroup | |||
.corrupt | dir | 2013-09-22 22:02 | rwxr-xr-x | hadoop | supergroup | |||
.logs | dir | 2013-09-23 10:06 | rwxr-xr-x | hadoop | supergroup | |||
.oldlogs | dir | 2013-09-23 10:07 | rwxr-xr-x | hadoop | supergroup | |||
.tmp | dir | 2013-09-23 10:06 | rwxr-xr-x | hadoop | supergroup | |||
hbase.id | file | 0.04 KB | 3 | 64 MB | 2013-09-22 16:32 | rw-r--r-- | hadoop | supergroup |
hbase.version | file | 0 KB | 3 | 64 MB | 2013-09-22 16:32 | rw-r--r-- | hadoop | supergroup |
test | dir | 2013-09-22 22:05 | rwxr-xr-x | hadoop |
相关文章推荐
- HBase正确安装配置单机和分布式【独立zk_quoram和data在hdfs上】
- HBase有关HDFS配置的官方文档记录
- hadoop2.6与hbase1.1.2单机版安装配置
- 基于多个HDFS文件系统的HBASE配置
- drill 查询hbase和hdfs数据的相关配置以及查询方法
- HBase1.2.0 windows单机版安装配置
- 高可用Hdfs&HBase配置实践
- hbase安装配置
- hbase安装配置(整合到hadoop)
- HBase配置性能调优
- HDFS 的Trash回收站功能的配置、使用
- HBase 在HDFS 上的目录树
- HBase 默认配置
- flume将多列数据写入HBase的配置
- Hadoop 2、配置HDFS HA (高可用)
- Hadoop HBase 伪分布式安装 配置
- Hbase安装及配置
- Hadoop HBase 配置 安装 Snappy 终极教程
- hdfs安装和配置过程以及hadfs的工作原理(备忘)
- 配置Hbase Zookeeper 注意事项 配置hbase.zookeeper.quorum property.