【原】Centos6.5下cdh4.6 hive安装部署
2014-05-09 09:20
447 查看
1、前提条件:
只需要选择一台服务器即可,这里选择安装在namenode上;安装用户为cloud-user
2、安装包:
sudo yum install -y hive hive-metastore hive-server2
3、安装mysql:
sudo yum install -y mysql-server
sudo service mysqld start
sudo yum install -y mysql-connector-java
sudo ln -s /usr/share/java/mysql-connector-java.jar /usr/lib/hive/lib/mysql-connector-java.jar
sudo /usr/bin/mysql_secure_installation (YYNYY)
创建数据库:
mysql -u root -p
[align=left] Enter password:[/align]
[align=left] mysql> CREATE DATABASE metastore;[/align]
[align=left] mysql> USE metastore;[/align]
[align=left] mysql> SOURCE /usr/lib/hive/scripts/metastore/upgrade/mysql/hive-schema-0.10.0.mysql.sql;[/align]
[align=left] [/align]
[align=left] mysql> CREATE USER 'hive'@'10.0.0.2' IDENTIFIED BY 'mypassword';[/align]
[align=left] mysql> REVOKE ALL PRIVILEGES, GRANT OPTION FROM 'hive'@'10.0.0.2';[/align]
[align=left] mysql> GRANT SELECT,INSERT,UPDATE,DELETE,LOCK TABLES,EXECUTE ON metastore.* TO 'hive'@'10.0.0.2';[/align]
[align=left] mysql> FLUSH PRIVILEGES;[/align]
[align=left] mysql> quit;[/align]
4、配置hive-site.xml:
5、配置yarn:
export HADOOP_MAPRED_HOME=/usr/lib/hadoop-mapreduce
6、配置hdfs目录:
sudo -u hdfs hadoop fs -chmod 777 /user
[align=left] sudo -u hdfs hadoop fs -mkdir /user/history[/align]
[align=left] sudo -u hdfs hadoop fs -chmod -R 1777 /user/history[/align]
[align=left] sudo -u hdfs hadoop fs -chown mapred:hadoop /user/history[/align]
[align=left] sudo -u hdfs hadoop fs -mkdir /var/log/hadoop-yarn[/align]
[align=left] sudo -u hdfs hadoop fs -chown yarn:mapred /var/log/hadoop-yarn[/align]
sudo -u hdfs hadoop fs -mkdir /tmp
[align=left] sudo -u hdfs hadoop fs -chmod -R 1777 /tmp[/align]
sudo -u hdfs hadoop fs -mkdir /user/hive
sudo -u hdfs hadoop fs -mkdir /user/hive/warehouse
sudo -u hdfs hadoop fs -chown -R hive /user/hive
sudo -u hdfs hadoop fs -chmod -R 1777 /user/hive/warehouse
sudo -u hdfs hadoop fs -mkdir /tmp/hadoop-mapred
sudo -u hdfs hadoop fs -mkdir /tmp/hive-hive
sudo -u hdfs hadoop fs -chmod -R 777 /tmp/hadoop-mapred
sudo -u hdfs hadoop fs -chmod -R 777 /tmp/hive-hive
sudo chown -R hive:hive /var/lib/hive/.hivehistory
sudo -u hdfs hadoop fs -mkdir /user/cloud-user
[align=left] sudo -u hdfs hadoop fs -chown cloud-user:cloud-user /user/cloud-user[/align]
[align=left] [/align]
[align=left]7、服务启动:[/align]
[align=left] sudo service hive-metastore start[/align]
[align=left] sudo service hive-server2 start[/align]
[align=left] [/align]
[align=left]8、测试:[/align]
[align=left] sudo /usr/lib/hive/bin/beeline[/align]
[align=left]beeline> !connect jdbc:hive2://10.0.0.2:10001 hive mypassword org.apache.hive.jdbc.HiveDriver[/align]
[align=left]0: jdbc:hive2://10.0.0.2:10001> SHOW TABLES;[/align]
[align=left]show tables;[/align]
[align=left]+-----------+[/align]
[align=left]| tab_name |[/align]
[align=left]+-----------+[/align]
[align=left]+-----------+[/align]
[align=left]No rows selected (0.238 seconds)[/align]
[align=left]0: jdbc:hive2://10.0.0.2:10001>!quit[/align]
只需要选择一台服务器即可,这里选择安装在namenode上;安装用户为cloud-user
2、安装包:
sudo yum install -y hive hive-metastore hive-server2
3、安装mysql:
sudo yum install -y mysql-server
sudo service mysqld start
sudo yum install -y mysql-connector-java
sudo ln -s /usr/share/java/mysql-connector-java.jar /usr/lib/hive/lib/mysql-connector-java.jar
sudo /usr/bin/mysql_secure_installation (YYNYY)
创建数据库:
mysql -u root -p
[align=left] Enter password:[/align]
[align=left] mysql> CREATE DATABASE metastore;[/align]
[align=left] mysql> USE metastore;[/align]
[align=left] mysql> SOURCE /usr/lib/hive/scripts/metastore/upgrade/mysql/hive-schema-0.10.0.mysql.sql;[/align]
[align=left] [/align]
[align=left] mysql> CREATE USER 'hive'@'10.0.0.2' IDENTIFIED BY 'mypassword';[/align]
[align=left] mysql> REVOKE ALL PRIVILEGES, GRANT OPTION FROM 'hive'@'10.0.0.2';[/align]
[align=left] mysql> GRANT SELECT,INSERT,UPDATE,DELETE,LOCK TABLES,EXECUTE ON metastore.* TO 'hive'@'10.0.0.2';[/align]
[align=left] mysql> FLUSH PRIVILEGES;[/align]
[align=left] mysql> quit;[/align]
4、配置hive-site.xml:
<property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://10.0.0.2/metastore</value> <description>JDBC connect string for a JDBC metastore</description> </property> <property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value> <description>Driver class name for a JDBC metastore</description> </property> <property> <name>javax.jdo.option.ConnectionUserName</name> <value>hive</value> </property> <property> <name>javax.jdo.option.ConnectionPassword</name> <value>mypassword</value> </property> <property> <name>datanucleus.autoCreateSchema</name> <value>false</value> </property> <property> <name>datanucleus.fixedDatastore</name> <value>true</value> </property> <property> <name>datanucleus.autoStartMechanism</name> <value>SchemaTable</value> </property> <property> <name>hive.metastore.uris</name> <value>thrift://10.0.0.2:9083</value> <description>IP address (or fully-qualified domain name) and port of the metastore host</description> </property> <property> <name>hive.support.concurrency</name> <description>Enable Hive's Table Lock Manager Service</description> <value>true</value> </property> <property> <name>hive.zookeeper.quorum</name> <description>Zookeeper quorum used by Hive's Table Lock Manager</description> <value>10.0.0.4,10.0.0.6,10.0.0.11</value> </property> <property> <name>hive.zookeeper.client.port</name> <value>2181</value> <description>The port at which the clients will connect.</description> </property> <property> <name>hive.server2.thrift.port</name> <value>10001</value> <description>TCP port number to listen on, default 10000</description> </property> <property> <name>hive.aux.jars.path</name> 59 <value>file:////usr/lib/hbase/hbase.jar,file:///usr/lib/hive/lib/zookeeper.jar,file:///usr/lib/hive/lib/hive-hbase-handler-0.10.0-cdh4.6.0.jar,file:///usr/lib/hive/lib/guava-11.0.2.jar</value> 60 </property>
5、配置yarn:
export HADOOP_MAPRED_HOME=/usr/lib/hadoop-mapreduce
6、配置hdfs目录:
sudo -u hdfs hadoop fs -chmod 777 /user
[align=left] sudo -u hdfs hadoop fs -mkdir /user/history[/align]
[align=left] sudo -u hdfs hadoop fs -chmod -R 1777 /user/history[/align]
[align=left] sudo -u hdfs hadoop fs -chown mapred:hadoop /user/history[/align]
[align=left] sudo -u hdfs hadoop fs -mkdir /var/log/hadoop-yarn[/align]
[align=left] sudo -u hdfs hadoop fs -chown yarn:mapred /var/log/hadoop-yarn[/align]
sudo -u hdfs hadoop fs -mkdir /tmp
[align=left] sudo -u hdfs hadoop fs -chmod -R 1777 /tmp[/align]
sudo -u hdfs hadoop fs -mkdir /user/hive
sudo -u hdfs hadoop fs -mkdir /user/hive/warehouse
sudo -u hdfs hadoop fs -chown -R hive /user/hive
sudo -u hdfs hadoop fs -chmod -R 1777 /user/hive/warehouse
sudo -u hdfs hadoop fs -mkdir /tmp/hadoop-mapred
sudo -u hdfs hadoop fs -mkdir /tmp/hive-hive
sudo -u hdfs hadoop fs -chmod -R 777 /tmp/hadoop-mapred
sudo -u hdfs hadoop fs -chmod -R 777 /tmp/hive-hive
sudo chown -R hive:hive /var/lib/hive/.hivehistory
sudo -u hdfs hadoop fs -mkdir /user/cloud-user
[align=left] sudo -u hdfs hadoop fs -chown cloud-user:cloud-user /user/cloud-user[/align]
[align=left] [/align]
[align=left]7、服务启动:[/align]
[align=left] sudo service hive-metastore start[/align]
[align=left] sudo service hive-server2 start[/align]
[align=left] [/align]
[align=left]8、测试:[/align]
[align=left] sudo /usr/lib/hive/bin/beeline[/align]
[align=left]beeline> !connect jdbc:hive2://10.0.0.2:10001 hive mypassword org.apache.hive.jdbc.HiveDriver[/align]
[align=left]0: jdbc:hive2://10.0.0.2:10001> SHOW TABLES;[/align]
[align=left]show tables;[/align]
[align=left]+-----------+[/align]
[align=left]| tab_name |[/align]
[align=left]+-----------+[/align]
[align=left]+-----------+[/align]
[align=left]No rows selected (0.238 seconds)[/align]
[align=left]0: jdbc:hive2://10.0.0.2:10001>!quit[/align]
相关文章推荐
- 【原】centos6.5下hadoop cdh4.6 安装
- 【原】centos6.5下cdh4.6 Oozie安装
- CentOS6.5下redis安装部署配置
- [原创] Centos 安装部署 Hadoop 集群和 hive
- CentOS6.5下Cloudera安装搭建部署大数据集群(图文分五大步详解)(博主强烈推荐)
- CentOS 6.5下JIRA安装部署
- Centos6.5下更简便的安装HIVE
- CentOS 6.5下Redis安装部署配置指南
- 王高利:CentOS6.5下redis安装部署配置指南、常用命令、主从同步集群、redis-php学习资料整合详解
- CentOS 6.5下Redis安装部署配置指南
- Centos7下Hive-1.2.1安装部署
- 64位CentOS6.5下安装hive
- Centos6.5下kafka部署安装
- Hive学习6_CentOS6.5下Hive2.1安装
- CentOS 6.5下JIRA安装部署
- CentOS6.5下redis安装部署配置指南、常用命令、主从同步集群、redis-php学习资料整合详解
- centos6.5下安装部署hadoop2.4(亲测)
- centos6\7下hive1.2.1安装部署
- Centos 6.5下Redis的安装部署
- centos6.5下安装部署单机版solr