Sqoop安装配置

<span style="font-family: Arial, Helvetica, sans-serif; font-size: 12px; background-color: rgb(255, 255, 255);">使用的系统</span>

Linux CentOS 6.5

Hadoop:hadoop-2.7.1

sqoop-1.99.6 下载地址:http://apache.fayea.com/sqoop/1.99.6/sqoop-1.99.6-bin-hadoop200.tar.gz

解压配置

tar zxvf sqoop-1.99.6-bin-hadoop200.tar.gz -C /home/hadoop/src/

配置环境变量

vim /etc/profile

export JAVA_HOME=/usr/jvm/jdk1.7.0_67
export HADOOP_HOME=/home/hadoop/src/hadoop-2.7.1
export SQOOP_HOME=/home/hadoop/src/sqoop
export CATALINE_BASE=$SQOOP_HOME/server
export CLASSPATH=.:$JAVA_HOME/jre/lib/rt.jar:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:$HADOOP_HOME/lib
export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/sbin:$HADOOP_HOME/bin:$SQOOP_HOME/bin

配置${SQOOP_HOME}/server/conf/catalina.properties

/home/hadoop/src/hadoop-2.7.1/share/hadoop/common/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/common/lib/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/hdfs/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/hdfs/lib/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/httpfs/tomcat/lib/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/mapreduce/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/mapreduce/lib/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/tools/lib/*.jar/home/hadoop/src/hadoop-2.7.1/share/hadoop/yarn/*.jar,/home/hadoop/src/hadoop-2.7.1/share/hadoop/yarn/lib/*.jar

配置${SQOOP_HOME}/server/conf/sqoop.properties
文件

vim
./server/conf/sqoop.properties

org.apache.sqoop.submission.engine.mapreduce.configuration.directory=修改为自己的Hadoop路径



sqoop的配置基本上已经结束：下面就开始测试是否安装成功！。。

先启动Hadoop集群

start-all.sh

由于刚刚配置的Sqoop的环境变量

sqoop2-server start

启动过Sqoop客户端

[hadoop@nn1 sqoop]$ sqoop.sh client
Sqoop home directory: /home/hadoop/src/sqoop
Apr 11, 2016 12:36:36 PM java.util.prefs.FileSystemPreferences$1 run
INFO: Created user preferences directory.
Sqoop Shell: Type 'help' or '\h' for help.

sqoop:000> help
For information about Sqoop, visit: http://sqoop.apache.org/ 
Available commands:
exit    (\x  ) Exit the shell
history (\H  ) Display, manage and recall edit-line history
help    (\h  ) Display this help message
set     (\st ) Configure various client options and settings
show    (\sh ) Display various objects and configuration options
create  (\cr ) Create new object in Sqoop repository
delete  (\d  ) Delete existing object in Sqoop repository
update  (\up ) Update objects in Sqoop repository
clone   (\cl ) Create new object based on existing one
start   (\sta) Start job
stop    (\stp) Stop job
status  (\stu) Display status of a job
enable  (\en ) Enable object in Sqoop repository
disable (\di ) Disable object in Sqoop repository
grant   (\g  ) Grant access to roles and assign privileges
revoke  (\r  ) Revoke access from roles and remove privileges