hive命令将hbase数据导出到hive然后到本地
2014-09-26 00:07
393 查看
CREATE EXTERNAL TABLE userData(rowkey string,UserId String, ProfileId int,ClientTimeHourPart int,ClientTimeDayOfWeekPart String,ServerTime String,Country String,StateOrProvince String,City String,Longitude String,Latitude String,ISP String,OSBrief String,OSDetail
String,BrowserBrief String,ScreenResolution String,IsMobile int,DeviceBrand String,DeviceType String,DeviceName String,Keywords String,SearchEngine String,ReferrerHostName String,SocialMedia String,PageHostName String,PageTitle String,WeiboUserId String)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,CF:UserId,CF:ProfileId,CF:ClientTimeHourPart,CF:ClientTimeDayOfWeekPart,CF:ServerTime,CF:Country,CF:StateOrProvince,CF:City,CF:Longitude,CF:Latitude,CF:ISP,CF:OSBrief,CF:OSDetail,CF:BrowserBrief,CF:ScreenResolution,CF:IsMobile,CF:DeviceBrand,CF:DeviceType,CF:DeviceName,CF:Keywords,CF:SearchEngine,CF:ReferrerHostName,CF:SocialMedia,CF:PageHostName,CF:PageTitle,CF:WeiboUserId")
TBLPROPERTIES("hbase.table.name" = "UserData");
rm -rf /home/bigdata/maoxiao/aud/accessUserData/userData
INSERT OVERWRITE LOCAL DIRECTORY '/home/bigdata/maoxiao/aud/accessUserData/userData' ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' select * from userData;
String,BrowserBrief String,ScreenResolution String,IsMobile int,DeviceBrand String,DeviceType String,DeviceName String,Keywords String,SearchEngine String,ReferrerHostName String,SocialMedia String,PageHostName String,PageTitle String,WeiboUserId String)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,CF:UserId,CF:ProfileId,CF:ClientTimeHourPart,CF:ClientTimeDayOfWeekPart,CF:ServerTime,CF:Country,CF:StateOrProvince,CF:City,CF:Longitude,CF:Latitude,CF:ISP,CF:OSBrief,CF:OSDetail,CF:BrowserBrief,CF:ScreenResolution,CF:IsMobile,CF:DeviceBrand,CF:DeviceType,CF:DeviceName,CF:Keywords,CF:SearchEngine,CF:ReferrerHostName,CF:SocialMedia,CF:PageHostName,CF:PageTitle,CF:WeiboUserId")
TBLPROPERTIES("hbase.table.name" = "UserData");
rm -rf /home/bigdata/maoxiao/aud/accessUserData/userData
INSERT OVERWRITE LOCAL DIRECTORY '/home/bigdata/maoxiao/aud/accessUserData/userData' ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' select * from userData;
相关文章推荐
- hive的数据导入与数据导出:(本地,云hdfs,hbase),列分隔符的设置,以及hdfs上传给pig如何处理
- hive的数据导入与数据导出:(本地,云hdfs,hbase),列分隔符的设置,以及hdfs上传给pig如何处理
- 使用expdp命令导出本地某个用户的数据
- hive over hbase方式将数据导出
- hive数据导出至本地文件,如何指定分隔符
- Sqoop_详细总结 使用Sqoop将HDFS/Hive/HBase与MySQL/Oracle中的数据相互导入、导出
- Sqoop_具体总结 使用Sqoop将HDFS/Hive/HBase与MySQL/Oracle中的数据相互导入、导出
- 使用Sqoop将HDFS/Hive/HBase与MySQL/Oracle中的数据相互导入、导出
- MapReduce从HBase多路径导出数据到Hive
- Hbase 数据导出到本地文件中
- Hbase总结(一)-hbase命令,hbase安装,与Hive的区别,与传统数据库的区别,Hbase数据模型
- 大规模数据导入和导出(hive和hbase)
- 大数据基础(二)hadoop, mave, hbase, hive, sqoop在ubuntu 14.04.04下的安装和sqoop与hdfs,hive,mysql导入导出
- hive导出数据导本地的方法
- hive导出hbase数据
- Hadoop数据工具sqoop,导入HDFS,HIVE,HBASE,导出到oracle
- sql server 导出数据到 Azure Hbase / Hive 详细步骤
- 结合linux命令讲解线上用hive拉取hbase数据
- shell命令将hbase数据导出到文本文件
- 如何使用mysqldump命令导入导出数据库下的数据或表结构(远程or本地都适合)