mongoDB id 导出,dump,sed,count,mysql import等用法示例
2014-11-07 11:07
405 查看
#count collection
db.news.count({"lpublishtime":{"$gte":1358697600000}});
#mongo导出
mongoexport -h 192.168.1.175 --port 33000 -d booaa_so -c weibo -f '_id' -q "{\"lweibotime\":{\"\$gte\":1349020800000,\"\$lt\":1351699200000}}" -o weibo_20121201_33000.ids &
######################20121227.txt######################
#mongo导出0.1
mongoexport --port 33000 -d booaa_so -c bbs -f '_id' -o 33000.bbs.ids;
#替换,将导出的文件内容替换成一个插入sql语句
#sed v1
sed 's/{ "_id" : { "\$oid" : /insert ignore into index_quene3_test (id,createtime) values (/' 33001.bbs.ids> 33001.bbs.ids_tmp
sed 's/ } }/,now());/' 33001.bbs.ids_tmp> 33001.bbs.ids_final
#sed v2
sed 's/{ "_id" : { "\$oid" : "/ /' 20130121_33002_bbs.ids> 20130121_33002_bbs.ids_tmp
sed 's/" } }/ /' 20130121_33002_bbs.ids_tmp> 20130121_33002_bbs.ids_final
#sed 3
sed 's/insert into index_quene/insert ignore into index_quene/' 33001.weibo.ids_final> 33001.weibo.ids_fffff
#mysql导入
#2013-01-12 import
mysql -um4n -p01D060A476642BA8335B832AC5B211F222F641B5 -h192.168.1.136 -D boss_db < 33002.bbs.ids_final &
mysql -um4n -p01D060A476642BA8335B832AC5B211F222F641B5 -h192.168.1.136 -D boss_db < 33002.blog.ids_final &
#统计文件行数数量
[webadmin@idc89 ~]$ wc -l weibo_20130121_33002.ids_final
4942900 weibo_20130121_33002.ids_final
#index_module mv
mv busstmp/weiboMerge/weibo0/* buss/weibo0/
mv busstmp/weiboMerge/weibo1/* buss/weibo1/
#mysql sql import
insert ignore into index_quene4 (id,createtime) select id,createtime from index_quene4_test;
db.news.count({"lpublishtime":{"$gte":1358697600000}});
#mongo导出
mongoexport -h 192.168.1.175 --port 33000 -d booaa_so -c weibo -f '_id' -q "{\"lweibotime\":{\"\$gte\":1349020800000,\"\$lt\":1351699200000}}" -o weibo_20121201_33000.ids &
######################20121227.txt######################
#mongo导出0.1
mongoexport --port 33000 -d booaa_so -c bbs -f '_id' -o 33000.bbs.ids;
#替换,将导出的文件内容替换成一个插入sql语句
#sed v1
sed 's/{ "_id" : { "\$oid" : /insert ignore into index_quene3_test (id,createtime) values (/' 33001.bbs.ids> 33001.bbs.ids_tmp
sed 's/ } }/,now());/' 33001.bbs.ids_tmp> 33001.bbs.ids_final
#sed v2
sed 's/{ "_id" : { "\$oid" : "/ /' 20130121_33002_bbs.ids> 20130121_33002_bbs.ids_tmp
sed 's/" } }/ /' 20130121_33002_bbs.ids_tmp> 20130121_33002_bbs.ids_final
#sed 3
sed 's/insert into index_quene/insert ignore into index_quene/' 33001.weibo.ids_final> 33001.weibo.ids_fffff
#mysql导入
#2013-01-12 import
mysql -um4n -p01D060A476642BA8335B832AC5B211F222F641B5 -h192.168.1.136 -D boss_db < 33002.bbs.ids_final &
mysql -um4n -p01D060A476642BA8335B832AC5B211F222F641B5 -h192.168.1.136 -D boss_db < 33002.blog.ids_final &
#统计文件行数数量
[webadmin@idc89 ~]$ wc -l weibo_20130121_33002.ids_final
4942900 weibo_20130121_33002.ids_final
#index_module mv
mv busstmp/weiboMerge/weibo0/* buss/weibo0/
mv busstmp/weiboMerge/weibo1/* buss/weibo1/
#mysql sql import
insert ignore into index_quene4 (id,createtime) select id,createtime from index_quene4_test;
相关文章推荐
- mysql的last_insert_id()用法
- MySQL数据导入导出方法与工具介绍(2-import from sql files) davidullua(原作)
- Ubuntu命令行下MySQL数据导出与导入简单示例
- mysqldumpslow用法示例
- 关于MySQL里的found_row()和row_count()解释及用法(很好很强大!!!)
- MySQL数据导入导出方法与工具介绍(1- myslqimport utility)
- MySQL的LAST_INSERT_ID用法
- 命令行下MySQL数据导出与导入简单示例
- MySQL的LAST_INSERT_ID用法
- mysql中last_insert_id()的用法
- MySQL数据导入导出方法与工具介绍(2-import from sql
- 内存变量 Export / Import ...To Memory ID 'ID_Name' / From Memory ID 'ID_Name' 导出/读取的使用
- 内存变量 Export / Import ...To Memory ID 'ID_Name' / From Memory ID 'ID_Name' 导出/读取的使用
- MongoDB 和 MongoMapper的示例用法简介
- mysql数据导出,mysqldump.exe详解
- MySQL数据导入导出方法与工具介绍(2-import from sql files)
- MySQL数据导入导出方法与工具mysqlimport
- MySQL导入导出数据 |数据和结构分开导| dump
- MySQL 导入、导出备份 mysqldump工具用法
- MySQL的LAST_INSERT_ID用法