您的位置:首页 > 理论基础 > 计算机网络

网络爬虫1

2015-06-17 19:22 465 查看
import MySQLdb
import urllib
import webbrowser as web
import json

conn=MySQLdb.connect(host="localhost",user="root",passwd="sf123456",port=3306,charset="utf8")
cur=conn.cursor()

#cur.execute('create database if not exists stock_db')
conn.select_db("db_stock")

for i in range(1,57):
print i
url="http://q.10jqka.com.cn/interface/stock/fl/zdf/desc/"+str(i)+"/hsa/quote"
content=urllib.urlopen(url).read()
open("E:\\data\\stock\\stock0617.json","w").write(content)
#web.open_new_tab("E:\\data\\stock\\stock0617.json")
f=file("E:\\data\\stock\\stock0617.json")
s=json.load(f)
length=len(s['data'])
for i in range(0,length):
sql = "INSERT INTO stock_information1(cje,cjl,hsl,jk,jlr,rtime,stockcode,\
stockid,stockname,zde,zdf,zdj,zgj,zs,zxj)values('%s','%s','%s','%s',\
'%s','%s','%s','%s','%s','%s','%s','%s','%s','%s','%s')"%(s['data'][i]['cje'],s['data'][i]['cjl'],\
s['data'][i]['hsl'],s['data'][i]['jk'],s['data'][i]['jlr'],s['data'][i]['rtime'],\
s['data'][i]['stockcode'],s['data'][i]['stockid'],s['data'][i]['stockname'],s['data'][i]['zde'],\
s['data'][i]['zdf'],s['data'][i]['zdj'],s['data'][i]['zgj'],s['data'][i]['zs'],s['data'][i]['zxj']
)

cur.execute(sql)
conn.commit()
print "hello"
# except:
# 	print e
# 	conn.rollback()

conn.close()
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签:  python mysql