您的位置:首页 > 编程语言 > Python开发

python3 读取大文件分解成若干小文件

2015-11-05 16:49 295 查看
有个数据实在太大了,有1.7G,打开慢,改文件也慢,我们将其分解成若干个中等文件

[code]     [code]#!/usr/bin/env python3


# -*- coding: utf-8 -*-


 


f = open("123.sql",'r',encoding='utf-8')


readlist = []


i = 0


i=i+1


filename = "mytest_{0}.sql".format(i)


wf=open(filename, 'w', encoding='utf-8')


linecount=0


while 1:


try:


line = f.readline()


wf.write(line)


linecount=linecount+1


if(linecount >;= 200000):


linecount = 0


print(filename)


i=i+1


wf.close()


filename = "mytest_{0}.sql".format(i)


wf=open(filename, 'w', encoding='utf-8')


if not line:


break


except Exception as e:


print("read except:" + str(e))


continue


#print("read except:" + str(e))


 


f.close()


 


print(filename)


wf.close()


 


 

[/code]
[/code]

有一个问题,之前的sql文件保存为utf-8格式,实际上在文件中夹杂中部分乱码,读取时会出错,所以需要try屏蔽
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: