擅长:python、mysql、java
<p>你试过偷懒吗?:<a href="https://stackoverflow.com/questions/519633/lazy-method-for-reading-big-file-in-python">Lazy Method for Reading Big File in Python?</a></p>
<p>这似乎已经回答了你的问题。但是,我会考虑使用这种方法将数据写入数据库,mysql是免费的:<a href="http://dev.mysql.com/downloads/" rel="nofollow noreferrer">http://dev.mysql.com/downloads/</a>,NoSQL也是免费的,可能更适合于涉及写入800gb数据或类似数量的操作:<a href="http://www.oracle.com/technetwork/database/nosqldb/downloads/default-495311.html" rel="nofollow noreferrer">http://www.oracle.com/technetwork/database/nosqldb/downloads/default-495311.html</a></p>