擅长:python、mysql、java
<p>听起来你希望文件打开是并行的,但处理是顺序的。我不确定这是否能节省你的时间。在</p>
<pre><code>from concurrent.futures import ThreadPoolExecutor, as_completed
bigLogFileFolder = [...]
num = len(bigLogFileFolder)
pool = ThreadPoolExecutor(num)
futures = [pool.submit(open, bigLogFile) for bigLogFile in bigLogFileFolder]
for x in as_completed(futures):
processBigLogFile(x.result())
</code></pre>