擅长:python、mysql、java
<p>将繁重的处理移到一个单独的程序中,然后用subprocess调用该程序以保持一定数量的并行进程运行:</p>
<pre><code>import subprocess
import time
todo = []
for file in list:
for filename in file:
todo.append(filename)
running_processes = []
while len(todo)>0:
running_processes = [p for p in running_processes if p.poll() is None]
if len(running_processes)<8:
target = todo.pop()
running_processes.append( subprocess.Popen(['python','process_gzip.py',target]) )
time.sleep(1)
</code></pre>