擅长:python、mysql、java
<p>坚持原著会更容易些,不是吗?你把标点符号放回去的最终目标是什么?如果你要重建整条生产线,为什么不把它放在第一位呢?在</p>
<pre><code>pattern = '['+''.join(string.punctuation)+']+' # Make a char set in regex syntax
for line in file:
tokens = line.split(' ')
for token in tokens:
parsed = parse_token(re.sub(pattern, token))
# Now do whatever else you might need to do with token and parsed.
# Remember, you still have access to the `line` string and `tokens` list!
def parse_token(token):
pass # Do whatever you need to do with your "clean" token here.
</code></pre>