从pandas数据帧列(python3)中提取所有模式

2024-10-03 00:28:44 发布

您现在位置:Python中文网/ 问答频道 /正文

我正在使用jupyter笔记本(python 3)。我正试图从我的列表中提取熊猫数据框关键字。我将有大约50个关键字在列表中

例如:

import pandas as pd
import re

rgx_words1 = ['algaecid','algaecide','algaecides','anti-bakterien']

 

pattern = "\\b("+'|'.join(rgx_words1)+")\\b"

re_patt = re.compile(pattern)

 

pattern2 = "("+'|'.join(rgx_words1)+")"

re_patt2 = re.compile(pattern2)

 

data = [[1, 'I, will, find, algaecide, dd, algaecid, algaecides'], [2, 'fff, algaecid, dd, algaecide'], [3, 'ssssalgaecidllll, algaecides']]

  

# Create the pandas DataFrame

mydf = pd.DataFrame(data, columns = ['id', 'text'])

 

mydf['matches'] = mydf.apply(lambda x : re.findall(re_patt,x['text']),axis=1)

mydf['matches2'] = mydf.apply(lambda x : re.findall(re_patt2,x['text']),axis=1)

通过Reu patt,我提取了精确的单词,得到了正确的结果。在id 1中,我的输出是algaecide,algaecid,algaecides。有了re_patt2,我希望所有模式都像“SSSSALGAECIDLLL”一样,输出为“algaecid”。id 1中re_patt2的输出为algaecid、algaecid、algaecid,我想要的输出为algaecid、algaecid、algaecides。 如蒙指教,我将不胜感激。先谢谢你


Tags: textimportreidpandas列表关键字mydf
1条回答
网友
1楼 · 发布于 2024-10-03 00:28:44

您可以将pattern2更改为可选地匹配非空白字符,但左侧和右侧的逗号[^\s,]*除外

pattern2 = "[^\s,]*(?:"+'|'.join(rgx_words1)+")[^\s,]*"

代码可能看起来像

import pandas as pd
import re

rgx_words1 = ['algaecid','algaecide','algaecides','anti-bakterien']

pattern = "\\b("+'|'.join(rgx_words1)+")\\b"
re_patt = re.compile(pattern)

pattern2 = "[^\s,]*(?:"+'|'.join(rgx_words1)+")[^\s,]*"
re_patt2 = re.compile(pattern2)

data = [[1, 'I, will, find, algaecide, dd, algaecid, algaecides'], [2, 'fff, algaecid, dd, algaecide'], [3, 'ssssalgaecidllll, algaecides']]
mydf = pd.DataFrame(data, columns = ['id', 'text'])

mydf['matches'] = mydf.apply(lambda x : re.findall(re_patt, x['text']), axis=1)
mydf['matches2'] = mydf.apply(lambda x : re.findall(re_patt2, x['text']), axis=1)

print(mydf)

输出

   id                                               text                            matches                           matches2
0   1  I, will, find, algaecide, dd, algaecid, algaec...  [algaecide, algaecid, algaecides]  [algaecide, algaecid, algaecides]
1   2                       fff, algaecid, dd, algaecide              [algaecid, algaecide]              [algaecid, algaecide]
2   3                       ssssalgaecidllll, algaecides                       [algaecides]     [ssssalgaecidllll, algaecides]

相关问题 更多 >