检索同义词和相似性

2024-10-01 19:15:18 发布

您现在位置:Python中文网/ 问答频道 /正文

我想从www.thesaurus.com上刮几页。 我对一个词的同义词和反义词都感兴趣。 例如,如果我正在寻找的单词是angry,我对以下图片中的单词感兴趣(在页面中还有很多,但我只对前两个块感兴趣):

enter image description here

以及: enter image description here 我可以找到与此代码相关的词语:

import requests
from bs4 import BeautifulSoup

word = "angry"
url = 'https://www.thesaurus.com/browse/{}'.format(word)
r = requests.get(url)
returned_words_list = []

soup = BeautifulSoup(r.text, 'html.parser')
word_ul = soup.find("ul", {"class":'css-1lc0dpe et6tpn80'})
for idx, elem in enumerate(word_ul.findAll("a")):
    returned_words_list.append(elem.text.strip())

print (returned_words_list)

但我也对相似性(单词的颜色)感兴趣

查看源代码,有一个类似JSON的文件:

<script>window.INITIAL_STATE = {"routerReducer":{"location":null},"searchData":{"isFetchingTunaApi":false,"isFetchingSpellSuggestion":false,"isFetchingRelatedWordsApi":false,"searchTerm":"angry","tunaApiData":{"entry":"angry","type":"normal","slugLuna":"angry","slug":"angry","pronunciation":{"audio":{"audio\u002Fogg":"https:\u002F\u002Fstatic.sfdict.com\u002Faudio\u002Flunawav\u002FA04\u002FA0484200.ogg","audio\u002Fmpeg":"https:\u002F\u002Fstatic.sfdict.com\u002Faudio\u002FA04\u002FA0484200.mp3"},"spell":"\u003Cspan class=\"bold\"\u003Eang\u003C\u002Fspan\u003E-gree","ipa":"ˈæŋ gri"},"posTabs":[{"isInformal":null,"isVulgar":"0","definition":"being mad, often extremely mad","thesRid":"842","pos":"adj.","synonyms":[{"similarity":"100","isInformal":"0","isVulgar":null,"term":"annoyed","targetTerm":"annoyed","targetSlug":"annoyed"},{"similarity":"100","isInformal":"0","isVulgar":null,"term":"bitter","targetTerm":"bitter","targetSlug":"bitter"},{"similarity":"100","isInformal":"0","isVulgar":null,"term":"enraged","targetTerm":"enraged","targetSlug":"enraged"},.....

但我不知道怎么读。最后,我希望得到如下输出:

"synonyms":[{"similarity":"100","isInformal":"0","isVulgar":null,"term":"annoyed","targetTerm":"annoyed","targetSlug":"annoyed"},{"similarity":"100","isInformal":"0","isVulgar":null,"term":"bitter","targetTerm":"bitter","targetSlug":"bitter"},{"similarity":"100","isInformal":"0","isVulgar":null,"term":"enraged","targetTerm":"enraged","targetSlug":"enraged"},
"antonyms":[{"similarity":"-100","isInformal":"0","isVulgar":null,"term":"calm","targetTerm":"calm","targetSlug":"calm"},{"similarity":"-100","isInformal":"0","isVulgar":null,"term":"cheerful","targetTerm":"cheerful","targetSlug":"cheerful"},

在这里,我可以像这样读取termsimilarity(或者只是一个元组输出列表):

[("annoyed", 100), ("bitter", 100)...]
[("calm", -100), ("cheerful", -100)...]

Tags: comnull感兴趣wordtermsimilaritybittercalm
1条回答
网友
1楼 · 发布于 2024-10-01 19:15:18

功劳归于Andrej Kesely

import re
import json
import requests

url = 'https://www.thesaurus.com/browse/angry?s=t'

txt = re.findall(r'INITIAL_STATE\s*=\s*({.*})', requests.get(url).text)[0]

data = json.loads(txt)

# print(json.dumps(data, indent=4))  # <  uncomment to see all data

print(data.keys())

相关问题 更多 >

    热门问题