从html页面中删除所有样式、脚本和html标记

2024-05-17 03:22:14 发布

您现在位置：Python中文网/ 问答频道 /正文
1268 3

以下是我目前掌握的情况：

from bs4 import BeautifulSoup

def cleanme(html):
    soup = BeautifulSoup(html) # create a new bs4 object from the html data loaded
    for script in soup(["script"]): 
        script.extract()
    text = soup.get_text()
    return text
testhtml = "<!DOCTYPE HTML>\n<head>\n<title>THIS IS AN EXAMPLE </title><style>.call {font-family:Arial;}</style><script>getit</script><body>I need this text captured<h1>And this</h1></body>"

cleaned = cleanme(testhtml)
print (cleaned)

正在删除脚本


Tags： textfromtitlestylehtmlscriptbodythis
3条回答
网友
1楼 · 编辑于 2024-05-17 03:22:14

你好像快拿到了。您还需要删除html标记和css样式代码。这是我的解决方案（我更新了函数）：

def cleanMe(html):
    soup = BeautifulSoup(html) # create a new bs4 object from the html data loaded
    for script in soup(["script", "style"]): # remove all javascript and stylesheet code
        script.extract()
    # get text
    text = soup.get_text()
    # break into lines and remove leading and trailing space on each
    lines = (line.strip() for line in text.splitlines())
    # break multi-headlines into a line each
    chunks = (phrase.strip() for line in lines for phrase in line.split("  "))
    # drop blank lines
    text = '\n'.join(chunk for chunk in chunks if chunk)
    return text
网友
2楼 · 编辑于 2024-05-17 03:22:14

您可以使用^{}从文档中完全删除标记，并使用^{}生成器检索标记内容。

def clean_me(html):
    soup = BeautifulSoup(html)
    for s in soup(['script', 'style']):
        s.decompose()
    return ' '.join(soup.stripped_strings)

>>> clean_me(testhtml) 
'THIS IS AN EXAMPLE I need this text captured And this'
网友
3楼 · 编辑于 2024-05-17 03:22:14

以干净的方式删除指定的标记和注释。感谢Kim Hyesung对this code的支持。

from bs4 import BeautifulSoup
from bs4 import Comment

def cleanMe(html):
    soup = BeautifulSoup(html, "html5lib")    
    [x.extract() for x in soup.find_all('script')]
    [x.extract() for x in soup.find_all('style')]
    [x.extract() for x in soup.find_all('meta')]
    [x.extract() for x in soup.find_all('noscript')]
    [x.extract() for x in soup.find_all(text=lambda text:isinstance(text, Comment))]
    return soup

相关问题 更多 >

    编程相关推荐