使用python beautifulsoup进行Web爬网

Question

如何提取<p>段落标记和<li>内的数据，它们位于命名的<div>类下？在

Answer 1

使用函数^{}和^{}：

import requests
from bs4 import BeautifulSoup

url = '...'

r = requests.get(url)
data = r.text
soup = BeautifulSoup(data, 'html.parser')

div = soup.find('div', {'class':'class-name'})
ps = div.find_all('p')
lis = div.find_all('li')

# print the content of all <p> tags
for p in ps:
    print(p.text)

# print the content of all <li> tags
for li in lis:
    print(li.text)