如何从类值为空的div中刮取文本

Question

嗨，没有任何类如何从div中抓取文本？一开始，我尝试用类“jobs page”从div中刮取所有数据，然后不使用类值，但它不起作用。你知道吗

from bs4 import BeautifulSoup
import requests

a = {}


def antal_pl(name=''):
    try:
        page_response = requests.get('https://antal.pl/oferty-pracy?s=&sid=&did=Accountancy', timeout=40).text
        page_content = BeautifulSoup(page_response, 'lxml')
        data = page_content.find_all(class_ = 'jobs_page')
        data_in = data.find_all('div', class_ = None)
        print(data_in)

    except:
        ''
antal_pl( name='Accontancy')

Answer 1

尝试下面的方法，以获得文本的网页，如你上面提到的。我试着整理一下你的代码，让它看起来更干净。你知道吗

from bs4 import BeautifulSoup
import requests

URL = "https://antal.pl/oferty-pracy?s=&sid=&did={}"

def antal_pl(name):
    res = requests.get(URL.format(name))
    soup = BeautifulSoup(res.text, 'lxml')
    data = soup.find(class_='header').find_next_sibling().text.strip()
    print(data)

if __name__ == '__main__':
    antal_pl("Accountancy")

结果：

Znaleziono 47 ofert pracy.

Answer 2

使用XPATH

html = etree.HTML(wb_data)
html_data = html.xpath('/html/body/div/ul/li/a')

enter image description here