<p>类似这样的东西(我没有测试这个,它可能有用也可能不起作用,只是想展示一下原理)</p>
<pre><code>button_next = soup.find("a", {"class": "btn paging-next"}, href=True)
while button_next:
time.sleep(2)#delay time requests are sent so we don\'t get kicked by server
url2 = "https://www.propertypal.com{0}".format(button_next["href"])
page2=requests.get(url2)
print(url2)
soup=BeautifulSoup(page2.text,"lxml")
g_data = soup.findAll("div", {"class": "propbox-details"})
for item in g_data:
try:
title = item.find_all("span", {"class": "propbox-addr"})[0].text
except:
pass
try:
town = item.find_all("span", {"class": "propbox-town"})[0].text
except:
pass
try:
price = item.find_all("span", {"class": "price-value"})[0].text
except:
pass
try:
period = item.find_all("span", {"class": "price-period"})[0].text
except:
pass
course=[title,town,price,period]
houses.append(course)
button_next = soup.find("a", {"class": "btn paging-next"}, href=True)
</code></pre>