<p>下面是一个可能的基于<code>selenium</code>的解决方案:</p>
<pre><code>from selenium import webdriver
from bs4 import BeautifulSoup as soup
d = webdriver.Chrome('/Users/jamespetullo/Downloads/chromedriver')
d.get('https://www.prokabaddi.com/stats/0-102-total-points-statistics')
while True:
_b = [i for i in d.find_elements_by_tag_name('span') if 'load more' in i.text.lower()]
if _b:
_b[0].click()
else:
break
r = [{'name':i.find('div', {'class':'sipk-lb-playerName'}).get_text(strip=True), 'points':i.find('div', {'class':'sipk-lb-detailBlock sipk-lb-raidPoints'}).get_text(strip=True)} for i in
soup(d.page_source, 'html.parser').find_all('div', {'class':'sipk-lb-detailItem wl-team-detail'})]
print(len(r))
</code></pre>
<p>输出:</p>
<pre><code>389
[{'name': 'Pardeep Narwal', 'points': '1055'}, {'name': 'Rahul Chaudhari', 'points': '987'}, {'name': 'Deepak Niwas Hooda', 'points': '892'}, {'name': 'Ajay Thakur', 'points': '811'}, {'name': 'Rohit Kumar', 'points': '689'}, {'name': 'Maninder Singh', 'points': '673'}, {'name': 'Rishank Devadiga', 'points': '619'}, {'name': 'Kashiling Adake', 'points': '612'}, {'name': 'Anup Kumar', 'points': '596'}, {'name': 'Pawan Kumar Sehrawat', 'points': '572'}......]
</code></pre>