有没有什么方法可以刮到csk？

Question

<td class="left " data-append-csv="adamja01" data-stat="player" csk="Adam,Jason0.01"><a href="/players/a/adamja01.shtml">Jason&nbsp;Adam</a></td>

这是我目前掌握的密码。。。我想亚当，杰森导入excel。他的名字好像在“csk”里。任何建议都会非常有用。谢谢！你知道吗

from urllib.request import urlopen
from bs4 import BeautifulSoup
content = urlopen("https://www.baseball-reference.com/leagues/MLB/2018-standard-pitching.shtml")
soup = BeautifulSoup(content.read(),"lxml")
tags = soup.findAll('div')
for t in tags:
    print(t)

Answer 1

使用lxml会更快：

from urllib.request import urlopen
#from bs4 import BeautifulSoup, Comment
from lxml import html

response = urlopen("https://www.baseball-reference.com/leagues/MLB/2018-standard-pitching.shtml")
content = response.read()

tree = html.fromstring( content )

#Now we need to find our target table (comment text)
comment_html = tree.xpath('//comment()[contains(., "players_standard_pitching")]')[0]

#removing HTML comment markup
comment_html = str(comment_html).replace(" >", "")
comment_html = comment_html.replace("<! ", "")

#parsing our target HTML again
tree = html.fromstring( comment_html )

for pitcher_row in tree.xpath('//table[@id="players_standard_pitching"]/tbody/tr[contains(@class, "full_table")]'):

    csk = pitcher_row.xpath('./td[@data-stat="player"]/@csk')[0]
    print(csk)

Answer 2

尝试下面的脚本来获取它们。您愿意获取的数据包含在注释中，这就是为什么通常的方法不允许您收集这些数据：

from urllib.request import urlopen
from bs4 import BeautifulSoup, Comment

content = urlopen("https://www.baseball-reference.com/leagues/MLB/2018-standard-pitching.shtml")
soup = BeautifulSoup(content.read(),"lxml")
for comment in soup.find_all(string=lambda text:isinstance(text,Comment)):
    sauce = BeautifulSoup(comment,"lxml")
    for tags in sauce.find_all('tr'):
        name = [item.get("csk") for item in tags.find_all("td")[:1]]
        print(name)