如何获取每个URL文本值，我只获取最后一个URL值

Question

我是Python新手。通过这段代码，我只需要最后一个URL值，但我希望每个URL都能抓取内容

contents = []
with open('c:\\users\\thegl\\documents\\datab.csv','r') as csvf: # Open file in read mode
    urls = csv.reader(csvf)
    for url in urls:
        contents.append(url) # Add each url to list contents

for url in contents:  # Parse through each url in the list.
    page = urlopen(url[0]).read()
    soup = BeautifulSoup(page, "html.parser")
for List in soup.find_all('ol',class_='breadcrumb'):
    for listext in List.find_all('li'):
        print(listext.text)

file datab.csv contain following ULS: https://www.dumpstool.com/1Y0-371-exam.htmlhttps://www.dumpstool.com/TK0-201-exam.htmlhttps://www.dumpstool.com/C9510-401-exam.html

Answer 1

您应该缩进最后一个for，以便对每个url执行它

contents = []
with open('c:\\users\\thegl\\documents\\datab.csv','r') as csvf: # Open file in read mode
    urls = csv.reader(csvf)
    for url in urls:
        contents.append(url) # Add each url to list contents

for url in contents:  # Parse through each url in the list.
    page = urlopen(url[0]).read()
    soup = BeautifulSoup(page, "html.parser")
    for List in soup.find_all('ol',class_='breadcrumb'):
        for listext in List.find_all('li'):
            print(listext.text)