pythonselenium使用循环语句从网站列表fi获取每个网站的元素属性

Question

如何使用pythonselenium遍历网站列表（从Excel文件）以从每个网站获取值？在

例如，Excel文件中的列包含：

https://www.inc.com/profile/dom-&-tom
https://www.inc.com/profile/decksouth
https://www.inc.com/profile/shp-financial
and many more.....

我想从每个链接获取一个特定的HREF属性。在

目前我的代码：

^{pr2}$

如有任何意见，我们将不胜感激。在

Answer 1

有什么改进我的代码的建议吗？在

from selenium import webdriver
from selenium.common.exceptions import NoSuchElementException
from selenium.webdriver.firefox.options import Options
import xlrd
import xlwt
from xlutils.copy import copy

def scraping(browser, link):
    returnValue = ""
    browser.get(link)
    try:
        website_link_anchor = browser.find_element_by_xpath("//dd[@class='website']/a")
        actual_website_link = website_link_anchor.get_attribute("href")
        returnValue = actual_website_link
    except NoSuchElementException: 
        returnValue = "Element not found for: " + link
    return returnValue

options = Options()
options.add_argument(" headless")
browser = webdriver.Firefox(firefox_options=options, executable_path=r'C:\WebDrivers\geckodriver.exe')

file_to_read = ("C:\INC5000\list.xlsx")

# read
file_to_read_wb = xlrd.open_workbook(file_to_read)
file_to_read_wb_sheet = file_to_read_wb.sheet_by_index(0)

# copy and write
file_to_write_to_wb = copy(file_to_read_wb)
file_to_write_to_wb_sheet = file_to_write_to_wb.get_sheet(0)

for i in range(1, file_to_read_wb_sheet.nrows):
    result = scraping(browser, file_to_read_wb_sheet.cell_value(i, 0))
    file_to_write_to_wb_sheet.write(i, 1, result)

file_to_write_to_wb.save("C:\INC5000\list2.xls")

browser.close()