如何从csv导入scrapy的起始URL?

2024-10-03 23:25:32 发布

您现在位置:Python中文网/ 问答频道 /正文

我尝试从csv文件中抓取几个URL(全部在1列中)。但是,代码不会返回任何内容。 谢谢 妮可

import scrapy
from scrapy.http import HtmlResponse
from scrapy.http import Request
import csv

scrapurls = ""

def get_urls_from_csv():
    with open("produktlink_test.csv", 'rbU') as csv_file:
        data = csv.reader(csv_file)
        scrapurls = []
        for row in data:
            scrapurls.append(column)
            return scrapurls

class GetlinksgalaxusSpider(scrapy.Spider):
    name = 'getlinksgalaxus'
    allowed_domains = []
    
    # An dieser Stelle definieren wir unsere Zieldomains
    start_urls = scrapurls

    def parse(self, response):

    ....

Tags: 文件csv代码fromimporthttpurl内容