我尝试从csv文件中抓取几个URL(全部在1列中)。但是,代码不会返回任何内容。 谢谢 妮可
import scrapy
from scrapy.http import HtmlResponse
from scrapy.http import Request
import csv
scrapurls = ""
def get_urls_from_csv():
with open("produktlink_test.csv", 'rbU') as csv_file:
data = csv.reader(csv_file)
scrapurls = []
for row in data:
scrapurls.append(column)
return scrapurls
class GetlinksgalaxusSpider(scrapy.Spider):
name = 'getlinksgalaxus'
allowed_domains = []
# An dieser Stelle definieren wir unsere Zieldomains
start_urls = scrapurls
def parse(self, response):
....
Previous Answer: How to loop through multiple URLs to scrape from a CSV file in Scrapy?l
另外,最好将所有方法都放在Scrapy spider中,并显式地添加start\u请求
相关问题 更多 >
编程相关推荐