斯帕利:ItemLoader,有人能给我解释一下这个错误吗?

2024-10-03 13:26:47 发布

您现在位置:Python中文网/ 问答频道 /正文

我有一个问题,我已经开始使用刮痧超过美丽的小组,我新的刮痧,所以这个错误把我扔掉了,我试图修复它没有成功一点。你知道吗

我想用项目加载器产生报废项目,但我得到错误,我不明白是什么问题。你知道吗

有人能解释一下我做错了什么吗。你知道吗

这是我的蜘蛛代码,报价.py公司名称:

from scrapy import Spider
from scrapy.loader import ItemLoader
from quotes_spider.items import QuotesSpiderItem

class QuotesSpider(Spider):
    name = 'quotes'
    allowed_domains = ['http://quotes.toscrape.com']
    start_urls = ["http://quotes.toscrape.com"]


    def parse(self, response):
        l = ItemLoader(item=QuotesSpiderItem(), response=response)
        quotes = response.xpath('//*[@class="quote"]')
        for quote in quotes:
            text = quote.xpath('.//*[@class="text"]/text()').extract_first()
            author = quote.xpath('.//*[@itemprop="author"]/text()').extract_first()
            tags = quote.xpath('.//*[@class="tag"]/text()').extract_first ()

            l.add_value('Text', text)
            l.add_value('Author', author)
            l.add_value('Tags', tags)

            return l.load_item()

这是我的项目.py文件:

import scrapy

class QuotesSpiderItem(scrapy.Item):
    text = scrapy.Field()
    author = scrapy.Field()
    tags = scrapy.Field()

这是我尝试运行它时遇到的错误:

Traceback (most recent call last):
  File "/home/djurovic/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks
    current.result = callback(current.result, *args, **kw)
  File "/home/djurovic/Desktop/quotes_spider/quotes_spider/spiders/quotes.py", line 20, in parse
    l.add_value('Text', text)
  File "/home/djurovic/.local/lib/python3.6/site-packages/scrapy/loader/__init__.py", line 77, in add_value
    self._add_value(field_name, value)
  File "/home/djurovic/.local/lib/python3.6/site-packages/scrapy/loader/__init__.py", line 91, in _add_value
    processed_value = self._process_input_value(field_name, value)
  File "/home/djurovic/.local/lib/python3.6/site-packages/scrapy/loader/__init__.py", line 148, in _process_input_value
    proc = self.get_input_processor(field_name)
  File "/home/djurovic/.local/lib/python3.6/site-packages/scrapy/loader/__init__.py", line 137, in get_input_processor
    self.default_input_processor)
  File "/home/djurovic/.local/lib/python3.6/site-packages/scrapy/loader/__init__.py", line 154, in _get_item_field_attr
    value = self.item.fields[field_name].get(key, default)

Tags: textinpyselfaddhomevaluelib