当我从php运行python scrapy回调时,它不会运行

2024-10-03 11:26:05 发布

您现在位置:Python中文网/ 问答频道 /正文

当我从php代码运行Python scrapy回调时,它不会运行。一切正常,但回拨不进行,不知道为什么。我正在使用以下代码,如果有人遇到这个请让我知道是什么问题。早点谢谢你!你知道吗

我的代码:
菲律宾比索:

exec("python mypythoncode.py $input", $my_output);

Python:
我的Python代码.py你知道吗

import sys  
from scrapy.crawler import CrawlerProcess, CrawlerRunner  
from scrapy.utils.project import get_project_settings  
from scrapy.utils.log import configure_logging  
from scrapy.settings import Settings  
from tutorial.spiders.MixSpider import MixSpider  
inputURL = sys.argv[1]  

crawler = CrawlerProcess(Settings())
crawler.crawl(MixSpider, inputURL=inputURL)
crawler.start() 

你知道吗混合蜘蛛.py你知道吗

import scrapy
import string
from tutorial.items import DmozItem
from urlparse import urlparse
from scrapy.http.request import Request

class MixSpider(scrapy.Spider):
    name = 'spider'
    def __init__(self, *args, **kwargs):
        super(MixSpider, self).__init__(*args, **kwargs) 
        url = kwargs.get('inputURL')
        self.start_urls = [url]

    def parse(self, response):
        for slide in response.css('#all > div > div > div > div.slide'):
            title = slide.css('div > div.frame > address > a::text').extract()
            pro_link = slide.css('div > div.frame > address > a::attr(href)').extract()
            yield scrapy.Request(pro_link,meta={'pro_title' : title,'title_link' : pro_link},callback=self.parse_property)

    def parse_property(self, response):
        print "inside"

Tags: 代码frompyimportselfdivtitledef