我想用Python脚本,而不是通过在终端上传递命令,将刮取的结果写入CSV文件中。你知道吗
代码如下:
from scrapy.spiders import CrawlSpider, Rule
from scrapy.linkextractors import LinkExtractor
from my_scrapy.items import newsItem
class BbcSpider(CrawlSpider):
name = "bbcnews"
allowed_domains = ["bbc.co.uk"]
start_urls = ["http://www.bbc.co.uk/news/technology/",]
rules = [Rule(LinkExtractor(allow=['/technology-\d+']), 'parse_story')]
def parse_story(self, response):
story = newsItem()
story['url'] = response.url
story['headline'] = response.xpath("//title/text()").extract()
story['intro'] = response.css('p.introduction::text').extract()
story['p_date'] = response.xpath("//ul/li/div[@class='date date--v2']/text()").extract()
story['story_body'] = response.css('p.story-body__introduction::text').extract()
return story
你试过csv模块吗? https://docs.python.org/2/library/csv.html
如果没有一个去写你在哪里挣扎。你知道吗
相关问题 更多 >
编程相关推荐