<p>根据<a href="http://doc.scrapy.org/en/latest/topics/request-response.html" rel="nofollow noreferrer">Scrapy 1.7.3 document</a>。你的头不会像其他人一样通用。它应该是相同的网站,你正在刮。您将从控制台网络选项卡了解标题。在</p>
<p>像下面这样添加它们并打印响应。在</p>
<pre><code># -*- coding: utf-8 -*-
import scrapy
#import logging
class AaidSpider(scrapy.Spider):
name = 'aaid'
def parse(self, response):
url = "https://www.eventscribe.com/2019/AAOMS-CSIOMS/ajaxcalls/PresenterInfo.asp?efp=SVNVS1VRTEo4MDMx&PresenterID=597498&rnd=0.8680339"
# Set the headers here.
headers = {
'Accept': '*/*',
'Accept-Encoding': 'gzip, deflate, br',
'Accept-Language': 'en-GB,en-US;q=0.9,en;q=0.8',
'Connection': 'keep-alive',
'Host': 'www.eventscribe.com',
'Referer': 'https://www.eventscribe.com/2018/ADEA/speakers.asp?h=Browse%20By%20Speaker',
'User-Agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.142 Safari/537.36',
'X-Requested-With': 'XMLHttpRequest'
}
# Send the request
scrapy.http.Request(url, method='GET' , headers = headers, dont_filter=False)
print(response.body) #If the response is HTML
#If the response is json ; import json
#jsonresponse = json.loads(response.body_as_unicode())
#print jsonresponse
</code></pre>