<p>由于某些原因,这些“更多”链接并不总是显示在页面中:
<a href="https://i.stack.imgur.com/P2Bhr.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/P2Bhr.png" alt="enter image description here"/></a></p>
<p>我也明白了:
<a href="https://i.stack.imgur.com/J67nH.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/J67nH.png" alt="enter image description here"/></a></p>
<p>注意,在一个版本中它有“更多”链接,在另一个版本中标题是链接。每当我清除缓存时,就会得到第二个版本。Scrapy似乎也得到了没有“更多”链接的版本。你知道吗</p>
<p>相反,我建议您从菜单中获取链接(即使它们对您来说是隐藏的)。你知道吗</p>
<p>以下是如何在“计算机和平板电脑”菜单中获得(蓝色)标题链接:</p>
<pre><code>>>> response.css('#computers-tablets .product-category-navigation__title a::attr("href")').getall()
['/en/laptops-desktops-monitors', '/en/peripherals', '/en/tablets-ereaders', '/en/computer-parts', '/en/printers-scanners', '/en/memory-storage', '/en/network-internet', '/en/gaming']
</code></pre>
<p>以下是如何获得每个标题下的链接:</p>
<pre><code>>>> response.css('#computers-tablets .category-navigation item a::attr("href")').getall()
['/en/laptops', '/en/laptops/apple-macbook', '/en/desktops', '/en/monitors', '/en/keyboards', '/en/mouses', '/en/office-supplies', '/en/tablets', '/en/tablets/apple-ipad', '/en/e-readers', '/en/tablet-covers', '/en/internal-hard-drives', '/en/internal-ssd', '/en/video-cards', '/en/ram', '/en/printers', '/en/scanners', '/en/cartridges', '/en/toners', '/en/external-hard-drives', '/en/external-ssds', '/en/memory-cards', '/en/nas', '/en/routers', '/en/powerline-adapters', '/en/network-switches', '/en/wifi-repeaters', '/en/consoles', '/en/video-games', '/en/gaming-headsets', '/en/vr-gear']
</code></pre>