<p>硒不是一个好主意,网页刮。我建议您使用JMeter,它是免费的、开源的。你知道吗</p>
<p><a href="http://www.testautomationguru.com/jmeter-how-to-do-web-scraping/" rel="nofollow noreferrer">http://www.testautomationguru.com/jmeter-how-to-do-web-scraping/</a></p>
<p>如果您想使用selenium,那么您尝试采用的方法并不是一种稳定的方法—单击并获取数据。相反,我建议你遵循这个-类似的东西在这里。这个例子是用java编写的。但你可以理解。你知道吗</p>
<pre><code>driver.get("https://www.yahoo.com");
Map<Integer, List<String>> map = driver.findElements(By.xpath("//*[@href]"))
.stream() // find all elements which has href attribute & process one by one
.map(ele -> ele.getAttribute("href")) // get the value of href
.map(String::trim) // trim the text
.distinct() // there could be duplicate links , so find unique
.collect(Collectors.groupingBy(LinkUtil::getResponseCode)); // group the links based on the response code
</code></pre>
<p>更多信息在这里。你知道吗</p>
<p><a href="http://www.testautomationguru.com/selenium-webdriver-how-to-find-broken-links-on-a-page/" rel="nofollow noreferrer">http://www.testautomationguru.com/selenium-webdriver-how-to-find-broken-links-on-a-page/</a></p>