擅长:python、mysql、java
<p>通常在实例化驱动程序后不久,执行一次<code>set_page_load_timeout</code>。然后,您应该在try中包装<code>driver.get</code>,如下所示:</p>
<pre><code>from __future__ import print_function
from selenium import webdriver
from time import sleep
from selenium.webdriver.support.ui import WebDriverWait
from selenium.common.exceptions import TimeoutException
profile = webdriver.FirefoxProfile()
profile.add_extension(extension = '/Users/wayne/Desktop/fourthparty/extension/fourthparty.xpi')
driver = webdriver.Firefox(profile)
driver.set_page_load_timeout(30)
def scan(cutoff):
with open('top-1m.csv', 'r') as f:
for num, url in enumerate(f):
if (num == 500):
return
url = url.split(',')[1]
try:
driver.get('http://www.' + url)
except TimeoutException:
print("Caught and handled slow page timeout exception")
# Do something here I guess?
if __name__ == "__main__":
scan(500)
</code></pre>