<p>使用<a href="http://docs.python-requests.org/en/latest/" rel="nofollow">requests</a>为您完成所有工作，使用<code>.content</code>让请求处理编码：</p>
<pre><code>import requests
urls=['http://www.nydailynews.com/sports/soccer-fans-stampede-south-african-stadium-nigeria-north-korea-world-cup-warmup-article-1.179211']
path='C:/Users/sony/Desktop/Python'
for i,site in enumerate(urls):
print (site)
req = requests.get(site)
page_content = req.content
with open ('{}{}.html'.format(path,i), 'w') as fid:
fid.write(page_content)
</code></pre>
<p>输出：</p>
<pre><code> <!DOCTYPE html> <! NEW > <! - www pageHead.vm -> <! - mode=www -> <! - URI=/sports/soccer-fans-stampede-south-african-stadium-nigeria-north-korea-world-cup-warmup-article-1.179211 -> <! - Host=www.nydailynews.com -> <! [if IE 8]><html class="ie8" lang="en" itemscope itemtype="http://schema.org/"><![endif] > <! [if IE 9]><html class="ie9" lang="en" itemscope itemtype="http://schema.org/"><![endif] > <! [if IE 10]><html class="ie10" lang="en" itemscope itemtype="http://schema.org/"><![endif] > <! [if IE 11]><html class="ie11" lang="en" itemscope itemtype="http://schema.org/"><![endif] > <! [if !IE]><! > <html lang="en" itemscope itemtype="http://schema.org/"> <! <![endif] > <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"/> <meta http-equiv="X-UA-Compatible" content="IE=edge"/> <title>Fans stampede outside South African stadium - NY Daily News</title> <meta name="nydn_section" content="Sports"/> <meta name="viewport" content="width=1070, maximum-scale=1.0"/> <meta property="fb:app_id" content="107464888913"/> <meta property="fb:admins" content="1594068001"/> <meta property="og:site_name" content="NY Daily News"/> <meta property="article:publisher" content="https://www.facebook.com/thenewyorkdailynews"/> <meta name="msvalidate.01" content="02916AAC0DA8B068EFE01D721E03ED7E"/> <meta name="twitter:card" content="summary"> <meta name="twitter:site" content="@nydailynews"> <meta property="twitter:url" content="http://www.nydailynews.com/sports/soccer-fans-stampede-south-african-stadium-nigeria-north-korea-world-cup-warmup-article-1.179211"/> <meta property="twitter:title" content="Fans stampede outside South African stadium"/> <meta property="twitter:description" content="Thousands of fans stampeded outside the stadium gates of a World Cup warmup game Sunday, five days before the start of soccer's showcase event. Several fans could be seen falling under the crush of people, many wearing Nigeria jerseys."/> <meta id="og_title" property="og:title" content="Fans stampede outside South African stadium"/> <meta property="og:type" content="article"/> <meta id="og_url" property="og:url" content="http://www.nydailynews.com/sports/soccer-fans-stampede-south-african-stadium-nigeria-north-korea-world-cup-warmup-article-1.179211"/> <meta id="og_image" property="og:image" content="http://assets.nydailynews.com/polopoly_fs/1.179213!/img/httpImage/image.jpg_gen/derivatives/landscape_1200/alg-stampede-johannesburg-jpg.jpg"/> <meta id="og_description" property="og:description" content="Thousands of fans stampeded outside the stadium gates of a World Cup warmup game Sunday, five days before the start of soccer's showcase event. Several fans could be seen falling under the crush of people, many wearing Nigeria jerseys."/> <meta name="description" content="Thousands of fans stampeded outside the stadium gates of a World Cup warmup game Sunday, five days before the start of soccer's showcase event. Several fans could be seen falling under the crush of people, many wearing Nigeria jerseys."/> <meta name="nydn_byline" content="MICHAEL LEWIS"/> <link rel="stylesheet" type="text/css" href="http://assets.nydailynews.com/nydn/c/nydn.css?r=20120405mk1Bh"> <meta name="parsely-title" content="Fans stampede outside South African stadium"/> <meta name="parsely-link" content="http://www.nydailynews.com/sports/soccer-fans-stampede-south-african-stadium-nigeria-north-korea-world-cup-warmup-article-1.179211"/> <meta name="parsely-type" content="article"/> <meta name="parsely-image-url" content="http://assets.nydailynews.com/polopoly_fs/1.179213!/img/httpImage/image.jpg_gen/derivatives/landscape_1200/alg-stampede-johannesburg-jpg.jpg"/> <meta name="parsely-pub-date" content="2010-06-06T15:01:04"/> <meta name="parsely-section" content="Sports"/> <meta name="parsely-author" content="Michael Lewis"/> <link rel="stylesheet" type="text/css" href="http://assets.nydailynews.com/nydn/c/article.css?r=20120405mk1Bh"> <meta name="robots" content="NOARCHIVE"/> <link rel="canonical" href="http://www.nydailynews.com/sports/soccer-fans-stampede-south-african-stadium-nigeria-north-korea-world-cup-warmup-article-1.179211"> <link rel="alternate" media="handheld" href="http://m.nydailynews.com/sports/soccer-fans-stampede-south-african-stadium-nigeria-north-korea-world-cup-warmup-article-1.179211"> <link rel="alternate" media="only screen and (max-width: 640px)" href="http://m.nydailynews.com/sports/soccer-fans-stampede-south-african-stadium-nigeria-north-korea-world-cup-warmup-article-1.179211"/> <script type="text/javascript" src="http://assets.nydailynews.com/nydn/js/nydn-pack-20140101.js?r=20120405mk1Bh"></script> <script type="text/javascript" src="http://assets.nydailynews.com/nydn/js/article2014.js?r=20120405mk1Bh"></script> <! [if lt IE 9]><script src="http://html5shiv.googlecode.com/svn/trunk/html5.js"></script><![endif] >
<link rel="alternate" type="application/rss+xml" title="NYDN Rss" href="http://feeds.nydailynews.com/nydnrss"> <link rel="alternate" type="application/rss+xml" title="Sports Rss" href="http://feeds.feedburner.com/nydnrss/sports">
..........................
</code></pre>
<p>如果要多次尝试相同的url，可以使用try/除了捕获<code>requests.ConnectionError</code>：</p>
<pre><code>def tries(path, url, i, max_tries=1):
for ty in range(1, max_tries+1):
try:
req = requests.get(url)
page_content = req.content
with open('{}{}.html'.format(path, i), 'w') as fid:
fid.write(page_content)
break
except requests.exceptions.ConnectionError as e:
print("Error {} for try {}".format(e, ty))
for ind, url in enumerate(urls):
tries(path, url, ind, 4)
</code></pre>
