<p>可以使用<code>ast.literal_eval</code>将数据提取到python列表中。我做了一个简单的函数<code>find_airport()</code>,在这里提供数据和机场名称,并返回它在机场1和机场2的次数:</p>
<pre><code>from bs4 import BeautifulSoup
import requests
import re
from ast import literal_eval
from pprint import pprint
airlines = ['kl-klm']
headers = {"Host":"www.flightradar24.com",
"Accept":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8",
"Accept-Encoding":"gzip,deflate,br",
"User-agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.2526.80 Safari/537.36"}
def find_aiport(data, name):
airport_1, airport_2 = 0, 0
for d in data:
if d['airport1']['name'] == name:
airport_1 += 1
if d['airport2']['name'] == name:
airport_2 += 1
return airport_1, airport_2
for a in airlines:
url = 'https://www.flightradar24.com/data/airlines/' + a + '/routes'
page = requests.get(url, headers=headers)
soup = BeautifulSoup(page.text, 'lxml')
m = re.search(r'(?<=arrRoutes=)\[\{(.*?)\}\]', soup.text)
l = literal_eval(m[0])
pprint(l)
print(find_aiport(l, 'Amsterdam Schiphol Airport'))
</code></pre>
<p>印刷品:</p>
<pre><code>[{'airport1': {'country': 'Denmark',
'iata': 'AAL',
'icao': 'EKYT',
'lat': 57.092781,
'lon': 9.849164,
'name': 'Aalborg Airport'},
'airport2': {'country': 'Netherlands',
'iata': 'AMS',
'icao': 'EHAM',
'lat': 52.308609,
'lon': 4.763889,
'name': 'Amsterdam Schiphol Airport'}},
{'airport1': {'country': 'United Kingdom',
'iata': 'ABZ',
'icao': 'EGPD',
'lat': 57.201939,
'lon': -2.19777,
'name': 'Aberdeen International Airport'},
'airport2': {'country': 'Netherlands',
'iata': 'AMS',
'icao': 'EHAM',
'lat': 52.308609,
'lon': 4.763889,
'name': 'Amsterdam Schiphol Airport'}},
...and so on
</code></pre>
<p>最后:</p>
<pre><code>(147, 146)
</code></pre>
<p>阿姆斯特丹史基浦机场</p>