python中Biwenger的Html请求

import requests shots_url = "https://biwenger.as.com/user/naranjas-4537694" response = requests.get(shots_url) response.raise_for_status() # raise exception if invalid response print(response.text)

<!doctype html><meta charset=utf-8><title>Biwenger</title><base href=/ ><meta...<div class=body><p>Looks like the browser you're using is not compatible with Biwenger :(<p>We recommend using <a href=http://www.google.com/chrome/ target=_blank>Google Chrome</a>...</script>

2条回答

网友

1楼 · 编辑于 2024-10-02 10:18:34

数据通过JavaScript/JSON动态加载。当您打开Firefox/Chrome开发者工具-网络选项卡时，您将看到页面在哪里发出请求）。你知道吗

此示例将获得有关用户播放器的信息：

import re
import json
import requests
from pprint import pprint
from bs4 import BeautifulSoup


user_data_url = 'https://biwenger.as.com/api/v2/user/4537694?fields=*,account(id),players(id,owner),lineups(round,points,count,position),league(id,name,competition,mode,scoreID),market,seasons,offers,lastPositions'
all_data_url = 'https://cf.biwenger.com/api/v2/competitions/la-liga/data?lang=en&score=1&callback=jsonp_xxx' # < - check @αԋɱҽԃ αмєяιcαη answer, it's possible to do it without callback= parameter

response = requests.get(all_data_url)
data = json.loads( re.findall(r'jsonp_xxx\((.*)\)', response.text)[0] )

user_data = requests.get(user_data_url).json()

# pprint(user_data)  # <  uncomment this to see user data
# pprint(data)       # <  uncomment this to see data about all players

for p in user_data['data']['players']:
    pprint(data['data']['players'][str(p['id'])])
    print('-' * 80)

印刷品：

    {'fantasyPrice': 22000000,
     'fitness': [10, 2, 2, 2, -2],
     'id': 599,
     'name': 'Pedro León',
     'playedAway': 8,
     'playedHome': 8,
     'points': 38,
     'pointsAway': 16,
     'pointsHome': 22,
     'pointsLastSeason': 16,
     'position': 3,
     'price': 1400000,
     'priceIncrement': 60000,
     'slug': 'pedro-leon',
     'status': 'ok',
     'teamID': 76}
                                            
    {'fantasyPrice': 9000000,
     'fitness': [None, 'injured', 'doubt', None, 2],
     'id': 1093,
     'name': 'Javi López',
     'playedAway': 4,
     'playedHome': 2,
     'points': 10,
     'pointsAway': 6,
     'pointsHome': 4,
     'pointsLastSeason': 77,
     'position': 2,
     'price': 210000,
     'priceIncrement': 0,
     'slug': 'javier-lopez',
     'status': 'ok',
     'teamID': 7}
                                            

... and so on.

网友

2楼 · 编辑于 2024-10-02 10:18:34

import requests
import csv

r = requests.get(
    "https://cf.biwenger.com/api/v2/competitions/la-liga/data?lang=en&score=1").json()

data = []
for k, v in r['data']['players'].items():
    data.append(v.values())

with open('output.csv', 'w', newline="", encoding="UTF-8") as f:
    writer = csv.writer(f)
    writer.writerow(v.keys())
    writer.writerows(data)

输出：Click Here

相关问题更多 >

编程相关推荐

热门问题

热门文章