2024-10-01 09:19:19 发布
网友
我试图使用beautifulsoupfind方法来获取this page,但在HTML页面中找不到表值。我发现,当我通过一个内部API加载页面时,网站正在立即生成数据。有什么帮助吗??在
提前谢谢。在
这对我有用。我不得不在开发工具中到处找,但还是找到了
import requests geturl=r'https://www.barchart.com/futures/quotes/CLJ19/all-futures' apiurl=r'https://www.barchart.com/proxies/core-api/v1/quotes/get' getheaders={ 'accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8', 'accept-encoding': 'gzip, deflate, br', 'accept-language': 'en-US,en;q=0.9', 'cache-control': 'max-age=0', 'upgrade-insecure-requests': '1', 'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.119 Safari/537.36' } getpay={ 'page': 'all' } s=requests.Session() r=s.get(geturl,params=getpay, headers=getheaders) headers={ 'accept': 'application/json', 'accept-encoding': 'gzip, deflate, br', 'accept-language': 'en-US,en;q=0.9', 'referer': 'https://www.barchart.com/futures/quotes/CLJ19/all-futures?page=all', 'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.119 Safari/537.36', 'x-xsrf-token': s.cookies.get_dict()['XSRF-TOKEN'] } payload={ 'fields': 'symbol,contractSymbol,lastPrice,priceChange,openPrice,highPrice,lowPrice,previousPrice,volume,openInterest,tradeTime,symbolCode,symbolType,hasOptions', 'list': 'futures.contractInRoot', 'root': 'CL', 'meta': 'field.shortName,field.type,field.description', 'hasOptions': 'true', 'raw': '1' } r=s.get(apiurl,params=payload,headers=headers) j=r.json() print(j) >{'count': 108, 'total': 108, 'data': [{'symbol': 'CLY00', 'contractSymbol': 'CLY00 (Cash)', ........
这对我有用。我不得不在开发工具中到处找,但还是找到了
相关问题 更多 >
编程相关推荐