刮取需要登录的网站

2024-09-30 06:18:18 发布

您现在位置:Python中文网/ 问答频道 /正文

我正在尝试使用python来删除这个网站:http://www.ivolatility.com/options.j?ticker=SPX&lhid=141519256。在

问题是,有登录和有一些问题,以刮取信息。我尝试了这个代码,但是我没有得到信息。在

import requests
from bs4 import BeautifulSoup

username = 'user'
password = 'pass'
scrape_url = 'http://www.ivolatility.com/options.j?ticker=SPX&lhid=141519256'

login_url = 'https://www.ivolatility.com/login.j'
login_info = {'email': username,'password': password}

#Start session.
session = requests.session()

#Login using your authentication information.
session.post(url=login_url, data=login_info)

#Request page you want to scrape.
url = session.get(url=scrape_url)

soup = BeautifulSoup(url.content, 'html.parser')

Tags: importcom信息httpurlsessionwwwlogin

热门问题