我不熟悉使用selenium python进行刮片。因此,我可以检索一些数据,但我希望它以表格形式显示在网页上:
以下是我到目前为止的情况:
url='https://definitivehc.maps.arcgis.com/home/item.html?id=1044bb19da8d4dbfb6a96eb1b4ebf629&view=list&showFilters=false#data'
browser = webdriver.Chrome(r"C:\task\chromedriver")
browser.get(url)
time.sleep(25)
rows_in_table = browser.find_elements_by_xpath('//table[@class="dgrid-row-table"]//tr[th or td]')
for element in rows_in_table:
print(element.text.replace('\n', ''))
结果片段:
Hospital NameHospital TypeCityState AbrvZip CodeCounty NameState Name
Phoenix VA Health Care System (AKA Carl T Hayden VA Medical Center)VA HospitalPhoenixAZ85012MaricopaArizona040130401362620000.001
Southern Arizona VA Health Care SystemVA HospitalTucsonAZ85723PimaArizona04019040192952952202.002
VA Central California Health Care SystemVA HospitalFresnoCA93703FresnoCalifornia060190601954542202.003
VA Connecticut Healthcare System - West Haven Campus (AKA West Haven VA Medical Center)VA HospitalWest HavenCT6516New HavenConnecticut09009090092162161102.004
我将非常感谢专家在这方面的帮助。谢谢
这是@Andrej回答的更新版本,此代码将下载表格,并将其保存为excel文档,而不是打印
我试过了,并上传了excel表格HERE(LINK TO EXCEL SHEET)
使用Javascript动态加载数据。您可以使用
requests
模块模拟这些请求:打印所有6624条记录:
相关问题 更多 >
编程相关推荐