硒上蜘蛛的框架
beryllium的Python项目详细描述
铍包
这是铍包。你可以用beryllium来写你的精益。
安装
pip install beryllium
铍演示
# -*- coding: utf-8 -*-fromberylliumimportBerylliumimporttimefromberylliumimportFieldList,Field,FieldName,Page,ListCssSelector,Mongodb,NextPageCssSelectorSetup,PageFuncbery=Beryllium()bery.driver=bery.get_driver()bery.fast_get_page("https://www.baidu.com")time.sleep(1)bery.until_send_text_by_css_selector(css_selector="#kw",text="杭州")bery.until_send_enter_by_css_selector(css_selector="#kw")time.sleep(2)fieldlist_shop=FieldList(Field(field_name=FieldName.SHOP_NAME,css_selector="h3"),)page_shop=Page(name="shop_page",field_list=fieldlist_shop,list_css_selector=ListCssSelector(list_css_selector="#content_left > div.result.c-container"))bery.until_click_no_next_page_by_css_selector(next_page_setup=NextPageCssSelectorSetup(page=page_shop,css_selector="#page > a.n",main_page_func=PageFunc(func=bery.from_page_get_data_list,page=page_shop)))
演示
展望
致力于创建交互式爬虫程序库。我希望有同样愿望的程序员加入我的开发。你可以通过电子邮件联系我：wujunleiwang@gmail.com
欢迎加入QQ群-->： 979659372
