看门狗密切关注世界的变化。阅读更多:https://github.com/ClericPy/watchdogs。
watchdogs的Python项目详细描述
watchdogs
关注网络世界的变化。在
例如post articles
/news on the web portal
/server api health
/binge-watching
/steam price fluctuation
/github events
/updates of comic and novel
,等等。。。在
简介
- 这是一个基于fastapi,databases,uniparser,torequests的web应用程序。在
- 通过pip顺利部署它:
pip install -U watchdogs;python3 -m watchdogs
- 使用webui创建一个新的爬虫程序很简单,不像以前编写重复代码的方式。在
- 所有的爬虫程序都在异步环境中运行。在
- 几乎所有元素都有一个title属性来描述webui中的特性,这意味着文档位于UI之上。在
- 把你的手从重复刷新页面的浏览器中解放出来。
- 使用RSS提醒扩展订阅更改事件,例如Feedbro或RSS提要阅读器。在
- 实现继承自
watchdogs.callbacks.Callback
的类。在
使用
- 在
在pip install -U watchdogs
- 在
在python -m watchdogs
- 在
在Open the browser: http://127.0.0.1:9901
argeh3命令行>python -m watchdogs -- -h
- db_url:
sqlite / mysql / postgresql(not test) url, which databases supports. Defaults to 'sqlite:///{HOME_PATH}/watchdogs/storage.sqlite'
- password:
init password, if null can be set on the first visit on web.
- mute\u std_日志:
remove stdout log for clean stream
- mute_file_日志:
ignore file log located at {HOME_PATH}/watchdogs folder.
- md5\u盐:
md5_salt for custom md5(password) / md5(rss_tag)
- config\u dir:
config dir to save the logs and config files, if using sqlite include sqlite file. defaults to {HOME_PATH}/watchdogs
- use\u default_cdn:
If Config.cdn_urls not set, and use_default_cdn is True, will use online js/css cdn links from staticfile.org.
- **uvicorn_kwargs:
uvicorn startup kwargs, such as port, host. Which can be set like: python -m watchdogs --port=9999 --host=127.0.0.1 --access-log=False
快速开始创建新任务
python -m watchdogs -- -h
sqlite / mysql / postgresql(not test) url, which databases supports. Defaults to 'sqlite:///{HOME_PATH}/watchdogs/storage.sqlite'
init password, if null can be set on the first visit on web.
remove stdout log for clean stream
ignore file log located at {HOME_PATH}/watchdogs folder.
md5_salt for custom md5(password) / md5(rss_tag)
config dir to save the logs and config files, if using sqlite include sqlite file. defaults to {HOME_PATH}/watchdogs
If Config.cdn_urls not set, and use_default_cdn is True, will use online js/css cdn links from staticfile.org.
uvicorn startup kwargs, such as port, host. Which can be set like: python -m watchdogs --port=9999 --host=127.0.0.1 --access-log=False
Web用户界面
- 欢迎页面(任务页面)。在
Here you can see all the tasks meta, goto RSS / Mobile Lite Page, and do some operations to the tasks.
- 新建任务页。在
Here based on the latest uniparser web app, to create new rules and also tasks.
- 规则页面。在
Do some operations for the rules.
- API页面。在
Based on fastapi
/docs
which is generated automatically.
- 移动页面(精简视图)。在
For mobile phone to glimpse the latest result for the current 30 tasks.
- 项目
标签: