news_spider
所属分类:数据采集/爬虫
开发工具:HTML
文件大小:476KB
下载次数:0
上传日期:2019-08-24 07:33:32
上 传 者:
sh-1993
说明: severless 新闻爬虫
(Severless news crawler)
文件列表:
__init__.py (378, 2019-08-24)
__main__.py (0, 2019-08-24)
ajax.py (1257, 2019-08-24)
api.py (3864, 2019-08-24)
app.py (5111, 2019-08-24)
config.py (1259, 2019-08-24)
depend.txt (91, 2019-08-24)
doc (0, 2019-08-24)
doc\ctx.md (651, 2019-08-24)
doc\res.json (810, 2019-08-24)
doc\tv (0, 2019-08-24)
doc\tv\star.json (5589, 2019-08-24)
doc\tv\star1.json (11608, 2019-08-24)
doc\tv\tv.json (5878, 2019-08-24)
doc\tv\tv1.json (6675, 2019-08-24)
env (0, 2019-08-24)
env\__init__.py (328, 2019-08-24)
index.py (3484, 2019-08-24)
mongo.py (2507, 2019-08-24)
parser (0, 2019-08-24)
parser\__init__.py (31, 2019-08-24)
parser\bbc (0, 2019-08-24)
parser\bbc\bbc.html (321343, 2019-08-24)
parser\bbc\bbc.py (139, 2019-08-24)
parser\facebook (0, 2019-08-24)
parser\facebook\fb.html (59632, 2019-08-24)
parser\hack_news (0, 2019-08-24)
parser\hack_news\__pycache__ (0, 2019-08-24)
parser\hack_news\__pycache__\hack_news_parser.cpython-38.pyc (2088, 2019-08-24)
parser\hack_news\hack_news.html (79334, 2019-08-24)
parser\hack_news\hack_news_parser.py (1562, 2019-08-24)
parser\huanqiu (0, 2019-08-24)
parser\huanqiu\huanqiu.json (304451, 2019-08-24)
parser\huanqiu\main.py (858, 2019-08-24)
parser\huanqiu\topnews.xml (314304, 2019-08-24)
parser\infoq (0, 2019-08-24)
parser\infoq\infoq.html (361079, 2019-08-24)
... ...
# severless 新闻爬虫
## web
[news](https://douban.qing.workers.dev/)
## 站点
[hackernews][1]
[sputniknews][2]
[reuters][3]
[环球网][4]
[微博热搜][5]
[1]: http://hackernews.betacat.io/
[2]: http://sputniknews.cn/
[3]: http://cn.reuters.com/
[4]: http://www.huanqiu.com/
[5]: https://www.enlightent.cn/research/rank/weiboSearchRank
## 文件路径
[依赖列表](./depend.txt)
[安装包](./vendor)
[入口](./index.py)
[爬虫](./spider.py)
[解析](./parser)
## 接口
[base](https://service-75ph8ybo-1252957949.ap-hongkong.apigateway.myqcloud.com/release/weibo/)
+ /hack_news
+ /sputni
+ /vbc?n=1
+ /huanqiu?n=1
+ /news
+ https://service-75ph8ybo-1252957949.ap-hongkong.apigateway.myqcloud.com/release/weibo/hack_news
+ https://service-75ph8ybo-1252957949.ap-hongkong.apigateway.myqcloud.com/release/weibo/sputni
+ https://service-75ph8ybo-1252957949.ap-hongkong.apigateway.myqcloud.com/release/weibo/vbc?n=2
+ https://service-75ph8ybo-1252957949.ap-hongkong.apigateway.myqcloud.com/release/weibo/huanqiu?n=1
+ https://service-75ph8ybo-1252957949.ap-hongkong.apigateway.myqcloud.com/release/weibo/news
```shell
#安装
./setup i
#部署到腾讯云
./setup
```
近期下载者:
相关文件:
收藏者: