Weibo
所属分类:其他
开发工具:Python
文件大小:7KB
下载次数:0
上传日期:2019-03-04 17:46:25
上 传 者:
小小诗童
说明: 实现了新浪微博的用户及其粉丝关注列表和微博信息的爬取,还对接了Cookies池和代理池来处理反爬虫。
(It has realized the crawling of Sina Weibo users and their fans' attention lists and Weibo information, and also docked the cookie pool and proxy pool to handle anti-crawlers.)
文件列表:
scrapy.cfg (254, 2018-01-25)
weibo (0, 2018-01-25)
weibo\__init__.py (0, 2018-01-25)
weibo\items.py (1071, 2018-01-25)
weibo\middlewares.py (2061, 2018-01-25)
weibo\pipelines.py (3136, 2018-01-25)
weibo\settings.py (3913, 2018-01-25)
weibo\spiders (0, 2018-01-25)
weibo\spiders\__init__.py (161, 2018-01-25)
weibo\spiders\weibocn.py (6463, 2018-01-25)
近期下载者:
相关文件:
收藏者: