pholcus
所属分类：数据采集/爬虫
开发工具：GO
文件大小：7081KB
下载次数：0
上传日期：2019-07-10 06:44:26
上 传 者：
sh-1993
说明： Pholcus(幽灵蛛)是一款纯Go语言编写的支持分布式的高并发、重量级爬虫软件,定位于互联网数据采集,为具备一定Go或JS编程基础的人提供一个只需关注规则定制的功能强大的爬虫工具。
(Pholcus (Phantom Spider) is a distributed, high concurrency, heavyweight crawler software written in pure Go language, positioned for internet data collection, providing a powerful crawler tool for those with a certain Go or JS programming foundation that only needs to focus on rule customization.)
文件列表:
LICENSE (11338, 2019-04-30)
app (0, 2019-04-30)
app\aid (0, 2019-04-30)
app\aid\history (0, 2019-04-30)
app\aid\history\failure.go (3252, 2019-04-30)
app\aid\history\history.go (8338, 2019-04-30)
app\aid\history\success.go (2947, 2019-04-30)
app\aid\proxy (0, 2019-04-30)
app\aid\proxy\host.go (586, 2019-04-30)
app\aid\proxy\proxy.go (6461, 2019-04-30)
app\app.go (21568, 2019-04-30)
app\crawler (0, 2019-04-30)
app\crawler\crawler.go (4834, 2019-04-30)
app\crawler\crawlerpool.go (2189, 2019-04-30)
app\crawler\spiderqueue.go (2022, 2019-04-30)
app\distribute (0, 2019-04-30)
app\distribute\interface.go (255, 2019-04-30)
app\distribute\master_api.go (925, 2019-04-30)
app\distribute\slave_api.go (671, 2019-04-30)
app\distribute\task.go (1040, 2019-04-30)
app\distribute\taskjar.go (711, 2019-04-30)
app\downloader (0, 2019-04-30)
app\downloader\downloader.go (427, 2019-04-30)
app\downloader\downloader_surfer.go (1012, 2019-04-30)
app\downloader\request (0, 2019-04-30)
app\downloader\request\request.go (8790, 2019-04-30)
app\downloader\request\request_test.go (1125, 2019-04-30)
app\downloader\request\temp.go (944, 2019-04-30)
app\downloader\surfer (0, 2019-04-30)
app\downloader\surfer\agent (0, 2019-04-30)
app\downloader\surfer\agent\agent.go (10021, 2019-04-30)
app\downloader\surfer\agent\agent_bsd.go (429, 2019-04-30)
app\downloader\surfer\agent\agent_linux.go (727, 2019-04-30)
app\downloader\surfer\agent\agent_linux_arm.go (728, 2019-04-30)
app\downloader\surfer\agent\agent_windows.go (378, 2019-04-30)
app\downloader\surfer\example (0, 2019-04-30)
app\downloader\surfer\example\example.go (2419, 2019-04-30)
... ...
The MongoDB driver for Go
-------------------------
Please go to [http://labix.org/mgo](http://labix.org/mgo) for all project details.
近期下载者：
相关文件：
收藏者：