crawler
所属分类：数据采集/爬虫
开发工具：GO
文件大小：17KB
下载次数：0
上传日期：2017-04-05 08:52:09
上 传 者：
sh-1993
说明： Go编程语言网络爬虫框架。
(Go programming language web crawler framework.)
文件列表:
.travis.yml (27, 2017-04-05)
LICENSE (1057, 2017-04-05)
core (0, 2017-04-05)
core\commons (0, 2017-04-05)
core\commons\controller (0, 2017-04-05)
core\commons\controller\controller.go (105, 2017-04-05)
core\commons\controller\goroutineController.go (586, 2017-04-05)
core\commons\page (0, 2017-04-05)
core\commons\page\page.go (6153, 2017-04-05)
core\commons\request (0, 2017-04-05)
core\commons\request\request.go (1887, 2017-04-05)
core\commons\result (0, 2017-04-05)
core\commons\result\resultItems.go (806, 2017-04-05)
core\commons\task (0, 2017-04-05)
core\commons\task\task.go (226, 2017-04-05)
core\commons\utils (0, 2017-04-05)
core\commons\utils\utils.go (2398, 2017-04-05)
core\crawler (0, 2017-04-05)
core\crawler\crawler.go (6509, 2017-04-05)
core\downloader (0, 2017-04-05)
core\downloader\downloader.go (196, 2017-04-05)
core\downloader\httpDownloader.go (6025, 2017-04-05)
core\pipeline (0, 2017-04-05)
core\pipeline\consolePipeline.go (661, 2017-04-05)
core\pipeline\filePipeline .go (863, 2017-04-05)
core\pipeline\pipeline.go (734, 2017-04-05)
core\pipeline\pipelineCollector.go (565, 2017-04-05)
core\processor (0, 2017-04-05)
core\processor\pageProcessor.go (296, 2017-04-05)
core\scheduler (0, 2017-04-05)
core\scheduler\queueScheduler.go (1201, 2017-04-05)
core\scheduler\scheduler.go (331, 2017-04-05)
example (0, 2017-04-05)
example\pearvideo (0, 2017-04-05)
example\pearvideo\main.go (2240, 2017-04-05)
近期下载者：
相关文件：
收藏者：