文件列表:

AUTHORS (28, 2013-10-17)
LICENSE (566, 2013-10-17)
bin (0, 2013-10-17)
bin\coca.py (7566, 2013-10-17)
bin\start_master.py (2026, 2013-10-17)
bin\start_worker.py (2683, 2013-10-17)
cola (0, 2013-10-17)
cola\__init__.py (928, 2013-10-17)
cola\conf (0, 2013-10-17)
cola\conf\main.yaml (461, 2013-10-17)
cola\core (0, 2013-10-17)
cola\core\__init__.py (577, 2013-10-17)
cola\core\bloomfilter (0, 2013-10-17)
cola\core\bloomfilter\__init__.py (5743, 2013-10-17)
cola\core\bloomfilter\hashtype.py (1666, 2013-10-17)
cola\core\config.py (2355, 2013-10-17)
cola\core\dedup.py (1139, 2013-10-17)
cola\core\errors.py (944, 2013-10-17)
cola\core\extractor (0, 2013-10-17)
cola\core\extractor\__init__.py (717, 2013-10-17)
cola\core\extractor\preprocess.py (4420, 2013-10-17)
cola\core\extractor\readability.py (14982, 2013-10-17)
cola\core\extractor\utils.py (1987, 2013-10-17)
cola\core\logs.py (4440, 2013-10-17)
cola\core\mq (0, 2013-10-17)
cola\core\mq\__init__.py (6349, 2013-10-17)
cola\core\mq\client.py (1222, 2013-10-17)
cola\core\mq\hash_ring.py (5573, 2013-10-17)
cola\core\mq\node.py (8889, 2013-10-17)
cola\core\opener.py (4993, 2013-10-17)
cola\core\parsers.py (984, 2013-10-17)
cola\core\rpc.py (2365, 2013-10-17)
cola\core\unit.py (1325, 2013-10-17)
cola\core\urls.py (2347, 2013-10-17)
cola\core\utils.py (2568, 2013-10-17)
cola\core\zip.py (2423, 2013-10-17)
cola\job (0, 2013-10-17)
... ...

cola ==== Cola is a distributed crawling framework. Why named cola? hmm, I like cola, and cola sounds a bit like crawler. ##Quick Start * download or clone source code, add cola to python path. * start cola master: /path/to/cola/bin/start_master.py * start cola worker: /path/to/cola/bin/start_worker.py --master [ip address] * run job: /path/to/cola/bin/coca.py -runLocalJob /path/to/cola/contrib/wiki ##Tips * [Chinese docs(wiki)](https://github.com/chineking/cola/wiki). * I am trying my best to make cola stable. * Cola can also run in a single machine, you don't need to start master, workers and so on. Everything is simple!

近期下载者：

相关文件：

评论：[我要评论] [举报此文件]

收藏者：