larbin-2.6.3
所属分类：搜索引擎
开发工具：Unix_Linux
文件大小：1516KB
下载次数：7
上传日期：2013-10-09 10:04:18
上 传 者：
hu21060311
说明： 网络爬虫，爬取效率高，每天可爬去500万页面，同时还可定制爬取图片和音频文件
(Web crawler, crawling, high efficiency, climbing 5 million pages per day, but can also customize crawling pictures and audio files)
文件列表:
larbin-2.6.3 (0, 2013-03-04)
larbin-2.6.3\save (0, 2013-03-04)
larbin-2.6.3\src (0, 2013-03-04)
larbin-2.6.3\doc (0, 2003-07-11)
larbin-2.6.3\adns (0, 2013-03-04)
larbin-2.6.3\src\utils (0, 2013-03-04)
larbin-2.6.3\src\interf (0, 2013-03-04)
larbin-2.6.3\src\fetch (0, 2013-03-04)
larbin-2.6.3\config.make (0, 2013-03-04)
larbin-2.6.3\options.h (3197, 2013-03-04)
larbin-2.6.3\larbin (3066110, 2013-03-04)
larbin-2.6.3\.depend (0, 2013-03-04)
larbin-2.6.3\config.h (0, 2013-03-04)
larbin-2.6.3\configure (1054, 2002-05-19)
larbin-2.6.3\CREDITS (1178, 2002-03-05)
larbin-2.6.3\COPYING (18007, 2002-01-02)
larbin-2.6.3\Makefile (469, 2002-04-15)
larbin-2.6.3\larbin.conf (1669, 2013-03-04)
larbin-2.6.3\src\larbin.make (1194, 2013-03-04)
larbin-2.6.3\src\larbin (0, 2013-03-04)
larbin-2.6.3\src\main.o (0, 2013-03-04)
larbin-2.6.3\src\global.o (0, 2013-03-04)
larbin-2.6.3\src\config.h (29, 2013-03-04)
larbin-2.6.3\src\options.h (3197, 2013-03-04)
larbin-2.6.3\src\.depend (949, 2013-03-04)
larbin-2.6.3\src\types.h (2398, 2002-03-17)
larbin-2.6.3\src\main.cc (4132, 2002-03-23)
larbin-2.6.3\src\Makefile (938, 2013-03-04)
larbin-2.6.3\src\global.h (5609, 2003-07-09)
larbin-2.6.3\src\global.cc (9740, 2003-07-09)
larbin-2.6.3\doc\use-eng.html (3149, 2002-03-04)
larbin-2.6.3\doc\l-fr.jpg (503, 2002-01-02)
larbin-2.6.3\doc\l-en.jpg (1249, 2002-01-02)
larbin-2.6.3\doc\index.html (3702, 2002-01-23)
larbin-2.6.3\doc\index-eng.html (3220, 2002-01-23)
larbin-2.6.3\doc\download.html (8696, 2003-07-10)
larbin-2.6.3\doc\custom-eng.html (10312, 2003-07-09)
larbin-2.6.3\adns\libadns.a (1032376, 2013-03-04)
larbin-2.6.3\adns\check.o (0, 2013-03-04)
... ...
******************************************************************
Larbin web crawler by Sebastien Ailleret
******************************************************************
******************
Table of content :
- Compiling
- Configuring
- Running
- Supported platforms
- Contact
***********
Compiling :
have a look at options.h to choose options you need
./configure
gmake
*************
Configuring :
see larbin.conf. Please be sure to specify your mail
There is also some documentation in the doc directory in html format
*********
Running :
Be sure you did the configuration
./larbin
to see how it works, http://localhost:8081/
*********************
Supported platforms :
Larbin has mainly been developped under Linux
I've tested larbin with success on Linux and freeBSD.
It probably won't compile right out of the box on any other platform,
but i'll work on it for future versions. Please report success or
failure on any platform.
*********
Contact :
mailto:sebastien@ailleret.com
http://www.ailleret.com/
近期下载者：
相关文件：
收藏者：