sipderyang
所属分类：Java编程
开发工具：Java
文件大小：52KB
下载次数：181
上传日期：2006-09-27 23:52:46
上 传 者：
yangzhancheng
说明： 是个java写的sipder,非常不错!能承受很大的压力,每天采集的数量在10000万
(is written in java sipder, very good! Can withstand a great deal of pressure. Acquisition of daily volume in 100 million)
文件列表:
cn\yicha\subject\spider\Constants.java (475, 2005-12-01)
cn\yicha\subject\spider\datacnnect.java (186, 2006-05-17)
cn\yicha\subject\spider\DownloadQueue.java (5980, 2005-12-01)
cn\yicha\subject\spider\SiteConfig.java (1811, 2005-12-01)
cn\yicha\subject\spider\Spider.java (15298, 2005-12-01)
cn\yicha\subject\spider\SpiderConfig.java (24203, 2006-05-04)
cn\yicha\subject\spider\URLObject.java (10530, 2006-02-16)
cn\yicha\subject\spider\URLToDownload.java (9959, 2006-02-16)
cn\yicha\subject\spider\writer\NonPageLinkLog.java (3180, 2005-12-30)
cn\yicha\subject\spider\writer\CVS\Entries (53, 2006-02-16)
cn\yicha\subject\spider\writer\CVS\Repository (39, 2005-12-01)
cn\yicha\subject\spider\writer\CVS\Root (43, 2005-12-01)
cn\yicha\subject\spider\wapsite\GameSite.java (1571, 2006-05-03)
cn\yicha\subject\spider\wapsite\GameSiteFetcher.java (2052, 2006-05-03)
cn\yicha\subject\spider\wapsite\SpecialSiteList.java (1131, 2005-12-01)
cn\yicha\subject\spider\wapsite\CVS\Entries (155, 2006-02-16)
cn\yicha\subject\spider\wapsite\CVS\Repository (40, 2005-12-01)
cn\yicha\subject\spider\wapsite\CVS\Root (43, 2005-12-01)
cn\yicha\subject\spider\ui\FileSpider.java (4431, 2006-05-02)
cn\yicha\subject\spider\ui\CVS\Entries (49, 2005-12-01)
cn\yicha\subject\spider\ui\CVS\Repository (35, 2005-12-01)
cn\yicha\subject\spider\ui\CVS\Root (43, 2005-12-01)
cn\yicha\subject\spider\store\AnchorProperty.java (1156, 2005-12-01)
cn\yicha\subject\spider\store\ExtractAnchor.java (12308, 2005-12-09)
cn\yicha\subject\spider\store\HeaderContent.java (1016, 2005-12-01)
cn\yicha\subject\spider\store\ParseUrl.java (1396, 2005-12-01)
cn\yicha\subject\spider\store\StoreDiffUrl.java (2294, 2005-12-01)
cn\yicha\subject\spider\store\URLStore.java (2511, 2005-12-01)
cn\yicha\subject\spider\store\CVS\Entries (302, 2006-02-16)
cn\yicha\subject\spider\store\CVS\Repository (38, 2005-12-01)
cn\yicha\subject\spider\store\CVS\Root (43, 2005-12-01)
cn\yicha\subject\spider\fecther\TestGetMethod.java (1862, 2005-12-09)
cn\yicha\subject\spider\fecther\URLGetter.java (13628, 2006-02-17)
cn\yicha\subject\spider\fecther\URLReader.java (10083, 2005-12-07)
cn\yicha\subject\spider\fecther\CVS\Entries (148, 2006-02-16)
cn\yicha\subject\spider\fecther\CVS\Repository (40, 2005-12-01)
cn\yicha\subject\spider\fecther\CVS\Root (43, 2005-12-01)
cn\yicha\subject\spider\extractor\HTMLParser.java (7766, 2005-12-01)
cn\yicha\subject\spider\extractor\CVS\Entries (49, 2005-12-01)
cn\yicha\subject\spider\extractor\CVS\Repository (42, 2005-12-01)
... ...
近期下载者：
相关文件：
收藏者：