说明：  网上机器人（Robot）又被称作Spider、Worm或Random，核心目的是为获取在Internet上的信息。机器人利用主页中的超文本链接遍历Web，通过URL引用从一个HTML文档爬行到另一个HTML文档。网上机器人收集到的信息可有多种用途，如建立索引、HTML文件的验证、URL链接验证、获取更新信息、站点镜象等。
(Internet Robot (Robot) also known as Spider, Worm, or Random, the core objective is to obtain information on the Internet. Home of the robot using hypertext links traversal Web, through the URL reference from a HTML document to another HTML document crawling. Online robot collected information can be a variety of purposes, such as indexing, HTML document verification, URL link verification, access to updated information, such as mirror sites.)