爬虫

Based on the work of other people, we described the structure design of a distributed Web crawler, including the organization of hardware and module partition of software.

在吸取了他人技术和经验的基础上，本文设计并描述了一个分布式网络爬虫的结构，其中包括硬件的构架和软件的模块划分。

A MapReduce application or a web crawler application fits perfectly with this model.

一个MapReduce应用程序或网络爬虫应用程序非常的适合这种模型。

Deep Web crawler study is an important step for search engine in getting Deep Web information,which is still at its early stage.

Deep Web爬虫的研究，是搜索引擎获得Deep Web信息的重要步骤，仍处于研究的早期阶段。

With the development of Internet, information on the Web is rapidly expanding, and the demand for information is increasing. Web crawler who takes charge of gathering Web information is facing an enormous challenge.

随着网络技术的发展，Web上的信息海量增加，人们对信息的需求也不断加大，使得专门负责Web信息采集的网络爬虫技术面临着巨大的挑战。

He spent a week on it, applying Python for crawler and web, cron job and so forth, oops!

他花了一个星期用Python做了爬虫和网站，也用到了时钟守护任务等。

Web crawler technology is the key to search engine, it is an automatic extraction, analysis and filtering website procedures for search engine downloaded the webpage from the World Wide Web.

而网络爬虫作为搜索引擎的关键技术，它是一个自动提取，分析并过滤网页的程序，为搜索引擎从万维网上下载网页，是搜索引擎的重要组成。

I'm a creep, I'm a weirdo.

而我是一只爬虫，一个古怪的人

How, like a worm, was I wrapt round and round

多象一只爬虫，用幻想这昆虫编制的

But a tiny reptile found recently in India is something else entirely, an Indian zoologist announced today.

但是这个近日在印度发现的小爬虫却是一个与蛇完全不同的东西。

And then, when that new race had become an established part of their respective societies, the Carian/Reptilians arrived in the Lyra constellation and colonized a neighboring planet of the Feline/Humans.

于是，当那新的种族已经成为他们各自社会一个被确定的部分的时候，Carian/爬虫类抵达天琴星座并且在邻近的行星上殖民狮/人类。

The split between the two groups can hardly be papered over.

这两个团体间的分歧难以掩饰。

This approach not only encourages a greater number of responses, but minimizes the likelihood of stale groupthink.

这种做法不仅鼓励了更多的反应，而且减少跟风的可能性。