Web-Crawler is a important part of search engine, it is responsible for the network information gathering.
网络爬虫是搜索引擎的重要组成部分，它在搜索引擎中负责网络信息的采集。
The behavior policies define which pages the crawler will bring down to the indexer, how often to go back to a Web site to check it again, and something called a politeness policy.
这种行为策略定义了爬虫会将哪些页面带入索引程序、以什么样的频率回到Web站点上再次对它进行检查，以及一种礼貌原则。
This information helps the Web crawler determine what the set of pages is and when to crawl them.
这一信息能帮助web爬虫程序决定要爬行哪些页面以及爬行的时间。
Thus the efficiency of site crawls provides relief to both sides: the hosting Web server and the crawler as well, by keeping the number of GET requests for pages at a minimum.
这样，站点爬行的效率为两边都减轻了负担：宿主Web服务器和爬虫程序，方法是把GET页面请求数量保持在最小值。
Each search engine has its own automated program called a "web spider" or "web crawler" that crawls the web.
每个搜索引擎都有自己爬行网页的自动化程序，叫做“网络蜘蛛（web spider）”或“网络爬虫（web crawler）”。
Project Barcelona, a new project in the works from Microsoft, will give enterprises Web crawler-like tools for searching and storing information.
近日，微软准备推出自己最新的计划，他们称之为“Project Barcelona”。这个项目将用于企业级搜索和信息存储所用的网络爬虫工具。
At the same time, Web crawler developers work to create new crawling approaches that account for the ever-increasing complexity of Web pages, often with impact on their processing speed.
与此同时，web爬虫程序开发人员努力创建新的爬行方法以应对日益复杂的web页面，因为复杂的web页面常常会影响页面的处理速度。
Helps to optimize the entire structure of the site for a crawler by providing an alternate set of Web pages so that crawlers can quickly access and index a large number of embedded pages.
有助于为爬网程序优化站点的整个结构，通过提供备用的We b页面组，从而使爬网程序能够快速地访问大量的嵌入式页面并针对这些页面建立索引。
Provides an entry point for the search engine crawler to easily follow the links within your Web pages.
为搜索引擎爬网程序提供入口点，以使爬网程序轻松地跟踪您的Web页面内的链接。
To expand the Web crawler, consider collecting image references or searching for specific text strings.
要扩展该Web crawler，可以考虑收集图像引用或搜索特定的文本字符串。
Technology can help. Google's charity arm is developing “web crawler” technology to monitor news reports in dozens of languages to spot emerging pandemics.
现在，技术可以改变无助的现状，Google向WHO伸出援手，其开发的web crawler（网虫）技术将监视数十种语言关于传染病的新闻报告。
They'd bring these random x86-based computer parts back to their dorm room to add to the Frankenstein machine hosting the legendary rogue Web crawler that took down Stanford's entire network-twice.
他们将那些随意的、基于x86的计算机零件带回宿舍，将它们添加到托管具有传奇色彩的“爬网蛛”的Frankenstein机器上，爬网蛛—两次—记录下了斯坦福市的整个网络。
The CollectUrls Web crawler program takes advantage of a fixed-size thread pool.
CollectUrlsWeb crawler程序利用一个固定大小的线程池。
The high-level task for this article is a Web crawler: given a base URL for a Web site, you'll collect elements from the site that you can use for some purpose.
本文的高级任务是创建一个Web crawler：给定一个网站的基URL，从该网站收集可以用作某种用途的元素。
This article took you through the task of creating a Web crawler by.
本文向您介绍了创建Web crawler的过程。
Finally, it is illustrated to the future of Web crawler search engine research trends.
最后对搜索引擎未来网络爬虫研究趋势做了说明。
This paper is deal with the system's background data and foreground data to emerge. So it designs a system about platform of fund data extraction and analysis base on web crawler.
本文针对系统后台数据的获取以及系统前台数据处理进行展现，设计出基于网络爬虫的基金信息的抽取与分析平台。
We designed a deep web crawler base on the most efficient queries.
本文提出一种基于最优查询词的深度网络爬虫。
Topic web crawler search strategy is the core of professional search engine technology.
主题网络蜘蛛搜索策略是专业搜索引擎的核心技术。
Including full text search and Web crawler.
包括全文搜索和Web爬虫。
Traditional focused crawler is targeting web pages that are relevant to some specific topics. But some applications, such as web directory, are providing users with relevant websites.
传统的聚焦爬虫抓取的目标是与某一特定主题内容相关的网页，而在有些应用中，如网络目录，更多的是给用户提供主题相关网站。
Web crawler is a system which can automatically get web pages from Internet. It helps searching engine download web pages, so it is an important part of searching engine.
网络爬虫是一个可以从因特网上自动提取网页的系统，它为搜索引擎从万维网上下载网页，是搜索引擎的重要组成。
A website crawler is a software program designed to follow hyperlinks throughout a web site, retrieving and indexing pages to document the site for searching purposes.
一个网站爬虫是设计在整个一个网络站点跟随超连接的一个软件程序，检索并且索引页记录为寻找目的地点。
Through the web crawler technology to realize the extracting of the content on the web page, and the recognizing of the text and image appeared on the web page.
通过网络爬虫技术实现对互联网上的网页内容进行提取，并对提取的网页进行文本和图像识别。
Focused crawler is a subject-oriented information retrieval system. It can meet the users' need and retrieve information that is relevant to some specific subjects from the web automatically.
聚焦爬虫是一种面向主题的信息搜集系统，可以根据用户需要从互联网上自动搜集到主题相关信息，在主题搜索引擎、站点结构分析等方面取得越来越广泛的应用。
First, the search depth is not ideal. Search engines obtain information on Internet via web crawler, so they cannot get the Shared information stored in users' personal computer.
第一是搜索深度不够，当前搜索引擎通过网络蜘蛛获取互联网上的资源，无法检索用户个人电脑上的共享资源。
The main goals of focused web crawler are to get more web pages which are correlative with a certain topic and prepare data for users querying.
聚焦网络爬虫并不追求大的覆盖，而将目标定为抓取与某一特定主题内容相关的网页，为面向主题的用户查询准备数据资源。
The main goals of focused web crawler are to get more web pages which are correlative with a certain topic and prepare data for users querying.
聚焦网络爬虫并不追求大的覆盖，而将目标定为抓取与某一特定主题内容相关的网页，为面向主题的用户查询准备数据资源。
应用推荐