Web spiders operate in a similar way.

Web spider也会以类似的方式进行操作。

youdao

Another interesting chart with traffic from Web spiders is shown below.

下面显示了关于Web spider提供的流量的有趣图表。

youdao

Used to discover support for specific industry schemas by BICS-aware Web spiders and crawlers.

通过支持BICS的web蜘蛛和爬虫为特定行业模式提供发现支持。

youdao

All the search engines follow these robot directives, which, while not a perfect security solution, limit the entry points used by the bots and spiders that index the Web.

FORBES: Google Me Not