Community Knowledge Base

Spiders

Spiders and robots are applications that crawl the Web indexing and retrieving content, usually for the benefit of search engines, information resources, and news organizations. For example, the primary search engine robots for Google, Bing, and Yahoo! are Googlebot, Slurp, and MSNbot.

This report displays information about the search engine spider activity (spider, page views, hits, and bandwidth) on your website. Site administrators and users can use this report to evaluate and enhance their SEO efforts.

Note: This report can be added as a report item to a custom report. For more information on report items, refer to Understanding Report Items.

For a definition of the terms listed on this page, please refer to the Glossary.