Community Knowledge Base

Spider Top Files

This report displays the website files (web pages, images, etc.) most frequently accessed by spiders and/or bots, regardless of the file extension.

Each row returned in this report can be further analyzed by SmarterStats. By moving your mouse over a row, a down arrow appears at the end of the row. The options available when clicking on this arrow include: Data Mining, Open URL, Set Page Alias and View Details.

  • Data Mining - Data mining allows site administrators and users to drill down into more detail about the item in the particular row. For example, viewing the referring URLs, bandwidth used, query strings and more.
  • Open URL - Opens the item in a new window.
  • Set Page Alias - Allows users to set a friendly name for sometimes complex URLs. For example, if a Page shows up as "/smartertools/products/smarterstats/pricing.aspx", users can instead attach the alias of "SmarterStats Pricing". That way, any report items that reference that page URL will display "SmarterStats Pricing" instead of the URL itself. This feature is especially useful when using query variables, which can have cryptic or numerical variables such as ProductID=37.
  • View Details - Displays a number of details about the specific item. For example, Traffic details, Performance results, any result codes returned (e.g., 404 errors) or any Site Tuning issues that are found.

Note: This report can be added as a report item to a custom report. For more information on report items, refer to Understanding Report Items.

For a definition of the terms listed on this page, please refer to the Glossary.