Administrator Guide: Maximum Number Of Directories Within A URL

This feature allows you to specify how deep into a site the spider should crawl. The number specified here represents the number of directories within the URL, with 1 being the root.

Examples:

Setting this value to 1, will index only the top level:

http://www.mydomain.com/
Settings this value to 2, will index the top level and first sub directory:

http://www.mydomain.com/
http://www.mydomain.com/subdirectory/

To allow an unlimited depth, simply specify 0 (zero) as the maximum depth value.

<< Back To Table Of Contents