# $Id: robots.txt,v 1.7.2.1 2007/03/23 18:57:07 drumm Exp $## robots.txt## This file is to prevent the crawling and indexing of certain parts# of your site by web crawlers and spiders run by sites like Yahoo!# and Google. By telling these "robots" where not to go on your site,# you save bandwidth and server resources.## This file will be ignored unless it is at the root of your host:# Used:    http://example.com/robots.txt# Ignored: http://example.com/site/robots.txt## For more information about the robots.txt standard, see:# http://www.robotstxt.org/wc/robots.html## For syntax checking, see:# http://www.sxw.org.uk/computing/robots/check.htmlUser-agent: *# DirectoriesDisallow: /database/Disallow: /includes/Disallow: /misc/Disallow: /modules/Disallow: /sites/Disallow: /themes/Disallow: /scripts/Disallow: /updates/Disallow: /profiles/# Files

Disallow: /boost_stats.phpDisallow: /xmlrpc.phpDisallow: /cron.phpDisallow: /update.phpDisallow: /install.phpDisallow: /INSTALL.txtDisallow: /INSTALL.mysql.txtDisallow: /INSTALL.pgsql.txtDisallow: /CHANGELOG.txtDisallow: /MAINTAINERS.txtDisallow: /LICENSE.txtDisallow: /UPGRADE.txt# Paths (clean URLs)Disallow: /admin/Disallow: /aggregatorDisallow: /comment/reply/Disallow: /contactDisallow: /logoutDisallow: /node/addDisallow: /search/Disallow: /user/registerDisallow: /user/passwordDisallow: /user/login# Added at the request of the userDisallow: users/nbg1963# Paths (no clean URLs)Disallow: /?q=admin/Disallow: /?q=aggregator/Disallow: /?q=comment/reply/Disallow: /?q=contact/Disallow: /?q=logout/Disallow: /?q=node/add/Disallow: /?q=search/Disallow: /?q=user/password/Disallow: /?q=user/register/Disallow: /?q=user/login/