# html access file blocks bad bots, system records bad bots # apf also block bad bots # robots.txt checker http://tool.motoricerca.info/robots-checker.phtml # allow is not a command for robots.txt, wildcards not always supported # sometmes letting google index entire site is a good idea # google will notivy you if someone adds malware to a web page. User-agent: * Disallow: /~* Disallow: /php* Disallow: /secure/ Disallow: /phpMyAdmin Allow: /index.php #Allow: /$