User-agent: * Disallow: /admin/ Disallow: /assets/ Disallow: /backup/ Disallow: /classes/ Disallow: /extras/ Disallow: /includes/ Disallow: /jscripts/ Disallow: /logs/ Disallow: /phpMyAdmin-2.2.1/ Disallow: /styles/ Disallow: /temp/ Disallow: /backup/ User-agent: msnbot Crawl-delay: 10 User-agent: Teoma Crawl-delay: 10 User-agent: Slurp Crawl-delay: 10 User-agent: aipbot Disallow: / User-agent: BecomeBot Disallow: / User-agent: psbot Disallow: /