User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) Disallow: / User-agent: SkreemRBot Disallow: / User-agent: daumoa Disallow: / User-agent: Yandex Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: Mail.ru Disallow: / User-agent: * Crawl-delay: 60 Disallow: /docs/ Disallow: /Library/ Disallow: /Templates/ Disallow: /sendto_form Disallow: /author/NiccoloSarno User-agent: Slurp Crawl-delay: 60 Disallow: /author/NiccoloSarno Disallow: /*sendto_form$ Disallow: /*folder_factories$ Disallow: /Library/ Disallow: /Templates/ Disallow: /sendto_form # Add Googlebot-specific syntax extension to exclude forms # that are repeated for each piece of content in the site # the wildcard is only supported by Googlebot # http://www.google.com/support/webmasters/bin/answer.py?answer=40367&ctx=sibling User-Agent: Googlebot Disallow: /*sendto_form$ Disallow: /*folder_factories$ Disallow: /sendto_form Disallow: /author/NiccoloSarno # Block URLs that include ? except those that end with ? Allow: /*?$ Disallow: /*?