# /robots.txt file for http://www.ChristopherLewis.com/ # mail webmaster@ChristopherLewis.com for constructive criticism sitemap: http://www.ChristopherLewis.com/sitemap.xml #Stop bad agents from spidering site user-agent: EmailSiphon Disallow: / # user-agent: EmailWolf Disallow: / # user-agent: e-collector Disallow: / # user-agent: EmailCollector Disallow: / # user-agent: ExtractorPro Disallow: / # user-agent: WebEMailExtractor Disallow: / # user-agent: NPBot Disallow: / # user-agent: dloader Disallow: / #Google - allowed anywhere :-) User-agent: Mediapartners-Google Disallow: #YAHOO User-agent: Slurp Crawl-delay: 120 # All Agents - Ignore various directories. User-agent: * Disallow: /Benjamin/ Disallow: /benjamin/ Disallow: /Oregon/ Disallow: /Belgium/ Disallow: /Serenissima/ Disallow: /feedback.htm Disallow: /email-addresses/ Disallow: /analog_reports.asp Disallow: /analog/ Disallow: /Analog/ Disallow: /Annie/