# robots.txt generated at www.mcanerin.com User-agent: Googlebot Crawl-delay: 120 User-agent: Googlebot-Image Disallow: / User-agent: Gigabot Disallow: / User-agent: Scrubby Disallow: / User-agent: Nutch Disallow: / User-agent: baiduspider Disallow: / User-agent: yahoo-mmcrawler Disallow: / User-agent: psbot Disallow: / User-agent: asterias Disallow: / User-agent: * Crawl-delay: 120 Disallow: /blog/Trackback Disallow: /blog/CategoryView Disallow: /blog/PermaLink Disallow: /blog/Syndication