# Allow all spiders/bots to all directories & files... User-agent: * Disallow: /feed/ Disallow: /trackback/ Disallow: /page/ Disallow: /wp-admin/ Disallow: /tags/ Disallow: /tag/drawing Disallow: /tag/3d Disallow: /tag/illustration Disallow: /tag/photoshop Disallow: /tag/adobe Disallow: /tag/creation Disallow: /tag/graphic Disallow: /author/ Disallow: /2008/ Disallow: /2009/ Disallow: /wp-rss.php Disallow: /wget/ Disallow: /httpd/ Disallow: /i/ Disallow: /f/ Disallow: /t/ Disallow: /c/ Disallow: /j/ User-agent: Mediapartners-Google Allow: / User-agent: Adsbot-Google Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-Mobile Allow: / User-agent: Slurp Crawl-delay: 200 User-agent: MSIECrawler Disallow: / User-agent: psbot Disallow: / User-agent: Fasterfox Disallow: /