# robots.txt updated 12/06/2009 # http://www.cristalm.com.br User-agent: Googlebot Disallow: User-agent: MSNBot Disallow: User-agent: Googlebot-Image Disallow: User-agent: yahoo-mmcrawler Disallow: User-agent: psbot Disallow: User-agent: Roverbot Disallow: /cgi-bin/ #WebCrawler Yahoo - nao trabalha bem com akamai User-agent: Slurp Disallow: User-agent: * Disallow: Sitemap: http://www.cristalm.com.br/livesearchsiteauth.xml Sitemap: http://www.cristalm.com.br/sitemap.xml Sitemap: http://www.cristalm.com.br/sitemap1.asp