## ## robots.txt -- Robot Exclusion Standard config file ## ## $Id$ ## ## This is the robots.txt file for the website: ## http://www.hayimdevries.com/ ## ## More information about the robots.txt file available from the robots FAQ ## http://info.webcrawler.com/mak/projects/robots/faq.html ## User-agent: * Disallow: /analog/ Disallow: /css/ Disallow: /cgi-bin/ Disallow: /images/ Disallow: /DAV/ Disallow: /gallery/ Disallow: /albums/ User-agent: crawl*.atext.com Disallow: / ##EOF##