# robots.txt for http://kiss.selfdelve.com # contact webmaster for constructive critics # $Id: robots.txt,v 1.1.1.1 2006/11/29 21:50:58 steffenk Exp $ User-agent: * Disallow: /cgi-bin/ Disallow: /lib/ Disallow: /help/ Disallow: /old/ Disallow: /doc/ Disallow: /~falkb/bcp/ #Crawl-delay: 480 User-agent: Slurp # Hello Slurp, when you read this file, why do you ignore the Disable rules? #Crawl-delay: 960