# robots.txt, 2/28/2007 # # This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # # Format is: # User-agent: # Disallow: | # ----------------------------------------------------------------------------- User-agent: * Disallow: /cgi-bin Disallow: /gbook Disallow: /test