# robot exclusion file - additions by Benoit, Alberto, Felix and Webmaster # last modified: Jan 17 2012 Paul Carson # directed to all spiders User-agent: * Disallow: /admin/ Disallow: /archive/rh/ Disallow: /archive/hst/proxy/ Disallow: /bscw/ Disallow: /cgi-bin/ Disallow: /comments Disallow: /dss/dss/ Disallow: /gsc/gsc/ Disallow: /help/ Disallow: /icons/ Disallow: /images/ Disallow: /preview/ Disallow: /search/ Disallow: /skycat/servers/ Disallow: /wdb/wdb/ Disallow: /asm/ Disallow: /bin/ # dynamic content Disallow: /asm/ambient/ Disallow: /opticon/twiki/bin/edit Disallow: /opticon/twiki/bin/search Disallow: /opticon/twiki/bin/rdiff Disallow: /opticon/twiki/bin/oops Disallow: /Tools/DidRep Disallow: /hdr Disallow: /Tools/DidRep