# robots.txt file created 01/27/1999 # # robots.txt is a file retrieved by search engine spiders that conforms # to standards set forth by the Internet Engineering Task Force (IETF) # # For further guidance, please refer to: # # 1) http://info.webcrawler.com/mak/projects/robots/robots.html # 2) http:/info.webcrawler.com/mak/projects/robots/norobots-rfc.html # # A most helpful robots.txt "syntax checker" is located at: # # http://www.tardis.ed.ac.uk/~sxw/robots/check/ # # hoover.com and hoovercompany.com are owned by The Hoover Company. # The site was developed by The Hoover Company, Websitement(R) Communications # Corporation and Rampant Inc. and has been optimized for search engine # retrieval using Websitement(R) QueryMaster(TM) technology # # Webmaster: Greg Weiland - gw@websitement-tm.com, gw@querymaster.com # # NOTES: # # 07/25/1999 - Syntax is case sensitive: # carriage returns are not allowed between lines # # 09/12/1999 - The "*" following "User-agent:" prevents access by # ALL spiders # to directories listed as: "Disallow: /xxxxxx" # # ------------------------------------------------------------------------- User-agent: * Disallow: /_private Disallow: /_vti_bin Disallow: /_vti_cnf Disallow: /_vti_log Disallow: /_vti_pvt Disallow: /_vti_txt Disallow: /igneus Disallow: /image Disallow: /images Disallow: /work