View Single Post
  #2  
Old April 26, 2002, 04:42 PM
Cornell
 
Posts: n/a
Default Re: HTML to Prevent Spidering

Hi:

You need to use robots.txt on your server

The following links will explain:

http://www.searchtools.com/robots/robots-txt.html
http://www.robotstxt.org/wc/robots.html
http://www.tardis.ed.ac.uk/~sxw/robots/check/

Cornell