Re: HTML to Prevent Spidering
Hi:
You need to use robots.txt on your server
The following links will explain:
http://www.searchtools.com/robots/robots-txt.html
http://www.robotstxt.org/wc/robots.html
http://www.tardis.ed.ac.uk/~sxw/robots/check/
Cornell
|