SOWPub Small Business Forums - HTML to Prevent Spidering

SOWPub Small Business Forums (http://www.sowpub.com/forum/index.php)

- Original SOWPub Forum Archive (http://www.sowpub.com/forum/forumdisplay.php?f=3)

- - HTML to Prevent Spidering (http://www.sowpub.com/forum/showthread.php?t=2541)

Ken Black

April 26, 2002 04:09 PM

HTML to Prevent Spidering

Does anyone know the HTML code that you can add to a web page that will prevent a search engine spider from scanning and registering it on search engines ?

Thank you.

Ken Black
http://golfrevelations.com

Cornell

April 26, 2002 04:42 PM

Re: HTML to Prevent Spidering

Hi:

You need to use robots.txt on your server

The following links will explain:

http://www.searchtools.com/robots/robots-txt.html
http://www.robotstxt.org/wc/robots.html
http://www.tardis.ed.ac.uk/~sxw/robots/check/

Cornell

All times are GMT -4. The time now is 08:38 PM.