Deb
11-12-1998, 03:01 AM
This message is geared to owners of Full Virtual Domains hosted on the FutureQuest Server.
Yet another file should be noticed in your WWW directory. This file is titled robots.txt.
robots.txt is there to disallow spiders from indexing your stats directory.
You can delete this file or add to it if you would like to. We have put it there due to high demand for a solution. Any directory name you add to this file will not be allowed to be indexed by spiders that follow the rules of a robots.txt file.
If you would like more information on web robots (spiders) view http://info.webcrawler.com/mak/projects/robots/robots.html
Technically Yours,
Deb & Terra
Yet another file should be noticed in your WWW directory. This file is titled robots.txt.
robots.txt is there to disallow spiders from indexing your stats directory.
You can delete this file or add to it if you would like to. We have put it there due to high demand for a solution. Any directory name you add to this file will not be allowed to be indexed by spiders that follow the rules of a robots.txt file.
If you would like more information on web robots (spiders) view http://info.webcrawler.com/mak/projects/robots/robots.html
Technically Yours,
Deb & Terra