Explanation and use of robots.txt

[zmax]

Hi. Is there somewhere in the tutorials which explains how to setup and use robots.txt or can someone just explain it?

Thanks.

Z

[Deb]

Hey Z.

We do not have a tutorial yet, but now that you mention it... WE SHOULD --- I hearby promise to work on one ASAP ;)

Doing a search for robots.txt at http://www.aota.net/cgi-bin/search.cgi?action=intro[nbsp][nbsp]will give you quite a bit of information on the robots.txt file.[nbsp][nbsp]You may also want to check out http://www.rietta.com/robogen/index.shtml

Deb

[Deb]

Two more links you may want to view:

http://www.eboz.com/articles/design/114.shtml

http://www.eboz.com/articles/design/110.shtml