what can go in robots.txt?

[GregJ]

I looking to keep robots out of my lower directory structure.[nbsp][nbsp]What can go in the robots.txt file?[nbsp][nbsp]I looked on Aota and didn't find anything on robots.txt.

Also, are there some meta tags I should use, not use?

------------------
Greg

[Bob]

Hi Greg,

Actually you are correct that there are no tutorials within Aota.net regarding robots.txt,[nbsp][nbsp]however these Forums contain a wealth of information regarding this subject:
http://www.aota.net/ubb/Forum3/HTML/000358-1.html
http://www.aota.net/ubb/Forum7/HTML/000046-1.html

and about 28 others, contain some of the same or slightly differing comments.

Regarding Meta Tags, there is another <font color=#FF0000>HOT</font> Topic,
With over 68 threads involving them:
http://www.aota.net/ubb/Forum2/HTML/000252-1.html
http://www.aota.net/ubb/Forum3/HTML/001459-1.html
and many more as I mentioned, with a differing view point in many of them as this has and will continue to be a <font color=#FF0000>hotly</font> debated subject:)

There is also a couple of Aota.net Tutorials regarding Meta Tags located here:
http://www.aota.net/Software_For_Download/metatagcreator.php3
http://www.aota.net/Promotion/jim.php3
http://www.aota.net/Promotion/metatags.php3

I hope some of this will help.

Have a Good One,
Bob

- Tag....[nbsp][nbsp]Your It :P -

[GregJ]

That hit the mark, Thanks!

I'm gonna get used to this stuff.[nbsp][nbsp]I didn't even think to search the forums.

BTW, how long does stuff stay archived in the forums?[nbsp][nbsp]As I'm browsing I think 'lots of good stuff' to read later.[nbsp][nbsp]How much later do I have?
------------------
Greg

[Paul]

Hi..

Optimistically, the plan calls for as long as there is a FutureQuest or.. forever, whichever comes last. ;)

Paul