PDA

View Full Version : Robots text file help


joekid
03-01-2006, 09:28 PM
Hi Guys
I hope I am in the right place to post this Question. I don't think Google is Crawing my site to index the pages in my file manger in the Robots txt file the code in link this:

User-agent: *
Disallow: /stats/

will this code let Google Craw my web site or do I need to change it if so can you please tell me how the code should be.
this is what I have in my META Tag
<meta name="robots" content="index,follow">
Thank you
Joekid

Andilinks
03-02-2006, 01:37 AM
Hi Joekid.

There is no problem with that robots.txt code. Google will not be stopped by that.

Here (http://www.searchengineworld.com/robots/robots_tutorial.htm) is a helpful robot.txt tutorial that explains all the code that can go into that file. But it sounds more like you need Google Information for Webmasters (http://www.google.com/webmasters/).

Stop back here if you have any more questions.

Andi