Mandi
08-02-1999, 05:23 PM
I have noticed that my biggest "referrer" site is actually myself, without the www.[nbsp][nbsp]I have also noticed that when my site is listed via search engines (when I follow my referrer stats backwards) that invariably, the site is listed without the www[nbsp][nbsp]. . . just http://mysite.net.[nbsp][nbsp]Other sites listed for particular queries all seem to contain their www . . . is there a way to politely SUGGEST to a spider (such as a line in robot.txt, perhaps?) that it include your whole darn URL?[nbsp][nbsp](I realize some people prefer the "no www" type URL, in which case I suppose the reverse would be true - they don't care to have themselves indexed as www.mysite.com) (http://www.mysite.com))