Re: [htdig] robots.txt -quick question

[Malcolm A. <mal...@co...>]

On Sun, 2 Dec 2001 tr...@ma... wrote:

+ >No, it goes in the root of the server, e.g.:
+ >
+ >http://www.foo.com/robots.txt
+
+ what i should have said is:
+
+ the urls to the students' sites are formed, e.g.,:
+ http://slis.lis.sco.edu/~H765-87
+
+ the actual paths on the server to their home dirs is:
+ /usr2/foo/foo/foo/~H765-87/public_html/index.html
+
+ and each student is incremented, e.g., ~H765-87, -88, -89....
+
+ can i put a robots.txt file in each ~homdir or in each public_html dir?

No. The original answer above was exact and correct. It must go in the
_server_ document root directory. There can only be one robots.txt on the
server and it _must_ be addressable as http://slis.lis.sco.edu/robots.txt

regards,
	Malcolm.

 Malcolm.Austen@OUCS.ox.ac.uk     http://users.ox.ac.uk/~malcolm/