From: Lachlan A. <lh...@us...> - 2003-12-14 08:33:35
|
htdig/test t_htdig t_htsearch Update of /cvsroot/htdig/htdig/test In directory sc8-pr-cvs1:/tmp/cvs-serv26654/test Modified Files: t_htdig t_htsearch Log Message: Allow indexing if robots.txt has an empty "disallow" line |