From: <mc...@ci...> - 2004-05-21 11:39:41
|
In-Reply-To: <E1B...@sc...> "Sjan Evardsson" <sj...@al...> wrote on Thu, 20 May 2004 15:14:19 -0800: > > I understand that when I see the "url rejected" in the output, that > means it is in the excluded list. I have excluded /calendar/ from htdig, > however, it seems to find it necessarry to repeatedly hit > /calendar/index.php?page=3DXX&day=3DXX&month=3DXX&year=3DXX (where XX = > are > repeadetly replaced with increasing values, so far from 2001 to 2007). > Is this because it is finding those links somewhere or is it just doing > a zombie-like, brain-dead, recursive search on the url which is then > rejected? To answer that, you're going to have to look at the links *to* /calendar/index.php from outside the /calendar/ directory, and figure out what it returns in response. |