"Sjan Evardsson" <sjan_e@...> wrote on Thu, 20 May 2004
> I understand that when I see the "url rejected" in the output, that
> means it is in the excluded list. I have excluded /calendar/ from htdig,
> however, it seems to find it necessarry to repeatedly hit
> /calendar/index.php?page=3DXX&day=3DXX&month=3DXX&year=3DXX (where XX =
> repeadetly replaced with increasing values, so far from 2001 to 2007).
> Is this because it is finding those links somewhere or is it just doing
> a zombie-like, brain-dead, recursive search on the url which is then
To answer that, you're going to have to look at the links *to*
/calendar/index.php from outside the /calendar/ directory, and
figure out what it returns in response.