Re: [htdig] part of the website can't be indexed

[Gilles D. <gr...@sc...>]

According to Stephen L Arnold:
> On 15 Nov 01, at 8:40, Tony Melia wrote:
> > run it again with a -v at the end of whatever command you used
> > to index it in the first place and watch the output.  If it takes
> > a while try 'rundig -v >/tmp/mylog.txt' and go through the log
> > file when it has finished. 
> 
> > From: edwin lin [mailto:edw...@ho...]
> > 
> > I run htdig to dig two web sites. One website is only partially
> > indexed. What went wrong? Thanks, Yixiong 
> 
> The above is good advice, but it sounds like the part that's not 
> getting indexed may not be reachable, at least not via the top-
> level URL.  Remember, htdig doesn't index files on your hard-drive, 
> it can only follow URLs.

See FAQ 5.25 to 5.27, and 5.18.

> FAQ: http://htdig.sourceforge.net/FAQ.html

-- 
Gilles R. Detillieux              E-mail: <gr...@sc...>
Spinal Cord Research Centre       WWW:    http://www.scrc.umanitoba.ca/~grdetil
Dept. Physiology, U. of Manitoba  Phone:  (204)789-3766
Winnipeg, MB  R3E 3J7  (Canada)   Fax:    (204)789-3930