Re: [htdig] Getting started with htdig

[Milan A. <ma...@ee...>]

On Tue, Sep 21, 2004 at 01:01:05AM -0600, Jim wrote:
> On Mon, 20 Sep 2004, Aaron Levitt wrote:
> 
> >I have recently downloaded/compiled and installed htdig on an Apple 
> >Xserve.  The only problem seems to be getting the initial database going.  
> >I followed all the docs to set up htdig.conf.  The only thing out of the 
> >ordinary is that I am using a file for start_url because each document 
> >doesn't link to the next.  I run rundig for the first time, it seems to 
> >run htdig -i, and then htnotify, and it also creates files in the 
> >htdig/db/ directory, but the htnotify never seems to end.  At first, I 
> >thought it was due to the number of documents I am trying to index (over 
> >500,000).  I gave it 8 hours, but it never finished.
> 
> There is a bug in htnotify that only adversely affects certain platforms. 
> The following patch fixes the problem.
> 
>   ftp://ftp.ccsf.org/htdig-patches/3.1.6/htnotifyNull.0
> 
> If you would prefer not to mess with patching the code, you can also just 
> set the htnotify_prefix_file and htnotify_suffix_file attributes. By 
> default these attributes do not specify valid files and that is what
> triggers the bug.
> 
>   http://www.htdig.org/attrs.html#htnotify_prefix_file
>   http://www.htdig.org/attrs.html#htnotify_suffix_file

Also, htnotify is optional since, IIRC, it's purpose is to send email to
specified addresses if a document has changed.  I had a problem with it 
never completing and disabled it by commenting out the htnotify line in 
rundig script.

-- 
Milan