Re: [htdig] Load problem while indexing

[Jim <li...@yg...>]

On Mon, 14 Aug 2006, Ralf Hildebrandt wrote:

> During indexing, our nagios installation reports that the webserver is
> not responding -- generating the index seems to stress the machine to
> the point where it doesn't accept any HTTP connections.
> 
> I already added:
> server_wait_time:       10

Have you tried running with one or more -v options? That should give you 
some idea of what htdig is actually doing. If it is hitting the same 
server name over and over without pause, then that might be a sign that 
there is some sort of problem with your ht://Dig configuration file.

If you haven't already done so, it might be worth manually deleting any 
existing database files created by htdig before starting a new dig.

Have you verified that your web server's MaxClients (or equivalent) 
setting is high enough to support the extra connections? Long shot to
say the least.

The only other thing I can think of to suggest is to monitor your
server's disk activity while the index is being created. If you have
slow disks and/or very large databases, indexing can seriously degrade
the responsiveness of the system.

Jim