[htdig] DB2 problem when running htdig

[Georgina A. <gj...@wa...>]

Hi all,

We are having a problem with our htdig process.  It used to be an
intermittent problem but now is occuring more often.

The output from dig has lots of lines like:
DB2 problem...: /home/htdig/db/db.docdb: page 0: reference count
overflow
DB2 problem...: /home/htdig/db/db.docdb: page 137183088 doesn't exist,
create flag not set
BAD TAG IN SERIALIZED DATA: 244
DB2 problem...: /home/htdig/db/db.docdb: page 137183088 doesn't exist,
create flag not set
DB2 problem...: /home/htdig/db/db.docdb: page 137183088 doesn't exist,
create flag not set

The htdig process keeps running, but stops actually doing anything, and
starts to use almost all of the CPU.
When the job is killed off htmerge does its thing but searching returns
no results.

I've searched the mailing list and have found posts reporting these
types of errors, it seems that these errors are due to a corrupt
database but they should not occur when running htdig with the -i
option. =20

We are using htdig -i -s  and then running htmerge.

We are using 3.1.6, the config file has not changed for some time.

Does anyone have ideas or suggestions?

Thanks in advance,
Georgina.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Georgina Allbrook   =20
WebTeam : ITS Division : University of Waikato
http://phonebook.waikato.ac.nz/dept/WWTE.shtml
Ph 64 7 856 2889 x 6086

"Even overweight, cats instinctively know the cardinal rule:=20
when fat, arrange yourself in slim poses."=20
-- John Weitz
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~