[htdig-dev] Re: Residual database errors

[Lachlan A. <lh...@us...>]

Greetings Neal,

I've found a repeatable crash in the database code (stack dump below). =20
The bug seems to be very sensitive to the code, so I can't easily=20
print out debugging information.  If you can suggest things to try in=20
ddd then I'll happily give them a go.  The crash is about 30 mins=20
into execution.

Thanks :)
Lachlan

Program received signal SIGABRT, Aborted.
0x4027e621 in kill () from /lib/libc.so.6
Current language:  auto; currently c
(gdb) where
#0  0x4027e621 in kill () from /lib/libc.so.6
#1  0x4027e425 in raise () from /lib/libc.so.6
#2  0x4027fa53 in abort () from /lib/libc.so.6
#3  0x401ff45c in std::terminate() () from /usr/lib/libstdc++.so.5
#4  0x401ff616 in __cxa_throw () from /usr/lib/libstdc++.so.5
#5  0x401ff862 in operator new(unsigned) () from=20
/usr/lib/libstdc++.so.5
#6  0x401ff94f in operator new[](unsigned) () from=20
/usr/lib/libstdc++.so.5
#7  0x4007f24e in Compressor::get_vals(unsigned**, char const*)=20
(this=3D0xbfffe4a0, pres=3D0x85c3058, tag=3D0x2 <Address 0x2 out of=20
bounds>) at WordBitCompress.cc:815
#8  0x40085268 in WordDBPage::Uncompress_main(Compressor*)=20
(this=3D0xbfffe500, pin=3D0xbfffe4a0) at WordDBPage.cc:213
#9  0x40084fef in WordDBPage::Uncompress(Compressor*, int,=20
__db_cmpr_info*) (this=3D0xbfffe500, pin=3D0xbfffe4a0, ndebug=3D2) at=20
WordDBPage.cc:155
#10 0x40083547 in WordDBCompress::Uncompress(unsigned char const*,=20
int, unsigned char*, int) (this=3D0x8245c88, inbuff=3D0x87d2678 "\004",=20
inbuff_length=3D2032, outbuff=3D0x408309b0 "\001", outbuff_length=3D8192)=
=20
at WordDBCompress.cc:156
#11 0x40082e11 in WordDBCompress_uncompress_c (inbuff=3D0x87d2678=20
"\004", inbuff_length=3D2032, outbuff=3D0x408309b0 "\001",=20
outbuff_length=3D8192, user_data=3D0x2) at WordDBCompress.cc:48
#12 0x400fea93 in CDB___memp_cmpr_read (dbmfp=3D0x82db790,=20
bhp=3D0x40830978, db_io=3D0xbfffe680, niop=3D0xbfffe67c) at mp_cmpr.c:306
#13 0x400fe832 in CDB___memp_cmpr (dbmfp=3D0x82db790, bhp=3D0x40830978,=20
db_io=3D0xbfffe680, flag=3D1, niop=3D0xbfffe67c) at mp_cmpr.c:153
#14 0x400fdcdf in CDB___memp_pgread (dbmfp=3D0x82db790, bhp=3D0x40830978,=
=20
can_create=3D0) at mp_bh.c:212
#15 0x400ffdfb in CDB_memp_fget (dbmfp=3D0x82db790, pgnoaddr=3D0xbfffe758=
,=20
flags=3D0, addrp=3D0xbfffe75c) at mp_fget.c:353
#16 0x400d1747 in CDB___bam_search (dbc=3D0x82dbab0, key=3D0xbfffe970,=20
flags=3D12802, stop=3D1, recnop=3D0x0, exactp=3D0xbfffe844) at=20
bt_search.c:251
#17 0x400c95a9 in CDB___bam_c_search (dbc=3D0x82dbab0, key=3D0xbfffe970,=20
flags=3D15, exactp=3D0xbfffe844) at bt_cursor.c:1594
#18 0x400c8740 in CDB___bam_c_put (dbc_orig=3D0x82dbd50, key=3D0xbfffe970=
,=20
data=3D0xbfffe990, flags=3D15) at bt_cursor.c:982
#19 0x400da9ea in CDB___db_put (dbp=3D0x80e5f88, txn=3D0x0,=20
key=3D0xbfffe970, data=3D0xbfffe990, flags=3D0) at db_am.c:508
#20 0x40092796 in WordList::Put(WordReference const&, int)=20
(this=3D0xbffff190, arg=3D@0xbfffe970, flags=3D0) at WordDB.h:126
#21 0x4003ab7e in HtWordList::Flush() (this=3D0xbffff190) at=20
=2E./htword/WordList.h:118
#22 0x08056012 in Retriever::parse_url(URLRef&) (this=3D0xbffff0e0,=20
urlRef=3D@0x837c560) at Retriever.cc:667
#23 0x08055612 in Retriever::Start() (this=3D0xbffff0e0) at=20
Retriever.cc:432
#24 0x0805daa5 in main (ac=3D5, av=3D0xbffff704) at htdig.cc:338
#25 0x4026c280 in __libc_start_main () from /lib/libc.so.6
(gdb)=20

On Tuesday 28 January 2003 09:38, Neal Richter wrote:

> =09What DB errors are you speaking of?  Turning on
> wordlist_compress_zlib should be a workaround for the DB errors I
> know about.