From: Lachlan A. <lh...@ee...> - 2002-07-28 23:35:25
|
On Sun, Jul 28, 2002 at 12:12:49PM -0700, it was written > From: Geoff Hutchison <ghu...@us...> > Date: Sun, 28 Jul 2002 00:13:41 -0700 > Subject: [htdig-dev] Current Status as of snapshot 3.2.0b4-20020728 > > NEEDED FEATURES: > * Handle local_urls through file:// handler, for mime.types support. About a month ago I submitted a patch for this, but haven't heard back about it. If it is not acceptable, I'd be happy to fix it, but by leaving it in the "needed features" section, I'm afraid there may be duplicated effort. Cheers, Lachlan -- Lachlan Andrew lh...@ee... Phone: +613 8344-3816 Fax: +613 8344-6678 Department of Electrical and Electronic Engineering CRICOS Provider Code University of Melbourne, Victoria, 3010 AUSTRALIA 00116K |
From: Geoff H. <ghu...@ws...> - 2002-07-29 01:24:12
|
>> NEEDED FEATURES: >> * Handle local_urls through file:// handler, for mime.types support. > > About a month ago I submitted a patch for this, but haven't heard > back about it. If it is not acceptable, I'd be happy to fix it, but No, I just haven't updated the STATUS file. Sorry. I'll take care of that ASAP. -Geoff |
From: Neal R. <ne...@ri...> - 2002-07-30 21:31:02
|
Hey, Does anyone know exactly how to disable the BDB compression for the word-database db.words.db? I'm getting an error after indexing the 131,731th document.. FATAL ERROR:Compressor::get_vals invalid comptype FATAL ERROR at file:WordBitCompress.cc line:827 !!! It's having a problem with putting the string "ocean" into the wordDB during a words.flush(). The string is already in the database, it's contained in a number of other documents. After loading a page from the database, it looks like it's expecting a 'O' or '1' as a comptype in Compressor::get_vals() The actual comptype is '3'. Here's the backtrace: #0 0x4025b3e0 in Compressor::get_vals (this=0xbfff4dbc,pres=0x83fd430, tag=0x4031e360 "NumField2") at WordBitCompress.cc:827 #1 0x4026218a in WordDBPage::Uncompress_main (this=0xbfff4e1c,pin=0xbfff4dbc) at WordDBPage.cc:213 #2 0x402600b0 in WordDBPage::Uncompress (this=0xbfff4e1c, pin=0xbfff4dbc,ndebug=0) at WordDBPage.cc:155 #3 0x4025ee1a in WordDBCompress::Uncompress (this=0x848c740,inbuff=0x83fa208 "\004", inbuff_length=2032, outbuff=0x41031758 "\002",outbuff_length=8192) at WordDBCompress.cc:127 #4 0x4025e6e9 in WordDBCompress_uncompress_c (inbuff=0x83fa208 "\004",inbuff_length=2032, outbuff=0x41031758 "\002", outbuff_length=8192,user_data=0x848c740) at WordDBCompress.cc:48 #5 0x4023db09 in CDB___memp_cmpr_read (dbmfp=0x848dbe0, bhp=0x41031720,db_io=0xbfff4f50, niop=0xbfff4f4c) at mp_cmpr.c:288 #6 0x4023d889 in CDB___memp_cmpr (dbmfp=0x848dbe0, bhp=0x41031720,db_io=0xbfff4f50, flag=1, niop=0xbfff4f4c) at mp_cmpr.c:139 #7 0x4023cfa0 in CDB___memp_pgread (dbmfp=0x848dbe0, bhp=0x41031720,can_create=0) at mp_bh.c:214 #8 0x4023eeb4 in CDB_memp_fget (dbmfp=0x848dbe0, pgnoaddr=0xbfff5038,flags=0, addrp=0xbfff503c) at mp_fget.c:353 #9 0x40214fd7 in CDB___bam_search (dbc=0x848e148, key=0xbfff51e8,flags=12802, stop=1, recnop=0x0, exactp=0xbfff5100) at bt_search.c:251 #10 0x4020d85b in CDB___bam_c_search (dbc=0x848e148, key=0xbfff51e8,flags=15, exactp=0xbfff5100) at bt_cursor.c:1594 #11 0x4020c713 in CDB___bam_c_put (dbc_orig=0x848dfe0, key=0xbfff51e8,data=0xbfff51d0, flags=15) at bt_cursor.c:982 #12 0x4021d0a4 in CDB___db_put (dbp=0x83f69b0, txn=0x0, key=0xbfff51e8,data=0xbfff51d0, flags=0) at db_am.c:508 #13 0x4026e371 in WordList::Put (this=0x83f200c, arg=@0x848aef8,flags=0) at ../htword/WordDB.h:128 #14 0x402719b9 in WordList::Override (this=0x83f200c,wordRef=@0x848aef8) at ../htword/WordList.h:118 #15 0x40276eda in HtWordList::Flush (this=0x83f200c) at HtWordList.cc:84 Thanks! Any thoughts/isights would be appreciated! -- Neal Richter Knowledgebase Developer RightNow Technologies, Inc. Customer Service for Every Web Site Office: 406-522-1485 |
From: Geoff H. <ghu...@ws...> - 2002-07-31 02:04:44
|
> Does anyone know exactly how to disable the BDB compression for > the word-database db.words.db? <http://www.htdig.org/dev/htdig-3.2/attrs.html#wordlist_compress> -Geoff |
From: Neal R. <ne...@ri...> - 2002-08-02 20:13:27
|
It looks like the excerpts DB is not compressed at all... This would be handy, since as the number of documents in an archive increases the words DB growth flattens out (there are only so many words in a language) where as the excerpts DB just keeps on growing. On Tue, 30 Jul 2002, Geoff Hutchison wrote: > > > Does anyone know exactly how to disable the BDB compression for > > the word-database db.words.db? > > <http://www.htdig.org/dev/htdig-3.2/attrs.html#wordlist_compress> > > -Geoff > > > > ------------------------------------------------------- > This sf.net email is sponsored by: Dice - The leading online job board > for high-tech professionals. Search and apply for tech jobs today! > http://seeker.dice.com/seeker.epl?rel_code=31 > _______________________________________________ > htdig-dev mailing list > htd...@li... > https://lists.sourceforge.net/lists/listinfo/htdig-dev > -- Neal Richter Knowledgebase Developer RightNow Technologies, Inc. Customer Service for Every Web Site Office: 406-522-1485 |