Re: [htdig-dev] Re: [htdig-members] Results of Possible Efficiency improvment for 3.2.0

[Jim <li...@yg...>]

On Thu, 13 Jan 2005, Neal Richter wrote:

>>> 	As far as speed testing I would love it if a couple of you could 
>>> index a decent sized site (pefferable local to eliminate network 
>>> latency) with and without the index compression enabled and report back 
>>> your speed & size results.
>>> 
>>> wordlist_compress:         false
>>> wordlist_compress_zlib:    false
>> 
>> Here is what I got.
>> 
>> With compression:
>> 2296.03 user
>> 224.52 system
>> 8:10:56 elapsed
>> 
>> 10592256 Jan 10 09:46 db.docdb
>> 10461184 Jan 10 09:44 db.docs.index
>> 90120192 Jan 10 09:44 db.excerpts
>> 113465344 Jan 10 09:44 db.words.db
>> 16384 Jan 10 09:44 db.words.db_weakcmpr
>> 
>> Without compression:
>> 450.46 user
>> 123.33 system
>> 4:56:01 elapsed
>
>  Wow.. quite a difference.
>
>
>> Misplaced the file sizes for this run. I can rerun it some night if it
>> is important.
>
>   If you can some time..

   10526720 Jan 14 00:13 db.docdb
   10428416 Jan 14 00:13 db.docs.index
   90021888 Jan 14 00:13 db.excerpts
   435798016 Jan 14 00:12 db.words.db


Jim