Re: [htdig] DB2 Problem using htdig-3.2.0b3

[<tho...@ve...>]

----- Original Message -----
From: "Jim Cole" <li...@yg...>
To: "Thorsten F=F6rnges" <tho...@ve...>
Cc: "HTDIG-GENERAL" <htd...@li...>
Sent: Thursday, February 06, 2003 12:45 AM
Subject: Re: [htdig] DB2 Problem using htdig-3.2.0b3



Hi Jim!

> If you really need features in the 3.2 branch, you should probably be
> using one of the recent 3.2.0b4 snapshots.

I've tried this. Same problem.

>  Have you tried building
> and searching a very small database (e.g. one page)?

No, not yet. Will give it a try.

Actually I use htdig to index quite a big mailarchiv - and it's growing.
htdig has to go through app. 90.000 pure textfiles that can be read local=
ly.
As I was saying htdig-3.1.6 does this job quite fine. The problem is, tha=
t I
only have about 460 MBs of harddisk space. That's enough to hold the DBs
created by htmerge but the merging process temporarily eats up to much
memory for the quota restrictions on the machine.
So I let htdig run on the internet-server to build db.wordlist and db.doc=
db,
I then load down these files and merge them on my local machine since
there's enough space. After that I load up the resulting DBs. That works =
but
is very complicated, so I tried something from the 3.2.0 branch and found
out, that htmerge isn't used during DB building any more. As I think the
temporary memory usage isn't that exessive with 3.2.0, that is the only
reason I'm trying to update to 3.2.0. Am I right concerning temp space
usage? Otherwise I could stop trying.

Thanks a lot

Thorsten