[htdig-dev] Re: Residual database errors

[Lachlan A. <lh...@us...>]

On Friday 14 February 2003 11:16, Neal Richter wrote:

> Question:  Your message below points to an error on page 26613.=20
> Your previous message pointed to an error on page 33.
> Is the error a moving target? ;-)

I think I reduced the data set slightly, but yes, the target does seem=20
to move :(  As the attached file shows, it is now complaining about=20
page 46, and I don't think I've changed anything since the last time,=20
except the runtime flags (-v level).

> Is there something you can tell us about the type of data you are
> indexing?  Are they big pages with lots of repetitive information..
> giving htdig many similar keys which hash/sort to the same pages?

It is just micellaneous Linux documentation -- Qt, KDE, xemacs, LaTeX,=20
lots of READMEs.  I can't think off hand of any particularly=20
repetitive pages...

> Please recompile just mp_cmpr.c with "gcc -DDEBUG_CMPR [etc]" and
> post the output to a webserver
> At that point I'll check it out and get you a replacement mp_cmpr.c
> to try to get more information about the page in question...

When I compile  htdig  with that flag, the error does not occur. =20
However, I'm attaching a trace for  htdump  from a dig performed=20
without the flag, in case that helps.  I hope it isn't too big...

Cheers,
Lachlan