[htdig-dev] 3.2b4 snapshots

[<sa...@sa...>]

Can anyone comment on what would be required to make the htdig 3.2b4 code 64 bit clean ?

I am merging large databases, and the htmerge requires >4Gb memory so I have had to compile using -m64 (Solaris 8, gcc 3.2.1) but had to make some small changes in the code to make it compile, and to avoid a segmentation error. My concern is that there may be other 64 bit issues in the code which are causing corruptions. It seems that when the database sizes get really large, my merge results are unpredictable.

Has anyone had success with a 64 bit compilation, or can give me any pointers to where there could be addressing problems in the code ? Could I be hitting other limits (e.g. in Berkeley DB) ?

I am indexing > 400,000 pages - any thoughts on whether htdig 3.3 can scale to this ?

Thanks

Sandy