Re: [htdig] Virtual memory exceeded in `new' Bus Error - core dumped

[Geoff H. <ghu...@ws...>]

On Mon, 3 Jun 2002, Roger Beulen wrote:

> At our company we have htdig version 3.1.2 running. One a week we run a
> full update with every day an update on that full update. Always worked
> fine until last week.

This is somewhat unrelated, but you may wish to upgrade to 3.1.6, which is
the latest production version. <http://www.htdig.org/RELEASE.html>

> It seems the full update still works fine but the daily update doesn't.

I'm not sure what you mean by a "full update" or a "daily update." Are you
sure that your various updates aren't taking long enough that they clobber
each other? Your multiple copies of the htdig program would seem to
indicate this.

> DB2 problem...: page 1699: illegal page type or format
> DB2 problem...: PANIC: Invalid argument
> DB2 problem...: page 1699: illegal page type or format
> DB2 problem...: PANIC: Invalid argument

Yes, this is almost certainly a corrupted database.

I'd turn off the automatic indexing (assumedly from cron). Run your
indexing *once* with no cron interference and time it. If it takes more
than a day, you'll probably want to space your cron updates
accordingly. You may also want to consider ways to speed up indexing, like
local_urls:

<http://www.htdig.org/attrs.html#local_urls>

--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/