Re: [Archive-access-discuss] NutchWax Search error

[John H. L. <jl...@ar...>]

Hi Jack.

It sounds like you need to increase the number of open files that a  
single process can have on your system. The more indexes you're  
searching, the more filehandles the searcher process needs.

On Unix-like systems, "ulimit -n" will tell you the current setting,  
and "ulimit -n N" will set a new value for your current shell. If  
you're using Linux, you can usually set these values permanently in / 
etc/security/limits.conf.

For our systems, we use an arbitrary but high ulimit -n 32768.

Hope this helps.

-J

On Feb 4, 2008, at 7:06 AM, Pope, Jackson wrote:

> Hiya all,
>
> I’m trying to run NutchWax for searching. It’s all set up ok, doing  
> incremental indexing, and works fine. I’m not merging the indexes  
> however (I’ve a separate directory for each under /indexes, with an  
> index.done file in each). This works fine for small numbers of  
> indexes but with large numbers of indexes, I get an error when  
> browsing to the Nutchwax search page (before entering any search  
> criteria): Too many files open.
>
> Do I have to merge all the indexes together to get around this, or  
> is there another solution?
>
> Cheers,
>
> Jack
>
> Jackson Pope
> Technical Lead
> Web Archiving Team
> The British Library
> +44 (0)1937 54 6942
>
> **************************************************************************
>
> Experience the British Library online at www.bl.uk
>
> The British Library’s new interactive Annual Report and Accounts  
> 2006/07 : www.bl.uk/mylibrary
>
> Help the British Library conserve the world's knowledge. Adopt a  
> Book. www.bl.uk/adoptabook
>
> The Library's St Pancras site is WiFi - enabled
>
> *************************************************************************
>
> The information contained in this e-mail is confidential and may be  
> legally privileged. It is intended for the addressee(s) only. If you  
> are not the intended recipient, please delete this e-mail and notify  
> the pos...@bl... : The contents of this e-mail must not be  
> disclosed or copied without the sender's consent.
>
> The statements and opinions expressed in this message are those of  
> the author and do not necessarily reflect those of the British  
> Library. The British Library does not take any responsibility for  
> the views of the author.
>
> *************************************************************************
>
> -------------------------------------------------------------------------
> This SF.net email is sponsored by: Microsoft
> Defy all challenges. Microsoft(R) Visual Studio 2008.
> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/_______________________________________________
> Archive-access-discuss mailing list
> Arc...@li...
> https://lists.sourceforge.net/lists/listinfo/archive-access-discuss