|
From: John H. L. <jl...@ar...> - 2008-02-04 18:31:55
|
Hi Jack. It sounds like you need to increase the number of open files that a single process can have on your system. The more indexes you're searching, the more filehandles the searcher process needs. On Unix-like systems, "ulimit -n" will tell you the current setting, and "ulimit -n N" will set a new value for your current shell. If you're using Linux, you can usually set these values permanently in / etc/security/limits.conf. For our systems, we use an arbitrary but high ulimit -n 32768. Hope this helps. -J On Feb 4, 2008, at 7:06 AM, Pope, Jackson wrote: > Hiya all, > > I’m trying to run NutchWax for searching. It’s all set up ok, doing > incremental indexing, and works fine. I’m not merging the indexes > however (I’ve a separate directory for each under /indexes, with an > index.done file in each). This works fine for small numbers of > indexes but with large numbers of indexes, I get an error when > browsing to the Nutchwax search page (before entering any search > criteria): Too many files open. > > Do I have to merge all the indexes together to get around this, or > is there another solution? > > Cheers, > > Jack > > Jackson Pope > Technical Lead > Web Archiving Team > The British Library > +44 (0)1937 54 6942 > > ************************************************************************** > > Experience the British Library online at www.bl.uk > > The British Library’s new interactive Annual Report and Accounts > 2006/07 : www.bl.uk/mylibrary > > Help the British Library conserve the world's knowledge. Adopt a > Book. www.bl.uk/adoptabook > > The Library's St Pancras site is WiFi - enabled > > ************************************************************************* > > The information contained in this e-mail is confidential and may be > legally privileged. It is intended for the addressee(s) only. If you > are not the intended recipient, please delete this e-mail and notify > the pos...@bl... : The contents of this e-mail must not be > disclosed or copied without the sender's consent. > > The statements and opinions expressed in this message are those of > the author and do not necessarily reflect those of the British > Library. The British Library does not take any responsibility for > the views of the author. > > ************************************************************************* > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2008. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/_______________________________________________ > Archive-access-discuss mailing list > Arc...@li... > https://lists.sourceforge.net/lists/listinfo/archive-access-discuss |