From: Wayne G. <ws...@wm...> - 2008-07-07 15:54:10
|
I'm still going through the new stuff in Solr, but there are some interesting new elements. ramBufferedSizeMB (can be set with maxBufferedDocs) If both are set, the first one reached triggers a flush. The default is 32MB. You may also want to look at the httpCaching section if you are using caching, also if you're behind a load balancer, check out the healthcheck section (uncomment the server-eneabled section). Wayne Barnett, Jeffrey wrote: > Great, thanks. > > Are there any other solrconfig tweaks you migh recommend for building large indices? I've scanned and learned from the solr wiki you pointed to earlier (thanks for that too), but I'm thinking there might be specific things about the vufind environment that might make special case logic apply. For one thing, I'm doing all of this offline, with no simultaneous query activity. > > -----Original Message----- > From: Wayne Graham [mailto:ws...@wm...] > Sent: Monday, July 07, 2008 9:58 AM > To: Barnett, Jeffrey > Cc: vuf...@li... > Subject: Re: excessive commits / autowarming > > In solrconfig.xml: > > ... > <maxTime>20000</maxTime> > ... > > Barnett, Jeffrey wrote: > >> I'm glad to hear this is tuneable. If the change isn't too complex (I assume a solrconfig parameter), could you post it separately (or send me a note) so that it can be customized on a site by site (or even run by run) basis? >> >> -----Original Message----- >> From: Wayne Graham [mailto:ws...@wm...] >> Sent: Monday, July 07, 2008 9:31 AM >> To: Barnett, Jeffrey >> Cc: vuf...@li... >> Subject: Re: excessive commits / autowarming >> >> This is a "feature" of Solr 1.3. In 1.2, you only set a maxDocs for >> autocommits in the update handler. This behavior changed a bit in 1.3 to >> also include a maxTime element. Essentially, if one of the two criteria >> are met, a commit occurs (which you're seeing). I just committed a >> change that will extend this to 20 seconds or 10,000 records. >> >> Wayne >> >> Barnett, Jeffrey wrote: >> >> >>> On closer examination of a longer log snippet, the better question might be Why is MarcImporter opening closing and autowarming Searchers all over the place? >>> .... >>> >>> > > -- > /** > * Wayne Graham > * Earl Gregg Swem Library > * PO Box 8794 > * Williamsburg, VA 23188 > * 757.221.3112 > * http://swem.wm.edu/blogs/waynegraham/ > */ > > > -- /** * Wayne Graham * Earl Gregg Swem Library * PO Box 8794 * Williamsburg, VA 23188 * 757.221.3112 * http://swem.wm.edu/blogs/waynegraham/ */ |