Re: [VuFind-General] performance question

[Chris D. <ce...@ui...>]

On Wed, Aug 22, 2007 at 04:09:26PM -0700, Joerg Messer wrote:
> Wayne,
> 
> Any idea why Solr under Jetty seems to be substantially slower then Solr under Tomcat.  I'm getting 
>   something like a factor of 5 to 10 difference in loading speed using the Tomcat that I set up for 
> the 0.5 release.  I modified my JAVA_OPTIONS as you recommended and it doesn't seem affect the Jetty 
> speed.


I am running VUFind on Solaris 10 and never did get Jetty to work for
me (don't have patience for it right now).  Tomcat has always worked
for me, so I continue to use it.  I just keep two VUFind trees on my
system: an older version of VUFind (0.5) which I only use to launch
SOLR via the Tomcat container and a separate tree for the current
releases of VUFind (I'm simplifying a bit here so you can get the
idea... BTW, I'm using my own subversion setup so I can merge my
customizations with VUFind's original code).

HOWEVER, if you go this route, you must keep the solr directory in
sync with whatever version of VUFind you are using!!!  You can do this
by going into the old 0.5 VUFind tree.  Change into the solr/conf
directory.  Then perform a "svn co" (checkout).  Do this whenever you
checkout a newer version of VUFind.

There are better ways of handling this, I'm sure.  I am too busy
working on other things at the moment :-)

Chris


> 
> Wayne Graham wrote:
> > To add on to what Andrew said, as long as you do a little Java tuning on
> > your system, you should be able to handle pretty much anything that a
> > typical library could throw at Jetty (though if you're in OS X, you may
> > want to look at using the system versions of JBoss (which uses Jetty) or
> > Tomcat). I think this is more a question of which servlet container
> > you're running than a Solr issue though, and I'd encourage you to try
> > out different containers.
> > 
> > Try out JMeter (http://jakarta.apache.org/jmeter/) to do some testing.
> > It'll let you do testing on the website to see how it would perform. You
> > can tweak the JVM settings to tweak to make it move pretty darn fast. If
> > you need some help with that, let me know...it took a bit to figure out
> > how to actually run a test the first time.
> > 
> > HTH,
> > Wayne
> > 
> > Andrew Nagy wrote:
> >>> Moving forward, is there any benefit to having the Solr piece on a
> >>> faster machine, separated from where the rest of VuFind lives?  Or is
> >>> the network overhead between the 2 boxes likely to kill any performance
> >>> boost?
> >> My $0.02 is that if performance is an issue - due to user load - then setting solr up in a distributed slave/master model would be best.  For example - you might have 3 servers with a load balancer or round robin dns with one designated as the master and the other 2 as the slaves.  Or you could have all three as masters and just make sure the index is copied between the 3 on a nightly basis after the master syncs with the catalog.
> >>
> >> I would say that seperating the web server from solr is not worth while since the heart of the system lies with Solr.  The PHP scripts are very basic and require very little memory and cpu cycles.
> >>
> >> I would suggest posting your question to the solr listserv.  They would be much more able to answer your question.  Many of the people on the list use solr in a distributed model.
> >>
> >> Andrew
> >>
> >>
> >> -------------------------------------------------------------------------
> >> This SF.net email is sponsored by: Splunk Inc.
> >> Still grepping through log files to find problems?  Stop.
> >> Now Search log events and configuration files using AJAX and a browser.
> >> Download your FREE copy of Splunk now >>  http://get.splunk.com/
> >> _______________________________________________
> >> VuFind-General mailing list
> >> VuF...@li...
> >> https://lists.sourceforge.net/lists/listinfo/vufind-general
> > 
> > 
> 
> -- 
> Joerg Messer
> Programmer/Analyst
> University of British Columbia Library
> 2206 East Mall, Vancouver, BC, Canada, V6T 1Z3
> t. 1.604.822.5091 f. 1.604.822.3201 e. joe...@ub...
> 
> -------------------------------------------------------------------------
> This SF.net email is sponsored by: Splunk Inc.
> Still grepping through log files to find problems?  Stop.
> Now Search log events and configuration files using AJAX and a browser.
> Download your FREE copy of Splunk now >>  http://get.splunk.com/
> _______________________________________________
> VuFind-General mailing list
> VuF...@li...
> https://lists.sourceforge.net/lists/listinfo/vufind-general