[ http://oss.101tec.com/jira/browse/KATTA-17?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=10102#action_10102 ]
Stefan Groschupf commented on KATTA-17:
great contribution! Thanks a lot. Some comments looking through the loadTest code:
+ not sure why you create a execution service with just one thread. I would leave that null until it is set via startSearch.
+ we might even want to make the # of threads configurable and also increase them incrementally to see where the point starts that katta starts queuing.
+ We for sure dont want to use Katta.search(_indexNames, _queryString, _count); but the Client object. Using Katta.search creates a client object with each search, what means it creates a zookeeper connection with each search. This is a lot of overhead.
+ we might want to rename TestSearcherMetaData to LoadTestNodeMetaData
+ We need to use than just one word, we might need to use a complete dictionary, see SampleIndexGenerator for an example. Lucene is just great i caching, so a single world will not give us good results.
+ also I wonder in generell how we want to analyze the result. I suggest we try to make sure the clocks are sync of this boxes. Than we just write a log file with <timestamp, loadTestNodeID, queryString, duration>. If we than just collect the results log files it would be straight forward to compute queries per second and the duration. Maybe we can use jfreechart to create such a graph (http://www.jfree.org/jfreechart/images/PriceVolumeDemo1.png)
Where we graph number of queries per sec and there duration.
+ also it would be super cool if we can have an ant task that runs 1 master, 2 searchNodes, 2 loadTestNodes on a singel server and than run this within a loadTest ant task and generate a graph. My vison would be that we can run this as part of the release and compare the performance over time.
> create a load test running on ec2
> Key: KATTA-17
> URL: http://oss.101tec.com/jira/browse/KATTA-17
> Project: Katta
> Issue Type: Improvement
> Reporter: Stefan Groschupf
> Assignee: Peter Voss
> Fix For: 0.6
> The idea is to run load tests on ec2 to make performance a first level citizen.
> + write some script that creates a ec2 cluster
> + deploy the current sources on this cluster
> + write a class that generates a test index
> + start katta, deploy the test index
> + run a http://faban.sunsource.net test
> + graph the result
> + shutdown the cluster.
This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators: http://oss.101tec.com/jira/secure/Administrators.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira