From: Wolfgang M. <wol...@ex...> - 2012-04-24 16:11:49
|
> I will do some test and try first, do some basic config change ,such as jvm > ,cache, index mask, collection structure,etc, > any sugguests of you? I used half of the 50gb data set you mentioned to test the performance of my recent changes to the lucene indexing. Uploading and querying does work with a few tweaks: Most important, the size calculation for the collection cache has a bug, so to store and query a larger number of documents and collections, you need to specify a high value for collection cache in conf.xml. I used collectionCache="10000M". In reality it consumes a lot less, but the higher value is needed to work around the bug. I'll try to fix the issue. Also, I set cacheSize="1024M" because I wanted to create a bunch of indexes. -Xmx was set to 8192m. Wolfgang |