From: Greg B. <bar...@gm...> - 2012-05-16 18:43:49
|
In addition to collection load time issues (previous post) I believe I may be having lucene index issues. I setup a super simple test case: *let $searchString := 'case study'* *let $searchDocs := $global:FullText/doc[ft:query(., $searchString)]* *return count($searchDocs)* A few profiler results: String [13:41] luceneFull122.875String [13:41]luceneFull211.764 best case results are 6 seconds! That is way much unless I am mistaking. Another case: *let $searchString := '* "content marketing" OR "keywords" OR "content strategy" OR "case study" *'* *let $searchDocs := $global:FullText/doc[ft:query(., $searchString)]* *return count($searchDocs)* A few profiler results: String [13:41]luceneFull31.541 Averages 0.5 seconds -- much more reasonable. This would seem more complex than the above. I am guessing I have cache or index issues. Any thoughts? Other: 1) No other loads 2) about 150K documents in collection, about 5k each on average 3) System below 4) Indexes follows that System Status GeneralUptime:PT11H49M53.649SeXist Version:1.5.0deveXist Build:20120202eXist Home:/opt/exist-1.5.2SVN Revision:0000Operating System:Linux 2.6.39.1-x86_64-linode19 amd64File encoding:UTF-8JavaVendor:Sun Microsystems Inc.Version:1.6.0_21Implementation:Java HotSpot(TM) 64-Bit Server VMInstallation:/usr/java/jdk1.6.0_21/jreTemp file path: /opt/exist-1.5.2/tools/jetty/tmpMemory UsageMax. Memory:3276800KCurrent Total:3066752KFree:898608K <collection xmlns="http://exist-db.org/collection-config/1.0"> <index xmlns:c="http://s.opencalais.com/1/pred/" xmlns:rdf=" http://www.w3.org/1999/02/22-rdf-syntax-ns#"> <fulltext default="none" attributes="false" alphanum="false"/> <create qname="@type" type="xs:string"/> <create qname="@name" type="xs:string"/> <create qname="docURI" type="xs:string"/> <create qname="@docURI" type="xs:string"/> <create qname="@URI" type="xs:string"/> <create qname="@URL" type="xs:string"/> <create qname="Event" type="xs:string"/> <create qname="Entity" type="xs:string"/> <create qname="@addedDate" type="xs:dateTime"/> <!-- <create qname="@createdDate" type="xs:date"/> --> <!-- <create qname="@access_Level" type="xs:integer"/> --> <lucene> <text qname="@title"/> <text qname="@name"/> <text qname="Object"/> <text qname="Subject"/> <text qname="doc"/> </lucene> </index> </collection> -- Greg Bardwell bar...@gm... |