Re: [Exist-development] query collection containing one million documents

[Patrick S. <pat...@zi...>]

  Hi Thomas,

> What type index did you defined?
my index definition is:

<collection xmlns="http://exist-db.org/collection-config/1.0">
<index xmlns:atom="http://www.xml-cml.org/schema">
<fulltext default="none" attributes="no"/>
         ...
<create qname="@id" type="xs:string"/>
</index>
</collection>

> It may help to define a numeric type of range index and cast the value 
> to a number when you compare it.
I changed the index to integer:
<create qname="@id" type="xs:integer"/>

but there is still no improvement

09 Jul 2010 16:52:47,078 [P1-9] DEBUG (XQuery.java [compile]:161) - 
Compilation took 5 ms
09 Jul 2010 16:52:49,177 [P1-9] TRACE (Optimize.java 
[visitGeneralComparison]:219) - exist:optimize: found optimizable: 
org.exist.xquery.GeneralComparison
09 Jul 2010 16:52:49,178 [P1-9] TRACE (Optimize.java [before]:240) - 
exist:optimize: context step: 
descendant-or-self::xq:molecule[attribute::id = 298038]
09 Jul 2010 16:52:49,178 [P1-9] TRACE (Optimize.java [before]:241) - 
exist:optimize: context var: null
09 Jul 2010 16:52:50,465 [P1-9] TRACE (GeneralComparison.java 
[preSelect]:266) - Using QName index on type xs:integer
09 Jul 2010 16:52:50,465 [P1-9] TRACE (GeneralComparison.java 
[preSelect]:298) - Using QName range index for key: 298038
09 Jul 2010 16:52:50,625 [P1-9] TRACE (Optimize.java [eval]:120) - 
exist:optimize: pre-selection: 1
09 Jul 2010 16:52:50,696 [P1-9] TRACE (Optimize.java [eval]:140) - 
Ancestor selection took 71
09 Jul 2010 16:52:50,697 [P1-9] TRACE (Optimize.java [eval]:141) - Found: 1
09 Jul 2010 16:52:50,697 [P1-9] TRACE (Optimize.java [eval]:152) - 
exist:optimize: context after optimize: 1
09 Jul 2010 16:52:50,788 [P1-9] TRACE (Optimize.java [eval]:160) - 
exist:optimize: inner expr took 91; found: 1
09 Jul 2010 16:52:50,789 [P1-9] DEBUG (XQuery.java [execute]:231) - 
Execution took 3.710 ms
09 Jul 2010 16:52:50,789 [P1-9] DEBUG (HTTPUtils.java 
[addLastModifiedHeader]:61) - mostRecentDocumentTime: 0
09 Jul 2010 16:52:50,789 [P1-9] DEBUG (HTTPUtils.java 
[addLastModifiedHeader]:61) - mostRecentDocumentTime: 0
09 Jul 2010 16:52:50,790 [P1-9] INFO  (RpcConnection.java [doQuery]:303) 
- query took 3711ms.
09 Jul 2010 16:52:50,790 [P1-9] DEBUG (RpcConnection.java [queryP]:2434) 
- found 1
09 Jul 2010 16:52:50,814 [P1-9] DEBUG (RpcConnection.java 
[retrieveFirstChunk]:2991) - Writing to temporary file: 
eXistRPCC4083305984497633446.xml
09 Jul 2010 16:53:08,575 [exist_QuartzScheduler_Worker-2] DEBUG 
(NGramIndex.java [sync]:86) - SYNC NGRAM
09 Jul 2010 16:53:08,575 [exist_QuartzScheduler_Worker-2] INFO  
(NativeBroker.java [sync]:3191) - Memory: 3.448.768K total; 7.281.792K 
max; 2.636.440K free


Thank you

Patrick