Re: [eXist-TEIXML] Large tables

[Wolfgang M. <wol...@ex...>]

Hi, 

it is difficult to suggest optimizations without seeing the code, but very often there's just one bottleneck somewhere which slows down everything. In addition to the index usage information, it might be helpful to look at the functions panel in the profiler. Can you identify further bottlenecks there or is the problem really in the comparisons indicated in the index usage panel? If value comparisons are the bottleneck there might be a bad optimization on the eXist side as well, which would be interesting to check.

In any case I would recommend to first update to the 2.0RC (available via the sourceforge project page). A lot of issues have been fixed since the tech preview.

If you can't figure out the bottleneck, I'll be happy to have a look at it if I had some sample data and queries (you can also send me something off list). 

Wolfgang


Am Samstag, 15. Dezember 2012 um 06:42 schrieb Peter Watson:

> 
> Hi
> 
> I'm not sure where I should pose this question, but here goes. I'm 
> producing cross-tabulation data from an XML TEI database using eXist 2.0 
> tech preview version 15855. Using XQuery I produce data in the the form 
> of .gml files for use in external programs such as nodeXL and matrix 
> explorer. The data is in the form of nodes and edges/tuples for 
> production of graphs. I can take this data and transform the 
> edges/tuples directly into tables using XQuery and simpe html. These 
> tables are effectively matrices say 25 x 100. My problem is that the 
> process is quite slow computationally. Looking at the query profiler 
> quite a lot of the time is spent making calls to the index for what are 
> interim variables where no index is available. My question is where to 
> look for information that will help me improve my code/approach or take 
> any other measure that would speed up the process. I don't have a sense 
> as to how large a computation this is in terms of XQuery/eXist. Does 
> anyone have experience they could share?
> 
> Best wishes
> 
> Peter
> 
> ------------------------------------------------------------------------------
> LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
> Remotely access PCs and mobile devices and provide instant support
> Improve your efficiency, and focus on delivering more value-add services
> Discover what IT Professionals Know. Rescue delivers
> http://p.sf.net/sfu/logmein_12329d2d
> _______________________________________________
> eXist-TEIXML mailing list
> eXi...@li... (mailto:eXi...@li...)
> https://lists.sourceforge.net/lists/listinfo/exist-teixml