Re: [Treebase-devel] harvesting

[William P. <wil...@ya...>]

On Feb 3, 2012, at 3:00 AM, Roderic Page wrote:
> When I harvest for projects like the TreeBASE browser I pause between requests, but still get time outs.

Its driving us all completely nuts too, I might add. 

TreeBASE is capable of delivering all of its NeXML files -- at least initially. But throughout the day, even with a modest string of NeXML requests (basically, it has just been you and Enrico over the last couple of days), performance steadily degrades, threads proliferate, the CPU maxes out, and ultimately it starts failing to fulfill at all -- java/tomcat gets hung up with a backlog of requests, and even very minor requests spawn treads that are blocked. Surely Hibernate -- an industry standard -- is capable of better, more robust performance. The problem, then, is figuring out the source of the leaks (memory, threads, etc), the cause of the blockages, and the reason for inadequate trash collecting. 

bp