[gridsam-discuss] Re: GridSAM memory usage and Java heap size

SourceForge Headquarters 1320 Columbia Street Suite 310 San Diego, CA 92101 +1 (858) 422-6466

I'm on holiday at the moment. Would you kindly tell me which version
you were using?

William

On 5/5/06, Garry Smith <gar...@po...> wrote:
> Hi William,
>
> Further to my previous email (with the helloworld.jsdl tests), I have
> resorted to increasing the Java heap size again as used by Tomcat.
> This action does not solve the problem but does mean that the GridSAMs
> can last longer between reboots
>
> As you can see below, with a 400MByte heap size I executed 55 iterations
> of 30 jobs each.
> GridSAM was responsive for each iteration and did not exhibit the
> slow-down experienced with the
> default heap size.
>
> The worry for me is the amount of additional memory that is being
> consumed by each iteration and that is not being released. I estimate
> that I would be able to get approx 110 iterations of 30 jobs each before
> the GridSAM stops accepting jobs again. I assume this value will be
> lower given a JSDL that contains data staging elements.
>
> These tests were to the same GridSAM as before and using the fork
> jobmanager again. It will be interesting to see if the values are
> different using the Condor, ssh and Globus jobmanagers.
>
>
> Have you tested the GridSAM core independently of Tomcat and Axis? It
> would be nice if we could pin down the memory usage.
>
> regards
> Garry
>
>
> Using top to follow memory usage:
>
>   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
>
>   22288 omii       9   0  185m 185m  13m S  0.0  9.2   0:20.96 java
> #tomcat started up
>
>   22288 omii       9   0  205m 205m  18m S  0.0 10.2   0:20.96 java
> #after 1st iteration
>
>   22288 omii       9   0  199m 199m  18m S  0.0  9.9   0:20.96 java
> #after 2nd iteration
>
>   22288 omii       9   0  200m 200m  18m S  0.0  9.9   0:20.96 java #
> after 3rd iteration
>
>   22288 omii       9   0  200m 200m  14m S  0.0  9.9   0:20.96 java
> #after 4th iteration
>
>   22288 omii       9   0  205m 205m  16m S  0.0 10.2   0:20.96 java
> #after 5th iteration
>
>   22288 omii       9   0  209m 209m  16m S  0.0 10.4   0:20.96 java #
> after 6th iteration
>
>   22288 omii       9   0  213m 213m  16m S  0.0 10.6   0:20.96 java #
> after 7th iteration
>
>   22288 omii       9   0  215m 215m  14m S  0.0 10.7   0:20.96 java #
> after 8th iteration
>
>   22288 omii       9   0  221m 221m  16m S  0.0 11.0   0:20.96 java
> #after 9th iteration
>
>   22288 omii       9   0  223m 223m  16m S  0.0 11.1   0:20.96 java
> #after 10th iteration
>
>   22288 omii       9   0  223m 223m  16m S  0.0 11.0   0:20.96 java
> #after 11th iteration
>
>   22288 omii       9   0  221m 221m  14m S  0.0 11.0   0:20.96 java
> #after 12th iteration
>
>   22288 omii       9   0  222m 222m  14m S  0.0 11.0   0:20.96 java
> #after 13th iteration
>
>   22288 omii       9   0  223m 223m  14m S  0.0 11.1   0:20.96 java
> #after 14th iteration
>
>   22288 omii       9   0  225m 225m  14m S  0.0 11.1   0:20.96 java
> #after 15th iteration
>
>   22288 omii       9   0  226m 226m  14m S  0.0 11.2   0:20.96 java
> #after 16th iteration
>
>   22288 omii       9   0  227m 227m  14m S  0.0 11.3   0:20.96 java
> #after 17th iteration
>
>   22288 omii       9   0  229m 229m  14m S  0.0 11.3   0:20.96 java
> #after 18th iteration
>
>   22288 omii       9   0  230m 230m  14m S  0.0 11.4   0:20.96 java
> #after 19th iteration
>
>   22288 omii       9   0  231m 231m  14m S  0.0 11.5   0:20.96 java
> #after 20th iteration
>
>   22288 omii       9   0  233m 233m  14m S  0.0 11.5   0:20.96 java
> #after 21st iteration
>
>   22288 omii       9   0  235m 235m  14m S  0.0 11.6   0:20.96 java
> #after 22nd iteration
>
>   22288 omii       9   0  236m 236m  14m S  0.0 11.7   0:20.96 java
> #after 23rd iteration
>
>   22288 omii       9   0  237m 237m  14m S  0.0 11.7   0:20.96 java
> #after 24th iteration
>
>   22288 omii       9   0  240m 240m  14m S  0.0 11.9   0:20.96 java
> #after 25th iteration
>
>   22288 omii       9   0  242m 242m  14m S  0.0 12.0   0:20.96 java
> #after 26th iteration
>
>   22288 omii       9   0  243m 243m  14m S  0.0 12.0   0:20.96 java
> #after 27th iteration
>
>   22288 omii       9   0  244m 244m  14m S  0.0 12.1   0:20.96 java
> #after 28th iteration
>
>   22288 omii       9   0  246m 246m  14m S  0.0 12.2   0:20.96 java
> #after 29th iteration
>
>   22288 omii       9   0  247m 247m  14m S  0.0 12.3   0:20.96 java
> #after 30th iteration
>
>   22288 omii       9   0  250m 250m  14m S  0.0 12.4   0:20.96 java
> #after 31st iteration
>
>   22288 omii       9   0  251m 251m  14m S  0.0 12.5   0:20.96 java
> #after 32nd iteration
>
>   22288 omii       9   0  252m 252m  14m S  0.0 12.5   0:20.96 java
> #after 33rd iteration
>
>   22288 omii       9   0  252m 252m  14m S  0.0 12.5   0:20.96 java
> #after 34th iteration
>
>   22288 omii       9   0  252m 252m  14m S  0.0 12.5   0:20.96 java
> #after 35th iteration
>
>   22288 omii       9   0  256m 256m  14m S  0.0 12.7   0:20.96 java
> #after 36th iteration
>
>   22288 omii       9   0  262m 262m  14m S  0.0 13.0   0:20.96 java
> #after 37th iteration
>
>   22288 omii       9   0  263m 263m  14m S  0.0 13.1   0:20.96 java
> #after 38th iteration
>
>   22288 omii       9   0  265m 265m  14m S  0.0 13.1   0:20.96 java
> #after 39th iteration
>
>   22288 omii       9   0  266m 266m  14m S  0.0 13.2   0:20.96 java
> #after 40th iteration
>
>   22288 omii       9   0  268m 268m  14m S  0.0 13.3   0:20.96 java
> #after 41st iteration
>
>   22288 omii       9   0  271m 271m  14m S  0.0 13.4   0:20.96 java
> #after 42nd iteration
>
>   22288 omii       9   0  272m 272m  14m S  0.0 13.5   0:20.96 java
> #after 43rd iteration
>
>   22288 omii       9   0  274m 274m  14m S  0.0 13.6   0:20.96 java
> #after 44th iteration
>
>   22288 omii       9   0  275m 275m  14m S  0.0 13.7   0:20.96 java
> #after 45th iteration
>
>   22288 omii       9   0  277m 277m  14m S  0.0 13.7   0:20.96 java #
> after 46th iteration
>
>   22288 omii       9   0  277m 276m  14m S  0.0 13.7   0:20.96 java
> #after 47th iteration
>
>   22288 omii       9   0  277m 277m  14m S  0.0 13.7   0:20.96 java
> #after 48th iteration
>
>   22288 omii       9   0  277m 277m  14m S  0.0 13.7   0:20.96 java
> #after 49th iteration
>
>   22288 omii       9   0  277m 277m  14m S  0.0 13.7   0:20.96 java
> #after 50th iteration
>
>   22288 omii       9   0  278m 278m  14m S  0.0 13.8   0:20.96 java
> #after 51st iteration
>
>  22288 omii       9   0  280m 280m  14m S  0.0 13.9   0:20.96 java
> #after 52nd iteration
>
>  22288 omii       9   0  281m 281m  14m S  0.0 14.0   0:20.96 java
> #after 53rd iteration
>
>  22288 omii       9   0  284m 284m  14m S  0.0 14.1   0:20.96 java
> #after 54th iteration
>
>  22288 omii       9   0  285m 285m  14m S  0.0 14.1   0:20.96 java
> #after 55th iteration.
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>