Menu
▾
▴
[gridsam-discuss] GridSAM memory usage and Java heap size
|
From: Garry S. <gar...@po...> - 2006-05-04 17:16:25
|
Hi William, Further to my previous email (with the helloworld.jsdl tests), I have resorted to increasing the Java heap size again as used by Tomcat. This action does not solve the problem but does mean that the GridSAMs can last longer between reboots As you can see below, with a 400MByte heap size I executed 55 iterations of 30 jobs each. GridSAM was responsive for each iteration and did not exhibit the slow-down experienced with the default heap size. The worry for me is the amount of additional memory that is being consumed by each iteration and that is not being released. I estimate that I would be able to get approx 110 iterations of 30 jobs each before the GridSAM stops accepting jobs again. I assume this value will be lower given a JSDL that contains data staging elements. These tests were to the same GridSAM as before and using the fork jobmanager again. It will be interesting to see if the values are different using the Condor, ssh and Globus jobmanagers. Have you tested the GridSAM core independently of Tomcat and Axis? It would be nice if we could pin down the memory usage. regards Garry Using top to follow memory usage: PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 22288 omii 9 0 185m 185m 13m S 0.0 9.2 0:20.96 java #tomcat started up 22288 omii 9 0 205m 205m 18m S 0.0 10.2 0:20.96 java #after 1st iteration 22288 omii 9 0 199m 199m 18m S 0.0 9.9 0:20.96 java #after 2nd iteration 22288 omii 9 0 200m 200m 18m S 0.0 9.9 0:20.96 java # after 3rd iteration 22288 omii 9 0 200m 200m 14m S 0.0 9.9 0:20.96 java #after 4th iteration 22288 omii 9 0 205m 205m 16m S 0.0 10.2 0:20.96 java #after 5th iteration 22288 omii 9 0 209m 209m 16m S 0.0 10.4 0:20.96 java # after 6th iteration 22288 omii 9 0 213m 213m 16m S 0.0 10.6 0:20.96 java # after 7th iteration 22288 omii 9 0 215m 215m 14m S 0.0 10.7 0:20.96 java # after 8th iteration 22288 omii 9 0 221m 221m 16m S 0.0 11.0 0:20.96 java #after 9th iteration 22288 omii 9 0 223m 223m 16m S 0.0 11.1 0:20.96 java #after 10th iteration 22288 omii 9 0 223m 223m 16m S 0.0 11.0 0:20.96 java #after 11th iteration 22288 omii 9 0 221m 221m 14m S 0.0 11.0 0:20.96 java #after 12th iteration 22288 omii 9 0 222m 222m 14m S 0.0 11.0 0:20.96 java #after 13th iteration 22288 omii 9 0 223m 223m 14m S 0.0 11.1 0:20.96 java #after 14th iteration 22288 omii 9 0 225m 225m 14m S 0.0 11.1 0:20.96 java #after 15th iteration 22288 omii 9 0 226m 226m 14m S 0.0 11.2 0:20.96 java #after 16th iteration 22288 omii 9 0 227m 227m 14m S 0.0 11.3 0:20.96 java #after 17th iteration 22288 omii 9 0 229m 229m 14m S 0.0 11.3 0:20.96 java #after 18th iteration 22288 omii 9 0 230m 230m 14m S 0.0 11.4 0:20.96 java #after 19th iteration 22288 omii 9 0 231m 231m 14m S 0.0 11.5 0:20.96 java #after 20th iteration 22288 omii 9 0 233m 233m 14m S 0.0 11.5 0:20.96 java #after 21st iteration 22288 omii 9 0 235m 235m 14m S 0.0 11.6 0:20.96 java #after 22nd iteration 22288 omii 9 0 236m 236m 14m S 0.0 11.7 0:20.96 java #after 23rd iteration 22288 omii 9 0 237m 237m 14m S 0.0 11.7 0:20.96 java #after 24th iteration 22288 omii 9 0 240m 240m 14m S 0.0 11.9 0:20.96 java #after 25th iteration 22288 omii 9 0 242m 242m 14m S 0.0 12.0 0:20.96 java #after 26th iteration 22288 omii 9 0 243m 243m 14m S 0.0 12.0 0:20.96 java #after 27th iteration 22288 omii 9 0 244m 244m 14m S 0.0 12.1 0:20.96 java #after 28th iteration 22288 omii 9 0 246m 246m 14m S 0.0 12.2 0:20.96 java #after 29th iteration 22288 omii 9 0 247m 247m 14m S 0.0 12.3 0:20.96 java #after 30th iteration 22288 omii 9 0 250m 250m 14m S 0.0 12.4 0:20.96 java #after 31st iteration 22288 omii 9 0 251m 251m 14m S 0.0 12.5 0:20.96 java #after 32nd iteration 22288 omii 9 0 252m 252m 14m S 0.0 12.5 0:20.96 java #after 33rd iteration 22288 omii 9 0 252m 252m 14m S 0.0 12.5 0:20.96 java #after 34th iteration 22288 omii 9 0 252m 252m 14m S 0.0 12.5 0:20.96 java #after 35th iteration 22288 omii 9 0 256m 256m 14m S 0.0 12.7 0:20.96 java #after 36th iteration 22288 omii 9 0 262m 262m 14m S 0.0 13.0 0:20.96 java #after 37th iteration 22288 omii 9 0 263m 263m 14m S 0.0 13.1 0:20.96 java #after 38th iteration 22288 omii 9 0 265m 265m 14m S 0.0 13.1 0:20.96 java #after 39th iteration 22288 omii 9 0 266m 266m 14m S 0.0 13.2 0:20.96 java #after 40th iteration 22288 omii 9 0 268m 268m 14m S 0.0 13.3 0:20.96 java #after 41st iteration 22288 omii 9 0 271m 271m 14m S 0.0 13.4 0:20.96 java #after 42nd iteration 22288 omii 9 0 272m 272m 14m S 0.0 13.5 0:20.96 java #after 43rd iteration 22288 omii 9 0 274m 274m 14m S 0.0 13.6 0:20.96 java #after 44th iteration 22288 omii 9 0 275m 275m 14m S 0.0 13.7 0:20.96 java #after 45th iteration 22288 omii 9 0 277m 277m 14m S 0.0 13.7 0:20.96 java # after 46th iteration 22288 omii 9 0 277m 276m 14m S 0.0 13.7 0:20.96 java #after 47th iteration 22288 omii 9 0 277m 277m 14m S 0.0 13.7 0:20.96 java #after 48th iteration 22288 omii 9 0 277m 277m 14m S 0.0 13.7 0:20.96 java #after 49th iteration 22288 omii 9 0 277m 277m 14m S 0.0 13.7 0:20.96 java #after 50th iteration 22288 omii 9 0 278m 278m 14m S 0.0 13.8 0:20.96 java #after 51st iteration 22288 omii 9 0 280m 280m 14m S 0.0 13.9 0:20.96 java #after 52nd iteration 22288 omii 9 0 281m 281m 14m S 0.0 14.0 0:20.96 java #after 53rd iteration 22288 omii 9 0 284m 284m 14m S 0.0 14.1 0:20.96 java #after 54th iteration 22288 omii 9 0 285m 285m 14m S 0.0 14.1 0:20.96 java #after 55th iteration. |
