Menu
▾
▴
[gridsam-discuss] Re: GridSAM memory usage and Java heap size
|
From: Garry S. <gar...@po...> - 2006-05-05 08:26:10
|
Hi William, William Lee wrote: > I'm on holiday at the moment. Would you kindly tell me which version > you were using? GridSAM 1.1.0 rc1, OMII 2.3.0. Java 1.5, default Java Heap size Server: uname -a Linux holly 2.4.32 #1 SMP Fri Nov 25 14:41:06 GMT 2005 i686 GNU/Linux Dual processor, 2GB physical memory. regards Garry > > William > > On 5/5/06, Garry Smith <gar...@po...> wrote: > >> Hi William, >> >> Further to my previous email (with the helloworld.jsdl tests), I have >> resorted to increasing the Java heap size again as used by Tomcat. >> This action does not solve the problem but does mean that the GridSAMs >> can last longer between reboots >> >> As you can see below, with a 400MByte heap size I executed 55 iterations >> of 30 jobs each. >> GridSAM was responsive for each iteration and did not exhibit the >> slow-down experienced with the >> default heap size. >> >> The worry for me is the amount of additional memory that is being >> consumed by each iteration and that is not being released. I estimate >> that I would be able to get approx 110 iterations of 30 jobs each before >> the GridSAM stops accepting jobs again. I assume this value will be >> lower given a JSDL that contains data staging elements. >> >> These tests were to the same GridSAM as before and using the fork >> jobmanager again. It will be interesting to see if the values are >> different using the Condor, ssh and Globus jobmanagers. >> >> >> Have you tested the GridSAM core independently of Tomcat and Axis? It >> would be nice if we could pin down the memory usage. >> >> regards >> Garry >> >> >> Using top to follow memory usage: >> >> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND >> >> 22288 omii 9 0 185m 185m 13m S 0.0 9.2 0:20.96 java >> #tomcat started up >> >> 22288 omii 9 0 205m 205m 18m S 0.0 10.2 0:20.96 java >> #after 1st iteration >> >> 22288 omii 9 0 199m 199m 18m S 0.0 9.9 0:20.96 java >> #after 2nd iteration >> >> 22288 omii 9 0 200m 200m 18m S 0.0 9.9 0:20.96 java # >> after 3rd iteration >> >> 22288 omii 9 0 200m 200m 14m S 0.0 9.9 0:20.96 java >> #after 4th iteration >> >> 22288 omii 9 0 205m 205m 16m S 0.0 10.2 0:20.96 java >> #after 5th iteration >> >> 22288 omii 9 0 209m 209m 16m S 0.0 10.4 0:20.96 java # >> after 6th iteration >> >> 22288 omii 9 0 213m 213m 16m S 0.0 10.6 0:20.96 java # >> after 7th iteration >> >> 22288 omii 9 0 215m 215m 14m S 0.0 10.7 0:20.96 java # >> after 8th iteration >> >> 22288 omii 9 0 221m 221m 16m S 0.0 11.0 0:20.96 java >> #after 9th iteration >> >> 22288 omii 9 0 223m 223m 16m S 0.0 11.1 0:20.96 java >> #after 10th iteration >> >> 22288 omii 9 0 223m 223m 16m S 0.0 11.0 0:20.96 java >> #after 11th iteration >> >> 22288 omii 9 0 221m 221m 14m S 0.0 11.0 0:20.96 java >> #after 12th iteration >> >> 22288 omii 9 0 222m 222m 14m S 0.0 11.0 0:20.96 java >> #after 13th iteration >> >> 22288 omii 9 0 223m 223m 14m S 0.0 11.1 0:20.96 java >> #after 14th iteration >> >> 22288 omii 9 0 225m 225m 14m S 0.0 11.1 0:20.96 java >> #after 15th iteration >> >> 22288 omii 9 0 226m 226m 14m S 0.0 11.2 0:20.96 java >> #after 16th iteration >> >> 22288 omii 9 0 227m 227m 14m S 0.0 11.3 0:20.96 java >> #after 17th iteration >> >> 22288 omii 9 0 229m 229m 14m S 0.0 11.3 0:20.96 java >> #after 18th iteration >> >> 22288 omii 9 0 230m 230m 14m S 0.0 11.4 0:20.96 java >> #after 19th iteration >> >> 22288 omii 9 0 231m 231m 14m S 0.0 11.5 0:20.96 java >> #after 20th iteration >> >> 22288 omii 9 0 233m 233m 14m S 0.0 11.5 0:20.96 java >> #after 21st iteration >> >> 22288 omii 9 0 235m 235m 14m S 0.0 11.6 0:20.96 java >> #after 22nd iteration >> >> 22288 omii 9 0 236m 236m 14m S 0.0 11.7 0:20.96 java >> #after 23rd iteration >> >> 22288 omii 9 0 237m 237m 14m S 0.0 11.7 0:20.96 java >> #after 24th iteration >> >> 22288 omii 9 0 240m 240m 14m S 0.0 11.9 0:20.96 java >> #after 25th iteration >> >> 22288 omii 9 0 242m 242m 14m S 0.0 12.0 0:20.96 java >> #after 26th iteration >> >> 22288 omii 9 0 243m 243m 14m S 0.0 12.0 0:20.96 java >> #after 27th iteration >> >> 22288 omii 9 0 244m 244m 14m S 0.0 12.1 0:20.96 java >> #after 28th iteration >> >> 22288 omii 9 0 246m 246m 14m S 0.0 12.2 0:20.96 java >> #after 29th iteration >> >> 22288 omii 9 0 247m 247m 14m S 0.0 12.3 0:20.96 java >> #after 30th iteration >> >> 22288 omii 9 0 250m 250m 14m S 0.0 12.4 0:20.96 java >> #after 31st iteration >> >> 22288 omii 9 0 251m 251m 14m S 0.0 12.5 0:20.96 java >> #after 32nd iteration >> >> 22288 omii 9 0 252m 252m 14m S 0.0 12.5 0:20.96 java >> #after 33rd iteration >> >> 22288 omii 9 0 252m 252m 14m S 0.0 12.5 0:20.96 java >> #after 34th iteration >> >> 22288 omii 9 0 252m 252m 14m S 0.0 12.5 0:20.96 java >> #after 35th iteration >> >> 22288 omii 9 0 256m 256m 14m S 0.0 12.7 0:20.96 java >> #after 36th iteration >> >> 22288 omii 9 0 262m 262m 14m S 0.0 13.0 0:20.96 java >> #after 37th iteration >> >> 22288 omii 9 0 263m 263m 14m S 0.0 13.1 0:20.96 java >> #after 38th iteration >> >> 22288 omii 9 0 265m 265m 14m S 0.0 13.1 0:20.96 java >> #after 39th iteration >> >> 22288 omii 9 0 266m 266m 14m S 0.0 13.2 0:20.96 java >> #after 40th iteration >> >> 22288 omii 9 0 268m 268m 14m S 0.0 13.3 0:20.96 java >> #after 41st iteration >> >> 22288 omii 9 0 271m 271m 14m S 0.0 13.4 0:20.96 java >> #after 42nd iteration >> >> 22288 omii 9 0 272m 272m 14m S 0.0 13.5 0:20.96 java >> #after 43rd iteration >> >> 22288 omii 9 0 274m 274m 14m S 0.0 13.6 0:20.96 java >> #after 44th iteration >> >> 22288 omii 9 0 275m 275m 14m S 0.0 13.7 0:20.96 java >> #after 45th iteration >> >> 22288 omii 9 0 277m 277m 14m S 0.0 13.7 0:20.96 java # >> after 46th iteration >> >> 22288 omii 9 0 277m 276m 14m S 0.0 13.7 0:20.96 java >> #after 47th iteration >> >> 22288 omii 9 0 277m 277m 14m S 0.0 13.7 0:20.96 java >> #after 48th iteration >> >> 22288 omii 9 0 277m 277m 14m S 0.0 13.7 0:20.96 java >> #after 49th iteration >> >> 22288 omii 9 0 277m 277m 14m S 0.0 13.7 0:20.96 java >> #after 50th iteration >> >> 22288 omii 9 0 278m 278m 14m S 0.0 13.8 0:20.96 java >> #after 51st iteration >> >> 22288 omii 9 0 280m 280m 14m S 0.0 13.9 0:20.96 java >> #after 52nd iteration >> >> 22288 omii 9 0 281m 281m 14m S 0.0 14.0 0:20.96 java >> #after 53rd iteration >> >> 22288 omii 9 0 284m 284m 14m S 0.0 14.1 0:20.96 java >> #after 54th iteration >> >> 22288 omii 9 0 285m 285m 14m S 0.0 14.1 0:20.96 java >> #after 55th iteration. >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> > |
