[opennms-devel] Crashes

[Michael O. <Mic...@th...>]

Hi,

We're consistently (every few hours) getting crashes in opennms 1.2.81.
Any advice on what this may be related to? Stack trace below.

#
# An unexpected error has been detected by HotSpot Virtual Machine:
#
#  SIGSEGV (0xb) at pc=3D0x00000037dda6ff20, pid=3D5345, =
tid=3D1130924384
#
# Java VM: Java HotSpot(TM) 64-Bit Server VM (1.5.0_08-b03 mixed mode)
# Problematic frame:
# C  [libc.so.6+0x6ff20]  strlen+0x10
#

---------------  T H R E A D  ---------------

Current thread (0x0000002b684e71a0):  JavaThread "PingManager.Pinger-0"
[_thread_in_native, id=3D5648]

siginfo:si_signo=3D11, si_errno=3D0, si_code=3D1, =
si_addr=3D0x00000000ddb0f3ed

Registers:
RAX=3D0x00000000ddb0f3ed, RBX=3D0x0000000000000001, =
RCX=3D0x0000000000000003,
RDX=3D0x00000000436878d8
RSP=3D0x00000000436870d8, RBP=3D0x0000000043687770, =
RSI=3D0x0000002b67829401,
RDI=3D0x00000000ddb0f3ed
R8 =3D0x0000000000000000, R9 =3D0x0000000000000002, =
R10=3D0x0000000000000053,
R11=3D0x0000002b678294cc
R12=3D0x0000000000000000, R13=3D0x00000000ddb0f3ed, =
R14=3D0x0000002b21836300,
R15=3D0x0000000043687780
RIP=3D0x00000037dda6ff20, EFL=3D0x0000000000010217,
CSGSFS=3D0x000000000000454b, ERR=3D0x0000000000000004
  TRAPNO=3D0x000000000000000e

Top of Stack: (sp=3D0x00000000436870d8)
0x00000000436870d8:   00000037dda42a1c 0000000043687410
0x00000000436870e8:   0000002a95b1e22c 0000005d00000000
0x00000000436870f8:   0000002b661bd730 0000000043687aa0
0x0000000043687108:   0000000000000000 0000000000000000
0x0000000043687118:   0000000043687350 0000000000000000
0x0000000043687128:   0000000000000000 0000000043687ab0
0x0000000043687138:   0000000043687ab0 00000000436877e0
0x0000000043687148:   00000000684e7920 0000000043687ab8
0x0000000043687158:   0000000043687ab8 0000000043687ac0
0x0000000043687168:   0000000043687ac0 0000000043687ac8
0x0000000043687178:   0000000043687ac8 0000002b621accb8
0x0000000043687188:   0000002a95dbe040 0000000043687ad0
0x0000000043687198:   0000000043687ad0 0000000043687ad8
0x00000000436871a8:   7300000043687ad8 0000000043687a20
0x00000000436871b8:   0000000043687ae0 0000000043687200
0x00000000436871c8:   0000000095aba5b3 00000000ffffffff
0x00000000436871d8:   0000000000000000 0000000000000000
0x00000000436871e8:   0000000000000000 0000000000000000
0x00000000436871f8:   0000000a00000000 0000000000000000
0x0000000043687208:   0000000100000016 0000000043687738
0x0000000043687218:   0000002b678294c7 0000001243687b08
0x0000000043687228:   ffffffffffffffff 0000000000000000
0x0000000043687238:   00000000436878a0 0000002b678294b9
0x0000000043687248:   0000000043687b18 0000000043687b20
0x0000000043687258:   0000000043687b20 0000000043687360
0x0000000043687268:   0000002a9952c888 0000000043687368
0x0000000043687278:   0000000043687360 00000000436872b0
0x0000000043687288:   0000002a95bb75a0 00000000436872b0
0x0000000043687298:   0000002a9941eae8 0000000043687360
0x00000000436872a8:   0000000043687aa0 0000000043687350
0x00000000436872b8:   0000002a95bb781d 0000000043687380
0x00000000436872c8:   0000002b678294cc 0000009f00000000=20

Instructions: (pc=3D0x00000037dda6ff20)
0x00000037dda6ff10:   48 89 f9 83 e1 07 48 89 f8 74 15 f7 d9 83 c1 08
0x00000037dda6ff20:   80 38 00 0f 84 cc 00 00 00 48 ff c0 ff c9 75 f0=20

Stack: [0x0000000043588000,0x0000000043689000),  =
sp=3D0x00000000436870d8,
free space=3D1020k
Native frames: (J=3Dcompiled Java code, j=3Dinterpreted, Vv=3DVM code,
C=3Dnative code)
C  [libc.so.6+0x6ff20]  strlen+0x10
C  [libc.so.6+0x5cad9]  vsprintf+0x79

Java frames: (J=3Dcompiled Java code, j=3Dinterpreted, Vv=3DVM code)
J
org.opennms.protocols.icmp.IcmpSocket.send(Ljava/net/DatagramPacket;)V
J
org.opennms.netmgt.discovery.PingManager$Pinger.poll(Lorg/opennms/netmgt
/discovery/IPPollAddress;)Z
v  ~I2CAdapter
j  org.opennms.netmgt.discovery.PingManager$Pinger.run()V+176
j  java.lang.Thread.run()V+11
v  ~StubRoutines::call_stub

---------------  P R O C E S S  ---------------

Java Threads: ( =3D> current thread )
  0x0000002b688d58a0 JavaThread "ThreshdScheduler-5 Pool-fiber4"
[_thread_blocked, id=3D6325]
  0x0000002b67b9c940 JavaThread "Capsd Rescan Pool-fiber2"
[_thread_blocked, id=3D21388]
  0x0000002b6677d4d0 JavaThread "DataSenderPool-fiber1"
[_thread_blocked, id=3D5964]
  0x0000002b667eb030 JavaThread "RTC Updater Pool-fiber8"
[_thread_blocked, id=3D5929]
  0x0000002b65ad0b80 JavaThread "EventHandlerPool-fiber0"
[_thread_blocked, id=3D5922]
  0x0000002b684e9e80 JavaThread "DestroyJavaVM" [_thread_blocked,
id=3D5345]
  0x0000002b68812da0 JavaThread "PollerScheduler-30 Pool-fiber14"
[_thread_blocked, id=3D5663]
  0x0000002b68804e60 JavaThread "Vacuumd-Thread" [_thread_blocked,
id=3D5650]
=3D>0x0000002b684e71a0 JavaThread "PingManager.Pinger-0"
[_thread_in_native, id=3D5648]
  0x0000002b6710fe50 JavaThread "CollectdScheduler-50 Pool-fiber0"
[_thread_blocked, id=3D5645]
  0x0000002b684e6080 JavaThread "ICMPReceiver48879" daemon
[_thread_in_native, id=3D5644]
  0x0000002b684f58a0 JavaThread "PingManager--16657" daemon
[_thread_blocked, id=3D5643]
  0x0000002b684f4750 JavaThread "Discovery:SuspectEventGenerator"
[_thread_blocked, id=3D5642]
  0x0000002b684eb620 JavaThread "ThreshdScheduler-5 Pool"
[_thread_blocked, id=3D5641]
  0x0000002b684ea5c0 JavaThread "CollectdScheduler-50 Pool"
[_thread_blocked, id=3D5640]
  0x0000002b6885bba0 JavaThread "PollerScheduler-30 Pool"
[_thread_blocked, id=3D5639]
  0x0000002b684e8570 JavaThread "RTCManager:BroadcastEventProcessor"
[_thread_blocked, id=3D5638]
  0x0000002b684f6570 JavaThread "Scriptd-Executor" [_thread_blocked,
id=3D5637]
  0x0000002b68859840 JavaThread "default" [_thread_blocked, id=3D5636]
  0x0000002b68858780 JavaThread "Capsd Scheduler" [_thread_blocked,
id=3D5635]
  0x0000002b6885d150 JavaThread "Actiond-Executor" [_thread_blocked,
id=3D5634]
  0x0000002b6885c0a0 JavaThread "Actiond-Executor-Reaper" daemon
[_thread_blocked, id=3D5633]
  0x0000002b68856e10 JavaThread "OpenNMS.Dhcpd" [_thread_in_native,
id=3D5632]
  0x0000002b68855cf0 JavaThread "DHCPReceiver2" daemon
[_thread_in_native, id=3D5631]
  0x0000002b68833ea0 JavaThread "TrapQueueProcessor" [_thread_blocked,
id=3D5630]
  0x0000002b68832ec0 JavaThread "UDP UUID Sender[5817]"
[_thread_blocked, id=3D5629]
  0x0000002b68898a20 JavaThread "UDP Event Processor[5817]"
[_thread_blocked, id=3D5628]
  0x0000002b688ece80 JavaThread "UDP Event Receiver[5817]"
[_thread_in_native, id=3D5627]
  0x0000002b688ed690 JavaThread "Event TCP Server[5817]"
[_thread_in_native, id=3D5626]
  0x0000002b68d2ef80 JavaThread "Discovery:BroadcastEventProcessor"
[_thread_blocked, id=3D5625]
  0x0000002b66a07140 JavaThread "Threshd:BroadcastEventProcessor"
[_thread_blocked, id=3D5582]
  0x0000002b66a9b220 JavaThread "Collectd:BroadcastEventProcessor"
[_thread_blocked, id=3D5571]
  0x0000002b661bee00 JavaThread "Poller:PollerEventProcessor"
[_thread_blocked, id=3D5570]
  0x0000002b68d12030 JavaThread "Timer-0" [_thread_blocked, id=3D5569]
  0x0000002b688ecbd0 JavaThread "Scriptd:BroadcastEventProcessor"
[_thread_blocked, id=3D5567]
  0x0000002b682c83e0 JavaThread "Notifd:BroadcastEventProcessor"
[_thread_blocked, id=3D5566]
  0x0000002b66bf8860 JavaThread "Capsd:BroadcastEventProcessor"
[_thread_blocked, id=3D5565]
  0x0000002b67f34410 JavaThread "IcmpMonitor-Receiver" daemon
[_thread_blocked, id=3D5564]
  0x0000002b6734eb10 JavaThread "ICMPReceiver15992" daemon
[_thread_in_native, id=3D5563]
  0x0000002b67f35220 JavaThread "IcmpPlugin-Receiver" daemon
[_thread_blocked, id=3D5501]
  0x0000002b67f34f30 JavaThread "ICMPReceiver46568" daemon
[_thread_in_native, id=3D5500]
  0x0000002b668907d0 JavaThread "Actiond:BroadcastEventProcessor"
[_thread_blocked, id=3D5499]
  0x0000002b682009e0 JavaThread "SnmpPortal--1-FastReceiver"
[_thread_in_native, id=3D5498]
  0x0000002b67f36570 JavaThread "Trapd:BroadcastEventProcessor"
[_thread_blocked, id=3D5497]
  0x0000002b6688fba0 JavaThread "SnmpPortal--1" [_thread_blocked,
id=3D5496]
  0x0000002b66784830 JavaThread "Thread-2" [_thread_in_native, =
id=3D5404]
  0x0000002b66729af0 JavaThread "Thread-1" [_thread_in_native, =
id=3D5403]
  0x0000002b621c6eb0 JavaThread "Low Memory Detector" daemon
[_thread_blocked, id=3D5400]
  0x0000002b621c5290 JavaThread "CompilerThread1" daemon
[_thread_blocked, id=3D5399]
  0x0000002b621c3cf0 JavaThread "CompilerThread0" daemon
[_thread_blocked, id=3D5398]
  0x0000002b621c25a0 JavaThread "AdapterThread" daemon [_thread_blocked,
id=3D5397]
  0x0000002b621c1250 JavaThread "Signal Dispatcher" daemon
[_thread_blocked, id=3D5396]
  0x0000002b621acfd0 JavaThread "Finalizer" daemon [_thread_blocked,
id=3D5395]
  0x0000002b621ac7b0 JavaThread "Reference Handler" daemon
[_thread_blocked, id=3D5394]

Other Threads:
  0x0000002b621a82b0 VMThread [id=3D5393]
  0x0000002b621c8af0 WatcherThread [id=3D5401]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap
 PSYoungGen      total 4544K, used 1880K [0x0000002b216a0000,
0x0000002b21b70000, 0x0000002b616a0000)
  eden space 4160K, 39% used
[0x0000002b216a0000,0x0000002b2183a0d0,0x0000002b21ab0000)
  from space 384K, 62% used
[0x0000002b21b10000,0x0000002b21b4c018,0x0000002b21b70000)
  to   space 384K, 0% used
[0x0000002b21ab0000,0x0000002b21ab0000,0x0000002b21b10000)
 PSOldGen        total 69376K, used 50473K [0x0000002aa16a0000,
0x0000002aa5a60000, 0x0000002b216a0000)
  object space 69376K, 72% used
[0x0000002aa16a0000,0x0000002aa47ea7f8,0x0000002aa5a60000)
 PSPermGen       total 23488K, used 17731K [0x0000002a9c4a0000,
0x0000002a9db90000, 0x0000002aa16a0000)
  object space 23488K, 75% used
[0x0000002a9c4a0000,0x0000002a9d5f0ec8,0x0000002a9db90000)

Dynamic libraries:
40000000-4000e000 r-xp 00000000 fd:00 3261790
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/bin/java
4010d000-40110000 rw-p 0000d000 fd:00 3261790
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/bin/java
40110000-40154000 rwxp 40110000 00:00 0=20
40154000-40155000 ---p 40154000 00:00 0=20
40155000-40255000 rwxp 40155000 00:00 0=20
40255000-40256000 ---p 40255000 00:00 0=20
40256000-40356000 rwxp 40256000 00:00 0=20
40356000-40357000 ---p 40356000 00:00 0=20
40357000-40457000 rwxp 40357000 00:00 0=20
40457000-4045a000 ---p 40457000 00:00 0=20
4045a000-40558000 rwxp 4045a000 00:00 0=20
40558000-4055b000 ---p 40558000 00:00 0=20
4055b000-40659000 rwxp 4055b000 00:00 0=20
40659000-4065c000 ---p 40659000 00:00 0=20
4065c000-4075a000 rwxp 4065c000 00:00 0=20
4075a000-4075d000 ---p 4075a000 00:00 0=20
4075d000-4085b000 rwxp 4075d000 00:00 0=20
4085b000-4085e000 ---p 4085b000 00:00 0=20
4085e000-4095c000 rwxp 4085e000 00:00 0=20
4095c000-4095f000 ---p 4095c000 00:00 0=20
4095f000-40a5d000 rwxp 4095f000 00:00 0=20
40a5d000-40a60000 ---p 40a5d000 00:00 0=20
40a60000-40b5e000 rwxp 40a60000 00:00 0=20
40b5e000-40b5f000 ---p 40b5e000 00:00 0=20
40b5f000-40c5f000 rwxp 40b5f000 00:00 0=20
40c5f000-40c62000 ---p 40c5f000 00:00 0=20
40c62000-40d60000 rwxp 40c62000 00:00 0=20
40d60000-40d63000 ---p 40d60000 00:00 0=20
40d63000-40e61000 rwxp 40d63000 00:00 0=20
40e61000-40e64000 ---p 40e61000 00:00 0=20
40e64000-40f62000 rwxp 40e64000 00:00 0=20
40f62000-40f65000 ---p 40f62000 00:00 0=20
40f65000-41063000 rwxp 40f65000 00:00 0=20
41063000-41066000 ---p 41063000 00:00 0=20
41066000-41164000 rwxp 41066000 00:00 0=20
41164000-41167000 ---p 41164000 00:00 0=20
41167000-41265000 rwxp 41167000 00:00 0=20
41265000-41268000 ---p 41265000 00:00 0=20
41268000-41366000 rwxp 41268000 00:00 0=20
41366000-41369000 ---p 41366000 00:00 0=20
41369000-41467000 rwxp 41369000 00:00 0=20
41467000-4146a000 ---p 41467000 00:00 0=20
4146a000-41568000 rwxp 4146a000 00:00 0=20
41568000-4156b000 ---p 41568000 00:00 0=20
4156b000-41669000 rwxp 4156b000 00:00 0=20
41669000-4166c000 ---p 41669000 00:00 0=20
4166c000-4176a000 rwxp 4166c000 00:00 0=20
4176a000-4176d000 ---p 4176a000 00:00 0=20
4176d000-4186b000 rwxp 4176d000 00:00 0=20
4186b000-4186e000 ---p 4186b000 00:00 0=20
4186e000-4196c000 rwxp 4186e000 00:00 0=20
4196c000-4196f000 ---p 4196c000 00:00 0=20
4196f000-41a6d000 rwxp 4196f000 00:00 0=20
41a6d000-41a70000 ---p 41a6d000 00:00 0=20
41a70000-41b6e000 rwxp 41a70000 00:00 0=20
41b6e000-41b71000 ---p 41b6e000 00:00 0=20
41b71000-41c6f000 rwxp 41b71000 00:00 0=20
41c6f000-41c72000 ---p 41c6f000 00:00 0=20
41c72000-41d70000 rwxp 41c72000 00:00 0=20
41d70000-41d73000 ---p 41d70000 00:00 0=20
41d73000-41e71000 rwxp 41d73000 00:00 0=20
41e71000-41e74000 ---p 41e71000 00:00 0=20
41e74000-41f72000 rwxp 41e74000 00:00 0=20
41f72000-41f75000 ---p 41f72000 00:00 0=20
41f75000-42073000 rwxp 41f75000 00:00 0=20
42073000-42076000 ---p 42073000 00:00 0=20
42076000-42174000 rwxp 42076000 00:00 0=20
42174000-42177000 ---p 42174000 00:00 0=20
42177000-42275000 rwxp 42177000 00:00 0=20
42275000-42278000 ---p 42275000 00:00 0=20
42278000-42376000 rwxp 42278000 00:00 0=20
42376000-42379000 ---p 42376000 00:00 0=20
42379000-42477000 rwxp 42379000 00:00 0=20
42477000-4247a000 ---p 42477000 00:00 0=20
4247a000-42578000 rwxp 4247a000 00:00 0=20
42578000-4257b000 ---p 42578000 00:00 0=20
4257b000-42679000 rwxp 4257b000 00:00 0=20
42679000-4267c000 ---p 42679000 00:00 0=20
4267c000-4277a000 rwxp 4267c000 00:00 0=20
4277a000-4277d000 ---p 4277a000 00:00 0=20
4277d000-4287b000 rwxp 4277d000 00:00 0=20
4287b000-4287e000 ---p 4287b000 00:00 0=20
4287e000-4297c000 rwxp 4287e000 00:00 0=20
4297c000-4297f000 ---p 4297c000 00:00 0=20
4297f000-42a7d000 rwxp 4297f000 00:00 0=20
42a7d000-42a80000 ---p 42a7d000 00:00 0=20
42a80000-42b7e000 rwxp 42a80000 00:00 0=20
42b7e000-42b81000 ---p 42b7e000 00:00 0=20
42b81000-42c7f000 rwxp 42b81000 00:00 0=20
42c7f000-42c82000 ---p 42c7f000 00:00 0=20
42c82000-42d80000 rwxp 42c82000 00:00 0=20
42d80000-42d83000 ---p 42d80000 00:00 0=20
42d83000-42e81000 rwxp 42d83000 00:00 0=20
42e81000-42e84000 ---p 42e81000 00:00 0=20
42e84000-42f82000 rwxp 42e84000 00:00 0=20
42f82000-42f85000 ---p 42f82000 00:00 0=20
42f85000-43083000 rwxp 42f85000 00:00 0=20
43083000-43086000 ---p 43083000 00:00 0=20
43086000-43184000 rwxp 43086000 00:00 0=20
43184000-43187000 ---p 43184000 00:00 0=20
43187000-43285000 rwxp 43187000 00:00 0=20
43285000-43288000 ---p 43285000 00:00 0=20
43288000-43386000 rwxp 43288000 00:00 0=20
43386000-43389000 rwxp 43386000 00:00 0=20
43389000-43487000 rwxp 43389000 00:00 0=20
43487000-4348a000 rwxp 43487000 00:00 0=20
4348a000-43588000 rwxp 4348a000 00:00 0=20
43588000-4358b000 ---p 43588000 00:00 0=20
4358b000-43689000 rwxp 4358b000 00:00 0=20
43689000-4368c000 rwxp 43689000 00:00 0=20
4368c000-4378a000 rwxp 4368c000 00:00 0=20
4378a000-4378d000 ---p 4378a000 00:00 0=20
4378d000-4388b000 rwxp 4378d000 00:00 0=20
4388b000-4388e000 rwxp 4388b000 00:00 0=20
4388e000-4398c000 rwxp 4388e000 00:00 0=20
4398c000-4398f000 rwxp 4398c000 00:00 0=20
4398f000-43a8d000 rwxp 4398f000 00:00 0=20
43a8d000-43a90000 rwxp 43a8d000 00:00 0=20
43a90000-43b8e000 rwxp 43a90000 00:00 0=20
43b8e000-43b91000 rwxp 43b8e000 00:00 0=20
43b91000-43c8f000 rwxp 43b91000 00:00 0=20
43c8f000-43c92000 rwxp 43c8f000 00:00 0=20
43c92000-43d90000 rwxp 43c92000 00:00 0=20
43d90000-43d93000 ---p 43d90000 00:00 0=20
43d93000-43e91000 rwxp 43d93000 00:00 0=20
43e91000-43e94000 rwxp 43e91000 00:00 0=20
43e94000-43f92000 rwxp 43e94000 00:00 0=20
43f92000-43f95000 rwxp 43f92000 00:00 0=20
43f95000-44093000 rwxp 43f95000 00:00 0=20
44093000-44096000 ---p 44093000 00:00 0=20
44096000-44194000 rwxp 44096000 00:00 0=20
44194000-44197000 rwxp 44194000 00:00 0=20
44197000-44295000 rwxp 44197000 00:00 0=20
44295000-44298000 ---p 44295000 00:00 0=20
44298000-44396000 rwxp 44298000 00:00 0=20
44396000-44399000 rwxp 44396000 00:00 0=20
44399000-44497000 rwxp 44399000 00:00 0=20
44497000-4449a000 ---p 44497000 00:00 0=20
4449a000-44598000 rwxp 4449a000 00:00 0=20
44598000-4459b000 rwxp 44598000 00:00 0=20
4459b000-44699000 rwxp 4459b000 00:00 0=20
44699000-4469c000 rwxp 44699000 00:00 0=20
4469c000-4479a000 rwxp 4469c000 00:00 0=20
4479a000-4479d000 rwxp 4479a000 00:00 0=20
4479d000-4489b000 rwxp 4479d000 00:00 0=20
4489b000-4489e000 rwxp 4489b000 00:00 0=20
4489e000-4499c000 rwxp 4489e000 00:00 0=20
4499c000-4499f000 rwxp 4499c000 00:00 0=20
4499f000-44a9d000 rwxp 4499f000 00:00 0=20
44a9d000-44aa0000 rwxp 44a9d000 00:00 0=20
44aa0000-44b9e000 rwxp 44aa0000 00:00 0=20
44b9e000-44ba1000 rwxp 44b9e000 00:00 0=20
44ba1000-44c9f000 rwxp 44ba1000 00:00 0=20
44c9f000-44ca2000 ---p 44c9f000 00:00 0=20
44ca2000-44da0000 rwxp 44ca2000 00:00 0=20
2a95556000-2a95557000 rw-p 2a95556000 00:00 0=20
2a95563000-2a95566000 rw-p 2a95563000 00:00 0=20
2a95566000-2a95c31000 r-xp 00000000 fd:00 3228872
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/server/libjvm.so
2a95c31000-2a95d30000 ---p 006cb000 fd:00 3228872
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/server/libjvm.so
2a95d30000-2a95eab000 rw-p 006ca000 fd:00 3228872
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/server/libjvm.so
2a95eab000-2a95eda000 rw-p 2a95eab000 00:00 0=20
2a95eda000-2a95edb000 r--p 2a95eda000 00:00 0=20
2a95edb000-2a95edc000 rwxp 2a95edb000 00:00 0=20
2a95edc000-2a95ee5000 r-xp 00000000 fd:00 3228868
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/native_threads/libhpi
.so
2a95ee5000-2a95fe4000 ---p 00009000 fd:00 3228868
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/native_threads/libhpi
.so
2a95fe4000-2a95fe8000 rw-p 00008000 fd:00 3228868
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/native_threads/libhpi
.so
2a95fe8000-2a95ff0000 rw-s 00000000 fd:00 2097161
/tmp/hsperfdata_root/5345
2a95ff4000-2a95ffe000 r-xp 00000000 fd:00 7421980
/lib64/libnss_files-2.3.4.so
2a95ffe000-2a960fe000 ---p 0000a000 fd:00 7421980
/lib64/libnss_files-2.3.4.so
2a960fe000-2a96100000 rw-p 0000a000 fd:00 7421980
/lib64/libnss_files-2.3.4.so
2a96100000-2a9610d000 r-xp 00000000 fd:00 3228863
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/libverify.so
2a9610d000-2a9620c000 ---p 0000d000 fd:00 3228863
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/libverify.so
2a9620c000-2a9620f000 rw-p 0000c000 fd:00 3228863
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/libverify.so
2a9620f000-2a96234000 r-xp 00000000 fd:00 3228848
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/libjava.so
2a96234000-2a96333000 ---p 00025000 fd:00 3228848
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/libjava.so
2a96333000-2a96339000 rw-p 00024000 fd:00 3228848
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/libjava.so
2a96339000-2a96348000 r-xp 00000000 fd:00 3228864
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/libzip.so
2a96348000-2a96449000 ---p 0000f000 fd:00 3228864
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/libzip.so
2a96449000-2a9644d000 rw-p 00010000 fd:00 3228864
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/libzip.so
2a9644d000-2a98a63000 r--s 00000000 fd:00 3228908
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/rt.jar
2a98a63000-2a98acc000 rw-p 2a98a63000 00:00 0=20
2a98acc000-2a98b51000 r--s 00000000 fd:00 3228902
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/jsse.jar
2a98b51000-2a98b66000 r--s 00000000 fd:00 3228901
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/jce.jar
2a98b66000-2a993d6000 r--s 00000000 fd:00 3228873
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/charsets.jar
2a993d6000-2a99896000 rwxp 2a993d6000 00:00 0=20
2a99896000-2a9c3d6000 rwxp 2a99896000 00:00 0=20
2a9c3d6000-2a9c3e9000 rwxp 2a9c3d6000 00:00 0=20
2a9c3e9000-2a9c496000 rwxp 2a9c3e9000 00:00 0=20
2a9c4a0000-2a9db90000 rwxp 2a9c4a0000 00:00 0=20
2a9db90000-2aa16a0000 rwxp 2a9db90000 00:00 0=20
2aa16a0000-2aa5a60000 rwxp 2aa16a0000 00:00 0=20
2aa5a60000-2b216a0000 rwxp 2aa5a60000 00:00 0=20
2b216a0000-2b21b70000 rwxp 2b216a0000 00:00 0=20
2b21b70000-2b616a0000 rwxp 2b21b70000 00:00 0=20
2b616a0000-2b616ac000 rwxp 2b616a0000 00:00 0=20
2b616ac000-2b616c9000 rwxp 2b616ac000 00:00 0=20
2b616c9000-2b616eb000 rwxp 2b616c9000 00:00 0=20
2b616eb000-2b61ac9000 rwxp 2b616eb000 00:00 0=20
2b61ac9000-2b61acc000 rwxp 2b61ac9000 00:00 0=20
2b61acc000-2b61cc9000 rwxp 2b61acc000 00:00 0=20
2b61cc9000-2b61cec000 rwxp 2b61cc9000 00:00 0=20
2b61cec000-2b620ca000 rwxp 2b61cec000 00:00 0=20
2b620ca000-2b620d6000 rwxp 2b620ca000 00:00 0=20
2b620d6000-2b620f3000 rwxp 2b620d6000 00:00 0=20
2b620f3000-2b6221b000 rw-p 2b620f3000 00:00 0=20
2b6221b000-2b6505f000 r--p 00000000 fd:00 2920153
/usr/lib/locale/locale-archive
2b6505f000-2b65123000 r--s 00000000 fd:00 3244047
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/ext/localedata.jar
2b65123000-2b65125000 r--s 00000000 fd:00 3244046
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/ext/dnsns.jar
2b65125000-2b6514c000 r--s 00000000 fd:00 3244048
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/ext/sunjce_provider.jar
2b6514c000-2b6515a000 r--s 00000000 fd:00 821159
/opt/OpenNMS/lib/activation.jar
2b6515a000-2b6516a000 r--s 00000000 fd:00 821160
/opt/OpenNMS/lib/avalon-framework-cvs-20020806.jar
2b6516a000-2b6536e000 r--s 00000000 fd:00 821161
/opt/OpenNMS/lib/batik.jar
2b6536e000-2b65388000 r--s 00000000 fd:00 821162
/opt/OpenNMS/lib/bsf220.jar
2b65388000-2b653bc000 r--s 00000000 fd:00 821163
/opt/OpenNMS/lib/bsh-1.2b7.jar
2b653bc000-2b654b9000 r--s 00000000 fd:00 821165
/opt/OpenNMS/lib/castor-0.9.3.9.jar
2b654b9000-2b655b9000 rw-p 2b654b9000 00:00 0=20
2b655b9000-2b6565f000 r--s 00000000 fd:00 821164
/opt/OpenNMS/lib/castor-0.9.3.9-xml.jar
2b6565f000-2b656dd000 r--s 00000000 fd:00 821166
/opt/OpenNMS/lib/catalina.jar
2b656dd000-2b6571f000 r--s 00000000 fd:00 821167
/opt/OpenNMS/lib/commons-jxpath-1.1.jar
2b6571f000-2b65893000 r--s 00000000 fd:00 821168
/opt/OpenNMS/lib/fop0205.jar
2b65893000-2b65896000 r--s 00000000 fd:00 821169
/opt/OpenNMS/lib/getopt.jar
2b65896000-2b65930000 r--s 00000000 fd:00 821170
/opt/OpenNMS/lib/hsqldb.jar
2b65930000-2b65951000 r--s 00000000 fd:00 821171
/opt/OpenNMS/lib/imap.jar
2b65951000-2b6597d000 r--s 00000000 fd:00 821174
/opt/OpenNMS/lib/jcifs.jar
2b6597d000-2b6597f000 r--s 00000000 fd:00 821175
/opt/OpenNMS/lib/jdhcp.jar
2b6597f000-2b659ef000 r--s 00000000 fd:00 821176
/opt/OpenNMS/lib/jimi100.jar
2b659ef000-2b659f1000 r--s 00000000 fd:00 821177
/opt/OpenNMS/lib/jmta.jar
2b659f1000-2b659f9000 r--s 00000000 fd:00 821178
/opt/OpenNMS/lib/jradius-client.jar
2b659f9000-2b65a25000 r--s 00000000 fd:00 821179
/opt/OpenNMS/lib/jrobin-1.4.0.jar
2b65a25000-2b65a28000 r--s 00000000 fd:00 821180
/opt/OpenNMS/lib/jta101.jar
2b65a28000-2b65a66000 r--s 00000000 fd:00 821181
/opt/OpenNMS/lib/ldap.jar
2b65a66000-2b65ab7000 r--s 00000000 fd:00 821186
/opt/OpenNMS/lib/log4j.jar
2b65ab7000-2b65bb7000 rw-p 2b65ab7000 00:00 0=20
2b65bb7000-2b65bc9000 r--s 00000000 fd:00 821187
/opt/OpenNMS/lib/logkit-1.0.jar
2b65bc9000-2b65bf5000 r--s 00000000 fd:00 821188
/opt/OpenNMS/lib/mailapi.jar
2b65bf5000-2b65c59000 r--s 00000000 fd:00 821189
/opt/OpenNMS/lib/mx4j-3.0.1.jar
2b65c59000-2b65c83000 r--s 00000000 fd:00 821190
/opt/OpenNMS/lib/mx4j-remote-3.0.1.jar
2b65c83000-2b65cfd000 r--s 00000000 fd:00 821191
/opt/OpenNMS/lib/mx4j-tools-3.0.1.jar
2b65cfd000-2b65d2a000 r--s 00000000 fd:00 821192
/opt/OpenNMS/lib/opennms_common.jar
2b65d2a000-2b65d35000 r--s 00000000 fd:00 821193
/opt/OpenNMS/lib/opennms_core.jar
2b65d35000-2b65d3f000 r--s 00000000 fd:00 821194
/opt/OpenNMS/lib/opennms_install.jar
2b65d3f000-2b65d73000 r--s 00000000 fd:00 821199
/opt/OpenNMS/lib/pg74.215.jdbc3.jar
2b65d73000-2b65d86000 r--s 00000000 fd:00 821195
/opt/OpenNMS/lib/opennms_joesnmp.jar
2b65d86000-2b66034000 r--s 00000000 fd:00 821196
/opt/OpenNMS/lib/opennms_services.jar
2b66034000-2b66234000 rw-p 2b66034000 00:00 0=20
2b66234000-2b662b0000 r--s 00000000 fd:00 821197
/opt/OpenNMS/lib/opennms_web.jar
2b662b0000-2b662c4000 r--s 00000000 fd:00 821198
/opt/OpenNMS/lib/oro204.jar
2b662c4000-2b662c9000 r--s 00000000 fd:00 821200
/opt/OpenNMS/lib/pop3.jar
2b662c9000-2b662d1000 r--s 00000000 fd:00 821201
/opt/OpenNMS/lib/regexp120.jar
2b662d1000-2b662e4000 r--s 00000000 fd:00 821214
/opt/OpenNMS/lib/servlet.jar
2b662e4000-2b66308000 r--s 00000000 fd:00 821215
/opt/OpenNMS/lib/smack.jar
2b66308000-2b66330000 r--s 00000000 fd:00 821216
/opt/OpenNMS/lib/smackx.jar
2b66330000-2b66336000 r--s 00000000 fd:00 821217
/opt/OpenNMS/lib/smtp.jar
2b66336000-2b6634b000 r--s 00000000 fd:00 821220
/opt/OpenNMS/lib/w3c.jar
2b6634b000-2b663b6000 r--s 00000000 fd:00 821221
/opt/OpenNMS/lib/xalan122.jar
2b663b6000-2b66494000 r--s 00000000 fd:00 821222
/opt/OpenNMS/lib/xalan231.jar
2b66494000-2b6665b000 r--s 00000000 fd:00 821225
/opt/OpenNMS/lib/xerces201.jar
2b6665b000-2b66676000 r--s 00000000 fd:00 821226
/opt/OpenNMS/lib/xml-apis231.jar
2b66676000-2b66691000 r--s 00000000 fd:00 821227
/opt/OpenNMS/lib/xmlrpc-1.2-b1.jar
2b66691000-2b66891000 rw-p 2b66691000 00:00 0=20
2b66891000-2b668a3000 r-xp 00000000 fd:00 3228858
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/libnet.so
2b668a3000-2b669a5000 ---p 00012000 fd:00 3228858
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/libnet.so
2b669a5000-2b669a8000 rw-p 00014000 fd:00 3228858
/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/libnet.so
2b669a8000-2b66aa8000 rw-p 2b669a8000 00:00 0=20
2b66b12000-2b66d12000 rw-p 2b66b12000 00:00 0=20
2b66d96000-2b66e96000 rw-p 2b66d96000 00:00 0=20
2b66f66000-2b67066000 rw-p 2b66f66000 00:00 0=20
2b670a8000-2b671a8000 rw-p 2b670a8000 00:00 0=20
2b6727f000-2b6757f000 rw-p 2b6727f000 00:00 0=20
2b67583000-2b67683000 rw-p 2b67583000 00:00 0=20
2b67727000-2b67827000 rw-p 2b67727000 00:00 0=20
2b67827000-2b6782a000 r-xp 00000000 fd:00 821182
/opt/OpenNMS/lib/libjicmp.so
2b6782a000-2b67929000 ---p 00003000 fd:00 821182
/opt/OpenNMS/lib/libjicmp.so
2b67929000-2b6792a000 rw-p 00002000 fd:00 821182
/opt/OpenNMS/lib/libjicmp.so
2b67937000-2b67f37000 rw-p 2b67937000 00:00 0=20
2b67fb3000-2b681b3000 rw-p 2b67fb3000 00:00 0=20
2b68200000-2b682fb000 rw-p 2b68200000 00:00 0=20
2b682fb000-2b68300000 ---p 2b682fb000 00:00 0=20
2b68300000-2b684f7000 rw-p 2b68300000 00:00 0=20
2b684f7000-2b68500000 ---p 2b684f7000 00:00 0=20
2b68500000-2b68502000 r-xp 00000000 fd:00 821184
/opt/OpenNMS/lib/libjrrd.so
2b68502000-2b68601000 ---p 00002000 fd:00 821184
/opt/OpenNMS/lib/libjrrd.so
2b68601000-2b68602000 rw-p 00001000 fd:00 821184
/opt/OpenNMS/lib/libjrrd.so
2b6860e000-2b68651000 r-xp 00000000 fd:00 2920450
/usr/lib64/librrd.so.2.0.8
2b68651000-2b68751000 ---p 00043000 fd:00 2920450
/usr/lib64/librrd.so.2.0.8
2b68751000-2b68758000 rw-p 00043000 fd:00 2920450
/usr/lib64/librrd.so.2.0.8
2b68800000-2b688ee000 rw-p 2b68800000 00:00 0=20
2b688ee000-2b68900000 ---p 2b688ee000 00:00 0=20
2b68900000-2b68926000 r-xp 00000000 fd:00 2930325
/usr/lib64/libpng12.so.0.1.2.7
2b68926000-2b68a26000 ---p 00026000 fd:00 2930325
/usr/lib64/libpng12.so.0.1.2.7
2b68a26000-2b68a27000 rw-p 00026000 fd:00 2930325
/usr/lib64/libpng12.so.0.1.2.7
2b68b00000-2b68bfe000 rw-p 2b68b00000 00:00 0=20
2b68bfe000-2b68c00000 ---p 2b68bfe000 00:00 0=20
2b68d00000-2b68dfe000 rw-p 2b68d00000 00:00 0=20
2b68dfe000-2b68e00000 ---p 2b68dfe000 00:00 0=20
2b68e00000-2b68f00000 rw-p 2b68e00000 00:00 0=20
2b69000000-2b69dff000 rw-p 2b69000000 00:00 0=20
2b69dff000-2b69e00000 ---p 2b69dff000 00:00 0=20
2b69e00000-2b69e04000 r-xp 00000000 fd:00 7421978
/lib64/libnss_dns-2.3.4.so
2b69e04000-2b69f03000 ---p 00004000 fd:00 7421978
/lib64/libnss_dns-2.3.4.so
2b69f03000-2b69f05000 rw-p 00003000 fd:00 7421978
/lib64/libnss_dns-2.3.4.so
2b69f6a000-2b6a46a000 rw-p 2b69f6a000 00:00 0=20
2b6a5bf000-2b6a8bf000 rw-p 2b6a5bf000 00:00 0=20
2b6a900000-2b6a9fc000 rw-p 2b6a900000 00:00 0=20
2b6a9fc000-2b6aa00000 ---p 2b6a9fc000 00:00 0=20
2b6aae8000-2b6abe8000 rw-p 2b6aae8000 00:00 0=20
2b6ac00000-2b6ac21000 rw-p 2b6ac00000 00:00 0=20
2b6ac21000-2b6ad00000 ---p 2b6ac21000 00:00 0=20
2b6ad00000-2b6ae21000 rw-p 2b6ad00000 00:00 0=20
2b6ae21000-2b6af00000 ---p 2b6ae21000 00:00 0=20
37dd800000-37dd815000 r-xp 00000000 fd:00 7422179
/lib64/ld-2.3.4.so
37dd914000-37dd916000 rw-p 00014000 fd:00 7422179
/lib64/ld-2.3.4.so
37dda00000-37ddb2b000 r-xp 00000000 fd:00 7422180
/lib64/tls/libc-2.3.4.so
37ddb2b000-37ddc2a000 ---p 0012b000 fd:00 7422180
/lib64/tls/libc-2.3.4.so
37ddc2a000-37ddc2d000 r--p 0012a000 fd:00 7422180
/lib64/tls/libc-2.3.4.so
37ddc2d000-37ddc30000 rw-p 0012d000 fd:00 7422180
/lib64/tls/libc-2.3.4.so
37ddc30000-37ddc34000 rw-p 37ddc30000 00:00 0=20
37ddd00000-37ddd02000 r-xp 00000000 fd:00 7422184
/lib64/libdl-2.3.4.so
37ddd02000-37dde01000 ---p 00002000 fd:00 7422184
/lib64/libdl-2.3.4.so
37dde01000-37dde03000 rw-p 00001000 fd:00 7422184
/lib64/libdl-2.3.4.so
37ddf00000-37ddf85000 r-xp 00000000 fd:00 7422188
/lib64/tls/libm-2.3.4.so
37ddf85000-37de084000 ---p 00085000 fd:00 7422188
/lib64/tls/libm-2.3.4.so
37de084000-37de086000 rw-p 00084000 fd:00 7422188
/lib64/tls/libm-2.3.4.so
37de100000-37de110000 r-xp 00000000 fd:00 7422023
/lib64/tls/libpthread-2.3.4.so
37de110000-37de20f000 ---p 00010000 fd:00 7422023
/lib64/tls/libpthread-2.3.4.so
37de20f000-37de211000 rw-p 0000f000 fd:00 7422023
/lib64/tls/libpthread-2.3.4.so
37de211000-37de215000 rw-p 37de211000 00:00 0=20
37de300000-37de313000 r-xp 00000000 fd:00 2930323
/usr/lib64/libz.so.1.2.1.2
37de313000-37de412000 ---p 00013000 fd:00 2930323
/usr/lib64/libz.so.1.2.1.2
37de412000-37de413000 rw-p 00012000 fd:00 2930323
/usr/lib64/libz.so.1.2.1.2
37de700000-37de711000 r-xp 00000000 fd:00 7422183
/lib64/libresolv-2.3.4.so
37de711000-37de811000 ---p 00011000 fd:00 7422183
/lib64/libresolv-2.3.4.so
37de811000-37de813000 rw-p 00011000 fd:00 7422183
/lib64/libresolv-2.3.4.so
37de813000-37de815000 rw-p 37de813000 00:00 0=20
37de900000-37de914000 r-xp 00000000 fd:00 7422193
/lib64/libnsl-2.3.4.so
37de914000-37dea13000 ---p 00014000 fd:00 7422193
/lib64/libnsl-2.3.4.so
37dea13000-37dea15000 rw-p 00013000 fd:00 7422193
/lib64/libnsl-2.3.4.so
37dea15000-37dea17000 rw-p 37dea15000 00:00 0=20
37e0900000-37e097e000 r-xp 00000000 fd:00 2923098
/usr/lib64/libfreetype.so.6.3.7
37e097e000-37e0a7d000 ---p 0007e000 fd:00 2923098
/usr/lib64/libfreetype.so.6.3.7
37e0a7d000-37e0a8a000 rw-p 0007d000 fd:00 2923098
/usr/lib64/libfreetype.so.6.3.7
37e4400000-37e4416000 r-xp 00000000 fd:00 2924002
/usr/lib64/libart_lgpl_2.so.2.3.16
37e4416000-37e4515000 ---p 00016000 fd:00 2924002
/usr/lib64/libart_lgpl_2.so.2.3.16
37e4515000-37e4516000 rw-p 00015000 fd:00 2924002
/usr/lib64/libart_lgpl_2.so.2.3.16
7fbfe00000-7fbfe03000 ---p 7fbfe00000 00:00 0=20
7fbfe03000-7fc0000000 rwxp 7fbfe03000 00:00 0=20
ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0=20

VM Arguments:
jvm_args: -DOPENNMSLAUNCH -Dopennms.home=3D/opt/OpenNMS
-Djcifs.properties=3D/opt/OpenNMS/etc/jcifs.properties -Xmx3072m
-verbose:gc
java_command: org.opennms.netmgt.vmmgr.Manager
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=3D/usr/lib/jvm/java-1.5.0-sun-1.5.0.08
PATH=3D/sbin:/usr/sbin:/bin:/usr/bin:/usr/X11R6/bin
LD_LIBRARY_PATH=3D/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64/serv=
e
r:/usr/lib/jvm/java-1.5.0-sun-1.5.0.08/jre/lib/amd64:/usr/lib/jvm/java-1
.5.0-sun-1.5.0.08/jre/../lib/amd64::/opt/OpenNMS/lib
SHELL=3D/bin/bash

Signal Handlers:
SIGSEGV: [libjvm.so+0x656380], sa_mask[0]=3D0x7ffbfeff,
sa_flags=3D0x14000004
SIGBUS: [libjvm.so+0x656380], sa_mask[0]=3D0x7ffbfeff, =
sa_flags=3D0x14000004
SIGFPE: [libjvm.so+0x55dd50], sa_mask[0]=3D0x7ffbfeff, =
sa_flags=3D0x14000004
SIGPIPE: [libjvm.so+0x55dd50], sa_mask[0]=3D0x7ffbfeff,
sa_flags=3D0x14000004
SIGILL: [libjvm.so+0x55dd50], sa_mask[0]=3D0x7ffbfeff, =
sa_flags=3D0x14000004
SIGUSR1: SIG_DFL, sa_mask[0]=3D0x00000000, sa_flags=3D0x00000000
SIGUSR2: [libjvm.so+0x55fc00], sa_mask[0]=3D0x00000000,
sa_flags=3D0x14000004
SIGHUP: [libjvm.so+0x55f6d0], sa_mask[0]=3D0x7ffbfeff, =
sa_flags=3D0x14000004
SIGINT: SIG_IGN, sa_mask[0]=3D0x00000000, sa_flags=3D0x00000000
SIGQUIT: [libjvm.so+0x55f6d0], sa_mask[0]=3D0x7ffbfeff,
sa_flags=3D0x14000004
SIGTERM: [libjvm.so+0x55f6d0], sa_mask[0]=3D0x7ffbfeff,
sa_flags=3D0x14000004


---------------  S Y S T E M  ---------------

OS:Red Hat Enterprise Linux ES release 4 (Nahant Update 3)

uname:Linux 2.6.9-34.ELsmp #1 SMP Fri Feb 24 16:56:28 EST 2006 x86_64
libc:glibc 2.3.4 NPTL 2.3.4=20
rlimit: STACK 8192k, CORE 0k, NPROC 16382, NOFILE 10240, AS infinity
load average:0.07 0.04 0.00

CPU:total 2 em64t ht

Memory: 4k page, physical 2055540k(96724k free), swap 2031608k(2031452k
free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (1.5.0_08-b03) for
linux-amd64, built on Jun 28 2006 00:27:03 by java_re with gcc 3.2.2
(SuSE Linux)