From: Robbie <jj...@nu...> - 2009-08-25 14:33:06
|
Hi, Recently I'm trying perfsuite-0.6.2 to monitoring OpenMP program (NPB-3.21/NPB-OMP) and encouter some problems. The target platform is Xeon64/Linux: uname -a: Linux node3 2.6.28 #2 SMP Tue Mar 3 15:49:55 CST 2009 x86_64 x86_64 x86_64 GNU/Linux The perfsuite configure options are list as follows: ./configure --prefix=/usr/local/perfsuite/psuite --with-tclinclude=/usr/local/perfusite/tcl/include --with-tdom=/ usr/local/perfsuite/tdom --enable-mpi F77=ifort MPICPPFLAGS=-I/home/jiangjie/install/mvapich2/include --disable-b inutils --with-tclsh=/usr/local/perfsuite/tcl/bin/tclsh8.5 --enable-debug My OpeneMP testsuite is NPB3.2.1/NPB3.2-OMP, and the compiler is ifort(version 10.1) with --openmp option. There are several different results returned by different experiments: (1) experiment 1 (export OMP_NUM_THREADS=2) [jiangjie@node1 bin]$ psrun -c /usr/local/perfsuite/psuite/share/perfsuite/xml/pshwpc/itimer.xml -p ./bt.A libpsrun.c:181 : SIGPROF ignored on startup. Handler=0x1, flags=14000000 PerfSuite debugging enabled (debug level: PS_DEBUG_OFF) [PID 14245] Library version: threaded [PID 14245] Environment (entry of psrun_init) [PID 14245] PSRUN_DOFORK = (null) [PID 14245] LD_PRELOAD = libpsrun_r.so.0 [PID 14245] PSRUN_PID = 14245 [PID 14245] PS_HWPC_FILE = bt.A 00400000-004b2000 r-xp 00000000 08:01 60425445 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/bt.A 006b2000-006b7000 rwxp 000b2000 08:01 60425445 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/bt.A 006b7000-032fb000 rwxp 006b7000 00:00 0 10378000-10399000 rwxp 10378000 00:00 0 2aaaaaaab000-2aaaaaac5000 r-xp 00000000 08:01 44958009 /lib64/ld-2.5.so 2aaaaaac5000-2aaaaaac7000 rwxp 2aaaaaac5000 00:00 0 2aaaaacc4000-2aaaaacc5000 r-xp 00019000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc5000-2aaaaacc6000 rwxp 0001a000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc6000-2aaaaacca000 r-xp 00000000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaacca000-2aaaaaec9000 ---p 00004000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaec9000-2aaaaaeca000 rwxp 00003000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaeca000-2aaaaaecb000 rwxp 2aaaaaeca000 00:00 0 2aaaaaef1000-2aaaaaf73000 r-xp 00000000 08:01 44957999 /lib64/libm-2.5.so 2aaaaaf73000-2aaaab172000 ---p 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab172000-2aaaab173000 r-xp 00081000 08:01 44957999 /lib64/libm-2.5.so 2aaaab173000-2aaaab174000 rwxp 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab174000-2aaaab1db000 r-xp 00000000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab1db000-2aaaab2db000 ---p 00067000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab2db000-2aaaab2e0000 rwxp 00067000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab2e0000-2aaaab2e8000 rwxp 2aaaab2e0000 00:00 0 2aaaab2e8000-2aaaab2fd000 r-xp 00000000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab2fd000-2aaaab4fc000 ---p 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fc000-2aaaab4fd000 r-xp 00014000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fd000-2aaaab4fe000 rwxp 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fe000-2aaaab502000 rwxp 2aaaab4fe000 00:00 0 2aaaab502000-2aaaab646000 r-xp 00000000 08:01 44958004 /lib64/libc-2.5.so 2aaaab646000-2aaaab846000 ---p 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaab846000-2aaaab84a000 r-xp 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaab84a000-2aaaab84b000 rwxp 00148000 08:01 44958004 /lib64/libc-2.5.so 2aaaab84b000-2aaaab850000 rwxp 2aaaab84b000 00:00 0 2aaaab850000-2aaaab85d000 r-xp 00000000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaab85d000-2aaaaba5c000 ---p 0000d000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaaba5c000-2aaaaba5d000 rwxp 0000c000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaaba5d000-2aaaaba5e000 rwxp 2aaaaba5d000 00:00 0 2aaaaba5e000-2aaaaba60000 r-xp 00000000 08:01 44958023 /lib64/libdl-2.5.so 2aaaaba60000-2aaaabc60000 ---p 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc60000-2aaaabc61000 r-xp 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc61000-2aaaabc62000 rwxp 00003000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc62000-2aaaabc6f000 r-xp 00000000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabc6f000-2aaaabe6e000 ---p 0000d000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabe6e000-2aaaabe6f000 rwxp 0000c000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabe6f000-2aaaabe71000 rwxp 2aaaabe6f000 00:00 0 2aaaabe71000-2aaaabe83000 r-xp 00000000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaabe83000-2aaaac082000 ---p 00012000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac082000-2aaaac083000 rwxp 00011000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac083000-2aaaac084000 rwxp 2aaaac083000 00:00 0 2aaaac0aa000-2aaaac0ca000 r-xp 00000000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac0ca000-2aaaac2c9000 ---p 00020000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac2c9000-2aaaac2cc000 rwxp 0001f000 08:01 44958013 /lib64/libexpat.so.0.5.0 7fff65329000-7fff6533e000 rwxp 7fff65329000 00:00 0 [stack] ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0 [vdso] NAS Parallel Benchmarks (NPB3.2-OMP) - BT Benchmark No input file inputbt.data. Using compiled defaults Size: 64x 64x 64 Iterations: 200 dt: 0.000800 Number of available threads: 2 Thread created... Thread returned from hwpc_start with status 0 Thread created... Fatal profiling error: cannot access TSD data in handler. Please report this as an internal PerfSuite bug to per...@li.... Thread executing cleanup handler Thread returned from hwpc_stop with status 0 (2) experiment 2 (export OMP_NUM_THREADS=8) [jiangjie@node1 bin]$ psrun -c /usr/local/perfsuite/psuite/share/perfsuite/xml/pshwpc/itimer.xml -p ./cg.A libpsrun.c:181 : SIGPROF ignored on startup. Handler=0x1, flags=14000000 PerfSuite debugging enabled (debug level: PS_DEBUG_OFF) [PID 15326] Library version: threaded [PID 15326] Environment (entry of psrun_init) [PID 15326] PSRUN_DOFORK = (null) [PID 15326] LD_PRELOAD = libpsrun_r.so.0 [PID 15326] PSRUN_PID = 15326 [PID 15326] PS_HWPC_FILE = cg.A 00400000-00406000 r-xp 00000000 08:01 60425440 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/cg.A 00606000-00607000 rw-p 00006000 08:01 60425440 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/cg.A 00607000-036c9000 rw-p 00607000 00:00 0 19af3000-19b14000 rw-p 19af3000 00:00 0 2aaaaaaab000-2aaaaaac5000 r-xp 00000000 08:01 44958009 /lib64/ld-2.5.so 2aaaaaac5000-2aaaaaac7000 rw-p 2aaaaaac5000 00:00 0 2aaaaacc4000-2aaaaacc5000 r--p 00019000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc5000-2aaaaacc6000 rw-p 0001a000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc6000-2aaaaacca000 r-xp 00000000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaacca000-2aaaaaec9000 ---p 00004000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaec9000-2aaaaaeca000 rw-p 00003000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaeca000-2aaaaaecb000 rw-p 2aaaaaeca000 00:00 0 2aaaaaef1000-2aaaaaf87000 r-xp 00000000 08:01 53419189 /usr/lib64/libgfortran.so.1.0.0 2aaaaaf87000-2aaaab186000 ---p 00096000 08:01 53419189 /usr/lib64/libgfortran.so.1.0.0 2aaaab186000-2aaaab188000 rw-p 00095000 08:01 53419189 /usr/lib64/libgfortran.so.1.0.0 2aaaab188000-2aaaab20a000 r-xp 00000000 08:01 44957999 /lib64/libm-2.5.so 2aaaab20a000-2aaaab409000 ---p 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab409000-2aaaab40a000 r--p 00081000 08:01 44957999 /lib64/libm-2.5.so 2aaaab40a000-2aaaab40b000 rw-p 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab40b000-2aaaab40c000 rw-p 2aaaab40b000 00:00 0 2aaaab40c000-2aaaab413000 r-xp 00000000 08:01 53419101 /usr/lib64/libgomp.so.1.0.0 2aaaab413000-2aaaab612000 ---p 00007000 08:01 53419101 /usr/lib64/libgomp.so.1.0.0 2aaaab612000-2aaaab613000 rw-p 00006000 08:01 53419101 /usr/lib64/libgomp.so.1.0.0 2aaaab613000-2aaaab620000 r-xp 00000000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaab620000-2aaaab81f000 ---p 0000d000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaab81f000-2aaaab820000 rw-p 0000c000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaab820000-2aaaab835000 r-xp 00000000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab835000-2aaaaba34000 ---p 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaaba34000-2aaaaba35000 r--p 00014000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaaba35000-2aaaaba36000 rw-p 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaaba36000-2aaaaba3b000 rw-p 2aaaaba36000 00:00 0 2aaaaba3b000-2aaaabb7f000 r-xp 00000000 08:01 44958004 /lib64/libc-2.5.so 2aaaabb7f000-2aaaabd7f000 ---p 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaabd7f000-2aaaabd83000 r--p 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaabd83000-2aaaabd84000 rw-p 00148000 08:01 44958004 /lib64/libc-2.5.so 2aaaabd84000-2aaaabd89000 rw-p 2aaaabd84000 00:00 0 2aaaabd89000-2aaaabd96000 r-xp 00000000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabd96000-2aaaabf95000 ---p 0000d000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabf95000-2aaaabf96000 rw-p 0000c000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabf96000-2aaaabf98000 r-xp 00000000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabf98000-2aaaac198000 ---p 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaac198000-2aaaac199000 r--p 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaac199000-2aaaac19a000 rw-p 00003000 08:01 44958023 /lib64/libdl-2.5.so 2aaaac19a000-2aaaac19b000 rw-p 2aaaac19a000 00:00 0 2aaaac19b000-2aaaac1a2000 r-xp 00000000 08:01 44957732 /lib64/librt-2.5.so 2aaaac1a2000-2aaaac3a2000 ---p 00007000 08:01 44957732 /lib64/librt-2.5.so 2aaaac3a2000-2aaaac3a3000 r--p 00007000 08:01 44957732 /lib64/librt-2.5.so 2aaaac3a3000-2aaaac3a4000 rw-p 00008000 08:01 44957732 /lib64/librt-2.5.so 2aaaac3a4000-2aaaac3a6000 rw-p 2aaaac3a4000 00:00 0 2aaaac3a6000-2aaaac3b8000 r-xp 00000000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac3b8000-2aaaac5b7000 ---p 00012000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac5b7000-2aaaac5b8000 rw-p 00011000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac5b8000-2aaaac5b9000 rw-p 2aaaac5b8000 00:00 0 2aaaac5df000-2aaaac5ff000 r-xp 00000000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac5ff000-2aaaac7fe000 ---p 00020000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac7fe000-2aaaac801000 rw-p 0001f000 08:01 44958013 /lib64/libexpat.so.0.5.0 7fffc37a5000-7fffc37ba000 rw-p 7fffc37a5000 00:00 0 [stack] ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0 [vdso] NAS Parallel Benchmarks (NPB3.2-OMP) - CG Benchmark Size: 14000 Iterations: 15 Number of available threads: 8 Thread created... Thread created... Thread returned from hwpc_start with status 0 Thread returned from hwpc_start with status 0 Thread created... Thread created... Thread created... Thread created... Thread created... Fatal profiling error: cannot access TSD data in handler. Please report this as an internal PerfSuite bug to per...@li.... [PID 15326] Notice: caught SIGSEGV in wrap-up. (3) Experiment 3 (export OMP_NUM_THREADS=8) [jiangjie@node1 bin]$ psrun -c /usr/local/perfsuite/psuite/share/perfsuite/xml/pshwpc/itimer.xml -p ./cg.A libpsrun.c:181 : SIGPROF ignored on startup. Handler=0x1, flags=14000000 PerfSuite debugging enabled (debug level: PS_DEBUG_OFF) [PID 15784] Library version: threaded [PID 15784] Environment (entry of psrun_init) [PID 15784] PSRUN_DOFORK = (null) [PID 15784] LD_PRELOAD = libpsrun_r.so.0 [PID 15784] PSRUN_PID = 15784 [PID 15784] PS_HWPC_FILE = cg.A 00400000-004a7000 r-xp 00000000 08:01 60425440 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/cg.A 006a7000-006ae000 rwxp 000a7000 08:01 60425440 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/cg.A 006ae000-037a2000 rwxp 006ae000 00:00 0 15b6b000-15b8c000 rwxp 15b6b000 00:00 0 2aaaaaaab000-2aaaaaac5000 r-xp 00000000 08:01 44958009 /lib64/ld-2.5.so 2aaaaaac5000-2aaaaaac7000 rwxp 2aaaaaac5000 00:00 0 2aaaaacc4000-2aaaaacc5000 r-xp 00019000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc5000-2aaaaacc6000 rwxp 0001a000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc6000-2aaaaacca000 r-xp 00000000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaacca000-2aaaaaec9000 ---p 00004000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaec9000-2aaaaaeca000 rwxp 00003000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaeca000-2aaaaaecb000 rwxp 2aaaaaeca000 00:00 0 2aaaaaef1000-2aaaaaf73000 r-xp 00000000 08:01 44957999 /lib64/libm-2.5.so 2aaaaaf73000-2aaaab172000 ---p 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab172000-2aaaab173000 r-xp 00081000 08:01 44957999 /lib64/libm-2.5.so 2aaaab173000-2aaaab174000 rwxp 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab174000-2aaaab1db000 r-xp 00000000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab1db000-2aaaab2db000 ---p 00067000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab2db000-2aaaab2e0000 rwxp 00067000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab2e0000-2aaaab2e8000 rwxp 2aaaab2e0000 00:00 0 2aaaab2e8000-2aaaab2fd000 r-xp 00000000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab2fd000-2aaaab4fc000 ---p 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fc000-2aaaab4fd000 r-xp 00014000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fd000-2aaaab4fe000 rwxp 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fe000-2aaaab502000 rwxp 2aaaab4fe000 00:00 0 2aaaab502000-2aaaab646000 r-xp 00000000 08:01 44958004 /lib64/libc-2.5.so 2aaaab646000-2aaaab846000 ---p 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaab846000-2aaaab84a000 r-xp 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaab84a000-2aaaab84b000 rwxp 00148000 08:01 44958004 /lib64/libc-2.5.so 2aaaab84b000-2aaaab850000 rwxp 2aaaab84b000 00:00 0 2aaaab850000-2aaaab85d000 r-xp 00000000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaab85d000-2aaaaba5c000 ---p 0000d000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaaba5c000-2aaaaba5d000 rwxp 0000c000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaaba5d000-2aaaaba5e000 rwxp 2aaaaba5d000 00:00 0 2aaaaba5e000-2aaaaba60000 r-xp 00000000 08:01 44958023 /lib64/libdl-2.5.so 2aaaaba60000-2aaaabc60000 ---p 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc60000-2aaaabc61000 r-xp 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc61000-2aaaabc62000 rwxp 00003000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc62000-2aaaabc6f000 r-xp 00000000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabc6f000-2aaaabe6e000 ---p 0000d000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabe6e000-2aaaabe6f000 rwxp 0000c000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabe6f000-2aaaabe71000 rwxp 2aaaabe6f000 00:00 0 2aaaabe71000-2aaaabe83000 r-xp 00000000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaabe83000-2aaaac082000 ---p 00012000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac082000-2aaaac083000 rwxp 00011000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac083000-2aaaac084000 rwxp 2aaaac083000 00:00 0 2aaaac0aa000-2aaaac0ca000 r-xp 00000000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac0ca000-2aaaac2c9000 ---p 00020000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac2c9000-2aaaac2cc000 rwxp 0001f000 08:01 44958013 /lib64/libexpat.so.0.5.0 7fff47070000-7fff47085000 rwxp 7fff47070000 00:00 0 [stack] ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0 [vdso] NAS Parallel Benchmarks (NPB3.2-OMP) - CG Benchmark Size: 14000 Iterations: 15 Number of available threads: 8 Thread created... Thread created... Thread created... Thread created... Thread created... Fatal profiling error: cannot access TSD data in handler. Please report this as an internal PerfSuite bug to per...@li.... Thread returned from hwpc_start with status 0 Thread returned from hwpc_start with status 0 Thread created... Thread created... system error(35): __kmp_reap_monitor: monitor did not reap properly: Resource deadlock avoided OMP: Error #107: Fatal system error detected. Thread executing cleanup handler (4) Experiment 4 (export OMP_NUM_THREADS=8) [jiangjie@node1 bin]$ psrun -c /usr/local/perfsuite/psuite/share/perfsuite/xml/pshwpc/itimer.xml -p ./cg.A libpsrun.c:181 : SIGPROF ignored on startup. Handler=0x1, flags=14000000 PerfSuite debugging enabled (debug level: PS_DEBUG_OFF) [PID 15916] Library version: threaded [PID 15916] Environment (entry of psrun_init) [PID 15916] PSRUN_DOFORK = (null) [PID 15916] LD_PRELOAD = libpsrun_r.so.0 [PID 15916] PSRUN_PID = 15916 [PID 15916] PS_HWPC_FILE = cg.A 00400000-004a7000 r-xp 00000000 08:01 60425440 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/cg.A 006a7000-006ae000 rwxp 000a7000 08:01 60425440 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/cg.A 006ae000-037a2000 rwxp 006ae000 00:00 0 19c52000-19c73000 rwxp 19c52000 00:00 0 2aaaaaaab000-2aaaaaac5000 r-xp 00000000 08:01 44958009 /lib64/ld-2.5.so 2aaaaaac5000-2aaaaaac7000 rwxp 2aaaaaac5000 00:00 0 2aaaaacc4000-2aaaaacc5000 r-xp 00019000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc5000-2aaaaacc6000 rwxp 0001a000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc6000-2aaaaacca000 r-xp 00000000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaacca000-2aaaaaec9000 ---p 00004000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaec9000-2aaaaaeca000 rwxp 00003000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaeca000-2aaaaaecb000 rwxp 2aaaaaeca000 00:00 0 2aaaaaef1000-2aaaaaf73000 r-xp 00000000 08:01 44957999 /lib64/libm-2.5.so 2aaaaaf73000-2aaaab172000 ---p 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab172000-2aaaab173000 r-xp 00081000 08:01 44957999 /lib64/libm-2.5.so 2aaaab173000-2aaaab174000 rwxp 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab174000-2aaaab1db000 r-xp 00000000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab1db000-2aaaab2db000 ---p 00067000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab2db000-2aaaab2e0000 rwxp 00067000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab2e0000-2aaaab2e8000 rwxp 2aaaab2e0000 00:00 0 2aaaab2e8000-2aaaab2fd000 r-xp 00000000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab2fd000-2aaaab4fc000 ---p 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fc000-2aaaab4fd000 r-xp 00014000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fd000-2aaaab4fe000 rwxp 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fe000-2aaaab502000 rwxp 2aaaab4fe000 00:00 0 2aaaab502000-2aaaab646000 r-xp 00000000 08:01 44958004 /lib64/libc-2.5.so 2aaaab646000-2aaaab846000 ---p 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaab846000-2aaaab84a000 r-xp 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaab84a000-2aaaab84b000 rwxp 00148000 08:01 44958004 /lib64/libc-2.5.so 2aaaab84b000-2aaaab850000 rwxp 2aaaab84b000 00:00 0 2aaaab850000-2aaaab85d000 r-xp 00000000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaab85d000-2aaaaba5c000 ---p 0000d000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaaba5c000-2aaaaba5d000 rwxp 0000c000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaaba5d000-2aaaaba5e000 rwxp 2aaaaba5d000 00:00 0 2aaaaba5e000-2aaaaba60000 r-xp 00000000 08:01 44958023 /lib64/libdl-2.5.so 2aaaaba60000-2aaaabc60000 ---p 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc60000-2aaaabc61000 r-xp 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc61000-2aaaabc62000 rwxp 00003000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc62000-2aaaabc6f000 r-xp 00000000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabc6f000-2aaaabe6e000 ---p 0000d000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabe6e000-2aaaabe6f000 rwxp 0000c000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabe6f000-2aaaabe71000 rwxp 2aaaabe6f000 00:00 0 2aaaabe71000-2aaaabe83000 r-xp 00000000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaabe83000-2aaaac082000 ---p 00012000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac082000-2aaaac083000 rwxp 00011000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac083000-2aaaac084000 rwxp 2aaaac083000 00:00 0 2aaaac0aa000-2aaaac0ca000 r-xp 00000000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac0ca000-2aaaac2c9000 ---p 00020000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac2c9000-2aaaac2cc000 rwxp 0001f000 08:01 44958013 /lib64/libexpat.so.0.5.0 7fff36965000-7fff3697b000 rwxp 7fff36965000 00:00 0 [stack] ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0 [vdso] NAS Parallel Benchmarks (NPB3.2-OMP) - CG Benchmark Size: 14000 Iterations: 15 Number of available threads: 8 Thread created... Thread created... Thread created... Thread created... Thread created... Thread created... Thread created... Fatal profiling error: cannot access TSD data in handler. Please report this as an internal PerfSuite bug to per...@li.... Thread created... Fatal profiling error: cannot access TSD data in handler. Please report this as an internal PerfSuite bug to per...@li.... libpsrun fatal error: calling sequence not allowed It is strange that sometimes it works well. Some forementioned problems also occur on my x86/Linux platform. And we notice that message "Fatal profiling error: cannot access TSD data in handler." always appears. Note that for all serial and MPI NPB benchmarks, perfsuite works well. Any suggestion? Regards, Jie Jiang |