From: Rick K. <rk...@il...> - 2009-08-25 14:41:41
|
Jie, My guess is that what is happening here is related to the use of the "itimer.xml" configuration file. The problem is that signal delivery is not defined with POSIX threads, and the results are unpredictable. POSIX threads enter the picture when you are using OpenMP. Does your system happen to have kernel support for hardware counters? If so, you may have better luck by profiling with performance counters such as total cycles rather than itimers. Rick ----- Original Message ----- From: "Robbie" <jj...@nu...> To: per...@li... Sent: Tuesday, August 25, 2009 9:32:33 AM GMT -06:00 US/Canada Central Subject: [PerfSuite-users] Problems about using Perfsuite to monitor OpenMP program (NPB-3.2.1) Hi, Recently I'm trying perfsuite-0.6.2 to monitoring OpenMP program (NPB-3.21/NPB-OMP) and encouter some problems. The target platform is Xeon64/Linux: uname -a: Linux node3 2.6.28 #2 SMP Tue Mar 3 15:49:55 CST 2009 x86_64 x86_64 x86_64 GNU/Linux The perfsuite configure options are list as follows: ./configure --prefix=/usr/local/perfsuite/psuite --with-tclinclude=/usr/local/perfusite/tcl/include --with-tdom=/ usr/local/perfsuite/tdom --enable-mpi F77=ifort MPICPPFLAGS=-I/home/jiangjie/install/mvapich2/include --disable-b inutils --with-tclsh=/usr/local/perfsuite/tcl/bin/tclsh8.5 --enable-debug My OpeneMP testsuite is NPB3.2.1/NPB3.2-OMP, and the compiler is ifort(version 10.1) with --openmp option. There are several different results returned by different experiments: (1) experiment 1 (export OMP_NUM_THREADS=2) [jiangjie@node1 bin]$ psrun -c /usr/local/perfsuite/psuite/share/perfsuite/xml/pshwpc/itimer.xml -p ./bt.A libpsrun.c:181 : SIGPROF ignored on startup. Handler=0x1, flags=14000000 PerfSuite debugging enabled (debug level: PS_DEBUG_OFF) [PID 14245] Library version: threaded [PID 14245] Environment (entry of psrun_init) [PID 14245] PSRUN_DOFORK = (null) [PID 14245] LD_PRELOAD = libpsrun_r.so.0 [PID 14245] PSRUN_PID = 14245 [PID 14245] PS_HWPC_FILE = bt.A 00400000-004b2000 r-xp 00000000 08:01 60425445 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/bt.A 006b2000-006b7000 rwxp 000b2000 08:01 60425445 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/bt.A 006b7000-032fb000 rwxp 006b7000 00:00 0 10378000-10399000 rwxp 10378000 00:00 0 2aaaaaaab000-2aaaaaac5000 r-xp 00000000 08:01 44958009 /lib64/ld-2.5.so 2aaaaaac5000-2aaaaaac7000 rwxp 2aaaaaac5000 00:00 0 2aaaaacc4000-2aaaaacc5000 r-xp 00019000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc5000-2aaaaacc6000 rwxp 0001a000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc6000-2aaaaacca000 r-xp 00000000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaacca000-2aaaaaec9000 ---p 00004000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaec9000-2aaaaaeca000 rwxp 00003000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaeca000-2aaaaaecb000 rwxp 2aaaaaeca000 00:00 0 2aaaaaef1000-2aaaaaf73000 r-xp 00000000 08:01 44957999 /lib64/libm-2.5.so 2aaaaaf73000-2aaaab172000 ---p 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab172000-2aaaab173000 r-xp 00081000 08:01 44957999 /lib64/libm-2.5.so 2aaaab173000-2aaaab174000 rwxp 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab174000-2aaaab1db000 r-xp 00000000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab1db000-2aaaab2db000 ---p 00067000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab2db000-2aaaab2e0000 rwxp 00067000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab2e0000-2aaaab2e8000 rwxp 2aaaab2e0000 00:00 0 2aaaab2e8000-2aaaab2fd000 r-xp 00000000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab2fd000-2aaaab4fc000 ---p 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fc000-2aaaab4fd000 r-xp 00014000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fd000-2aaaab4fe000 rwxp 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fe000-2aaaab502000 rwxp 2aaaab4fe000 00:00 0 2aaaab502000-2aaaab646000 r-xp 00000000 08:01 44958004 /lib64/libc-2.5.so 2aaaab646000-2aaaab846000 ---p 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaab846000-2aaaab84a000 r-xp 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaab84a000-2aaaab84b000 rwxp 00148000 08:01 44958004 /lib64/libc-2.5.so 2aaaab84b000-2aaaab850000 rwxp 2aaaab84b000 00:00 0 2aaaab850000-2aaaab85d000 r-xp 00000000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaab85d000-2aaaaba5c000 ---p 0000d000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaaba5c000-2aaaaba5d000 rwxp 0000c000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaaba5d000-2aaaaba5e000 rwxp 2aaaaba5d000 00:00 0 2aaaaba5e000-2aaaaba60000 r-xp 00000000 08:01 44958023 /lib64/libdl-2.5.so 2aaaaba60000-2aaaabc60000 ---p 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc60000-2aaaabc61000 r-xp 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc61000-2aaaabc62000 rwxp 00003000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc62000-2aaaabc6f000 r-xp 00000000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabc6f000-2aaaabe6e000 ---p 0000d000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabe6e000-2aaaabe6f000 rwxp 0000c000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabe6f000-2aaaabe71000 rwxp 2aaaabe6f000 00:00 0 2aaaabe71000-2aaaabe83000 r-xp 00000000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaabe83000-2aaaac082000 ---p 00012000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac082000-2aaaac083000 rwxp 00011000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac083000-2aaaac084000 rwxp 2aaaac083000 00:00 0 2aaaac0aa000-2aaaac0ca000 r-xp 00000000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac0ca000-2aaaac2c9000 ---p 00020000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac2c9000-2aaaac2cc000 rwxp 0001f000 08:01 44958013 /lib64/libexpat.so.0.5.0 7fff65329000-7fff6533e000 rwxp 7fff65329000 00:00 0 [stack] ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0 [vdso] NAS Parallel Benchmarks (NPB3.2-OMP) - BT Benchmark No input file inputbt.data. Using compiled defaults Size: 64x 64x 64 Iterations: 200 dt: 0.000800 Number of available threads: 2 Thread created... Thread returned from hwpc_start with status 0 Thread created... Fatal profiling error: cannot access TSD data in handler. Please report this as an internal PerfSuite bug to per...@li.... Thread executing cleanup handler Thread returned from hwpc_stop with status 0 (2) experiment 2 (export OMP_NUM_THREADS=8) [jiangjie@node1 bin]$ psrun -c /usr/local/perfsuite/psuite/share/perfsuite/xml/pshwpc/itimer.xml -p ./cg.A libpsrun.c:181 : SIGPROF ignored on startup. Handler=0x1, flags=14000000 PerfSuite debugging enabled (debug level: PS_DEBUG_OFF) [PID 15326] Library version: threaded [PID 15326] Environment (entry of psrun_init) [PID 15326] PSRUN_DOFORK = (null) [PID 15326] LD_PRELOAD = libpsrun_r.so.0 [PID 15326] PSRUN_PID = 15326 [PID 15326] PS_HWPC_FILE = cg.A 00400000-00406000 r-xp 00000000 08:01 60425440 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/cg.A 00606000-00607000 rw-p 00006000 08:01 60425440 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/cg.A 00607000-036c9000 rw-p 00607000 00:00 0 19af3000-19b14000 rw-p 19af3000 00:00 0 2aaaaaaab000-2aaaaaac5000 r-xp 00000000 08:01 44958009 /lib64/ld-2.5.so 2aaaaaac5000-2aaaaaac7000 rw-p 2aaaaaac5000 00:00 0 2aaaaacc4000-2aaaaacc5000 r--p 00019000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc5000-2aaaaacc6000 rw-p 0001a000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc6000-2aaaaacca000 r-xp 00000000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaacca000-2aaaaaec9000 ---p 00004000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaec9000-2aaaaaeca000 rw-p 00003000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaeca000-2aaaaaecb000 rw-p 2aaaaaeca000 00:00 0 2aaaaaef1000-2aaaaaf87000 r-xp 00000000 08:01 53419189 /usr/lib64/libgfortran.so.1.0.0 2aaaaaf87000-2aaaab186000 ---p 00096000 08:01 53419189 /usr/lib64/libgfortran.so.1.0.0 2aaaab186000-2aaaab188000 rw-p 00095000 08:01 53419189 /usr/lib64/libgfortran.so.1.0.0 2aaaab188000-2aaaab20a000 r-xp 00000000 08:01 44957999 /lib64/libm-2.5.so 2aaaab20a000-2aaaab409000 ---p 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab409000-2aaaab40a000 r--p 00081000 08:01 44957999 /lib64/libm-2.5.so 2aaaab40a000-2aaaab40b000 rw-p 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab40b000-2aaaab40c000 rw-p 2aaaab40b000 00:00 0 2aaaab40c000-2aaaab413000 r-xp 00000000 08:01 53419101 /usr/lib64/libgomp.so.1.0.0 2aaaab413000-2aaaab612000 ---p 00007000 08:01 53419101 /usr/lib64/libgomp.so.1.0.0 2aaaab612000-2aaaab613000 rw-p 00006000 08:01 53419101 /usr/lib64/libgomp.so.1.0.0 2aaaab613000-2aaaab620000 r-xp 00000000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaab620000-2aaaab81f000 ---p 0000d000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaab81f000-2aaaab820000 rw-p 0000c000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaab820000-2aaaab835000 r-xp 00000000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab835000-2aaaaba34000 ---p 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaaba34000-2aaaaba35000 r--p 00014000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaaba35000-2aaaaba36000 rw-p 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaaba36000-2aaaaba3b000 rw-p 2aaaaba36000 00:00 0 2aaaaba3b000-2aaaabb7f000 r-xp 00000000 08:01 44958004 /lib64/libc-2.5.so 2aaaabb7f000-2aaaabd7f000 ---p 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaabd7f000-2aaaabd83000 r--p 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaabd83000-2aaaabd84000 rw-p 00148000 08:01 44958004 /lib64/libc-2.5.so 2aaaabd84000-2aaaabd89000 rw-p 2aaaabd84000 00:00 0 2aaaabd89000-2aaaabd96000 r-xp 00000000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabd96000-2aaaabf95000 ---p 0000d000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabf95000-2aaaabf96000 rw-p 0000c000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabf96000-2aaaabf98000 r-xp 00000000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabf98000-2aaaac198000 ---p 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaac198000-2aaaac199000 r--p 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaac199000-2aaaac19a000 rw-p 00003000 08:01 44958023 /lib64/libdl-2.5.so 2aaaac19a000-2aaaac19b000 rw-p 2aaaac19a000 00:00 0 2aaaac19b000-2aaaac1a2000 r-xp 00000000 08:01 44957732 /lib64/librt-2.5.so 2aaaac1a2000-2aaaac3a2000 ---p 00007000 08:01 44957732 /lib64/librt-2.5.so 2aaaac3a2000-2aaaac3a3000 r--p 00007000 08:01 44957732 /lib64/librt-2.5.so 2aaaac3a3000-2aaaac3a4000 rw-p 00008000 08:01 44957732 /lib64/librt-2.5.so 2aaaac3a4000-2aaaac3a6000 rw-p 2aaaac3a4000 00:00 0 2aaaac3a6000-2aaaac3b8000 r-xp 00000000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac3b8000-2aaaac5b7000 ---p 00012000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac5b7000-2aaaac5b8000 rw-p 00011000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac5b8000-2aaaac5b9000 rw-p 2aaaac5b8000 00:00 0 2aaaac5df000-2aaaac5ff000 r-xp 00000000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac5ff000-2aaaac7fe000 ---p 00020000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac7fe000-2aaaac801000 rw-p 0001f000 08:01 44958013 /lib64/libexpat.so.0.5.0 7fffc37a5000-7fffc37ba000 rw-p 7fffc37a5000 00:00 0 [stack] ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0 [vdso] NAS Parallel Benchmarks (NPB3.2-OMP) - CG Benchmark Size: 14000 Iterations: 15 Number of available threads: 8 Thread created... Thread created... Thread returned from hwpc_start with status 0 Thread returned from hwpc_start with status 0 Thread created... Thread created... Thread created... Thread created... Thread created... Fatal profiling error: cannot access TSD data in handler. Please report this as an internal PerfSuite bug to per...@li.... [PID 15326] Notice: caught SIGSEGV in wrap-up. (3) Experiment 3 (export OMP_NUM_THREADS=8) [jiangjie@node1 bin]$ psrun -c /usr/local/perfsuite/psuite/share/perfsuite/xml/pshwpc/itimer.xml -p ./cg.A libpsrun.c:181 : SIGPROF ignored on startup. Handler=0x1, flags=14000000 PerfSuite debugging enabled (debug level: PS_DEBUG_OFF) [PID 15784] Library version: threaded [PID 15784] Environment (entry of psrun_init) [PID 15784] PSRUN_DOFORK = (null) [PID 15784] LD_PRELOAD = libpsrun_r.so.0 [PID 15784] PSRUN_PID = 15784 [PID 15784] PS_HWPC_FILE = cg.A 00400000-004a7000 r-xp 00000000 08:01 60425440 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/cg.A 006a7000-006ae000 rwxp 000a7000 08:01 60425440 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/cg.A 006ae000-037a2000 rwxp 006ae000 00:00 0 15b6b000-15b8c000 rwxp 15b6b000 00:00 0 2aaaaaaab000-2aaaaaac5000 r-xp 00000000 08:01 44958009 /lib64/ld-2.5.so 2aaaaaac5000-2aaaaaac7000 rwxp 2aaaaaac5000 00:00 0 2aaaaacc4000-2aaaaacc5000 r-xp 00019000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc5000-2aaaaacc6000 rwxp 0001a000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc6000-2aaaaacca000 r-xp 00000000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaacca000-2aaaaaec9000 ---p 00004000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaec9000-2aaaaaeca000 rwxp 00003000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaeca000-2aaaaaecb000 rwxp 2aaaaaeca000 00:00 0 2aaaaaef1000-2aaaaaf73000 r-xp 00000000 08:01 44957999 /lib64/libm-2.5.so 2aaaaaf73000-2aaaab172000 ---p 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab172000-2aaaab173000 r-xp 00081000 08:01 44957999 /lib64/libm-2.5.so 2aaaab173000-2aaaab174000 rwxp 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab174000-2aaaab1db000 r-xp 00000000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab1db000-2aaaab2db000 ---p 00067000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab2db000-2aaaab2e0000 rwxp 00067000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab2e0000-2aaaab2e8000 rwxp 2aaaab2e0000 00:00 0 2aaaab2e8000-2aaaab2fd000 r-xp 00000000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab2fd000-2aaaab4fc000 ---p 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fc000-2aaaab4fd000 r-xp 00014000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fd000-2aaaab4fe000 rwxp 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fe000-2aaaab502000 rwxp 2aaaab4fe000 00:00 0 2aaaab502000-2aaaab646000 r-xp 00000000 08:01 44958004 /lib64/libc-2.5.so 2aaaab646000-2aaaab846000 ---p 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaab846000-2aaaab84a000 r-xp 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaab84a000-2aaaab84b000 rwxp 00148000 08:01 44958004 /lib64/libc-2.5.so 2aaaab84b000-2aaaab850000 rwxp 2aaaab84b000 00:00 0 2aaaab850000-2aaaab85d000 r-xp 00000000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaab85d000-2aaaaba5c000 ---p 0000d000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaaba5c000-2aaaaba5d000 rwxp 0000c000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaaba5d000-2aaaaba5e000 rwxp 2aaaaba5d000 00:00 0 2aaaaba5e000-2aaaaba60000 r-xp 00000000 08:01 44958023 /lib64/libdl-2.5.so 2aaaaba60000-2aaaabc60000 ---p 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc60000-2aaaabc61000 r-xp 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc61000-2aaaabc62000 rwxp 00003000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc62000-2aaaabc6f000 r-xp 00000000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabc6f000-2aaaabe6e000 ---p 0000d000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabe6e000-2aaaabe6f000 rwxp 0000c000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabe6f000-2aaaabe71000 rwxp 2aaaabe6f000 00:00 0 2aaaabe71000-2aaaabe83000 r-xp 00000000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaabe83000-2aaaac082000 ---p 00012000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac082000-2aaaac083000 rwxp 00011000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac083000-2aaaac084000 rwxp 2aaaac083000 00:00 0 2aaaac0aa000-2aaaac0ca000 r-xp 00000000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac0ca000-2aaaac2c9000 ---p 00020000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac2c9000-2aaaac2cc000 rwxp 0001f000 08:01 44958013 /lib64/libexpat.so.0.5.0 7fff47070000-7fff47085000 rwxp 7fff47070000 00:00 0 [stack] ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0 [vdso] NAS Parallel Benchmarks (NPB3.2-OMP) - CG Benchmark Size: 14000 Iterations: 15 Number of available threads: 8 Thread created... Thread created... Thread created... Thread created... Thread created... Fatal profiling error: cannot access TSD data in handler. Please report this as an internal PerfSuite bug to per...@li.... Thread returned from hwpc_start with status 0 Thread returned from hwpc_start with status 0 Thread created... Thread created... system error(35): __kmp_reap_monitor: monitor did not reap properly: Resource deadlock avoided OMP: Error #107: Fatal system error detected. Thread executing cleanup handler (4) Experiment 4 (export OMP_NUM_THREADS=8) [jiangjie@node1 bin]$ psrun -c /usr/local/perfsuite/psuite/share/perfsuite/xml/pshwpc/itimer.xml -p ./cg.A libpsrun.c:181 : SIGPROF ignored on startup. Handler=0x1, flags=14000000 PerfSuite debugging enabled (debug level: PS_DEBUG_OFF) [PID 15916] Library version: threaded [PID 15916] Environment (entry of psrun_init) [PID 15916] PSRUN_DOFORK = (null) [PID 15916] LD_PRELOAD = libpsrun_r.so.0 [PID 15916] PSRUN_PID = 15916 [PID 15916] PS_HWPC_FILE = cg.A 00400000-004a7000 r-xp 00000000 08:01 60425440 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/cg.A 006a7000-006ae000 rwxp 000a7000 08:01 60425440 /home/jiangjie/NPB3.2.1/NPB3.2-OMP/bin/cg.A 006ae000-037a2000 rwxp 006ae000 00:00 0 19c52000-19c73000 rwxp 19c52000 00:00 0 2aaaaaaab000-2aaaaaac5000 r-xp 00000000 08:01 44958009 /lib64/ld-2.5.so 2aaaaaac5000-2aaaaaac7000 rwxp 2aaaaaac5000 00:00 0 2aaaaacc4000-2aaaaacc5000 r-xp 00019000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc5000-2aaaaacc6000 rwxp 0001a000 08:01 44958009 /lib64/ld-2.5.so 2aaaaacc6000-2aaaaacca000 r-xp 00000000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaacca000-2aaaaaec9000 ---p 00004000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaec9000-2aaaaaeca000 rwxp 00003000 08:01 60425291 /usr/local/perfsuite/psuite/lib/libpsrun_r.so.0.0.1 2aaaaaeca000-2aaaaaecb000 rwxp 2aaaaaeca000 00:00 0 2aaaaaef1000-2aaaaaf73000 r-xp 00000000 08:01 44957999 /lib64/libm-2.5.so 2aaaaaf73000-2aaaab172000 ---p 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab172000-2aaaab173000 r-xp 00081000 08:01 44957999 /lib64/libm-2.5.so 2aaaab173000-2aaaab174000 rwxp 00082000 08:01 44957999 /lib64/libm-2.5.so 2aaaab174000-2aaaab1db000 r-xp 00000000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab1db000-2aaaab2db000 ---p 00067000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab2db000-2aaaab2e0000 rwxp 00067000 08:01 66789180 /opt/intel10.1/fce/10.1.017/lib/libguide.so 2aaaab2e0000-2aaaab2e8000 rwxp 2aaaab2e0000 00:00 0 2aaaab2e8000-2aaaab2fd000 r-xp 00000000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab2fd000-2aaaab4fc000 ---p 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fc000-2aaaab4fd000 r-xp 00014000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fd000-2aaaab4fe000 rwxp 00015000 08:01 44957988 /lib64/libpthread-2.5.so 2aaaab4fe000-2aaaab502000 rwxp 2aaaab4fe000 00:00 0 2aaaab502000-2aaaab646000 r-xp 00000000 08:01 44958004 /lib64/libc-2.5.so 2aaaab646000-2aaaab846000 ---p 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaab846000-2aaaab84a000 r-xp 00144000 08:01 44958004 /lib64/libc-2.5.so 2aaaab84a000-2aaaab84b000 rwxp 00148000 08:01 44958004 /lib64/libc-2.5.so 2aaaab84b000-2aaaab850000 rwxp 2aaaab84b000 00:00 0 2aaaab850000-2aaaab85d000 r-xp 00000000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaab85d000-2aaaaba5c000 ---p 0000d000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaaba5c000-2aaaaba5d000 rwxp 0000c000 08:01 44958007 /lib64/libgcc_s-4.1.1-20070105.so.1 2aaaaba5d000-2aaaaba5e000 rwxp 2aaaaba5d000 00:00 0 2aaaaba5e000-2aaaaba60000 r-xp 00000000 08:01 44958023 /lib64/libdl-2.5.so 2aaaaba60000-2aaaabc60000 ---p 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc60000-2aaaabc61000 r-xp 00002000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc61000-2aaaabc62000 rwxp 00003000 08:01 44958023 /lib64/libdl-2.5.so 2aaaabc62000-2aaaabc6f000 r-xp 00000000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabc6f000-2aaaabe6e000 ---p 0000d000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabe6e000-2aaaabe6f000 rwxp 0000c000 08:01 60425170 /usr/local/perfsuite/psuite/lib/libperfsuite_r.so.1.0.1 2aaaabe6f000-2aaaabe71000 rwxp 2aaaabe6f000 00:00 0 2aaaabe71000-2aaaabe83000 r-xp 00000000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaabe83000-2aaaac082000 ---p 00012000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac082000-2aaaac083000 rwxp 00011000 08:01 60425187 /usr/local/perfsuite/psuite/lib/libpshwpc_r.so.1.0.1 2aaaac083000-2aaaac084000 rwxp 2aaaac083000 00:00 0 2aaaac0aa000-2aaaac0ca000 r-xp 00000000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac0ca000-2aaaac2c9000 ---p 00020000 08:01 44958013 /lib64/libexpat.so.0.5.0 2aaaac2c9000-2aaaac2cc000 rwxp 0001f000 08:01 44958013 /lib64/libexpat.so.0.5.0 7fff36965000-7fff3697b000 rwxp 7fff36965000 00:00 0 [stack] ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0 [vdso] NAS Parallel Benchmarks (NPB3.2-OMP) - CG Benchmark Size: 14000 Iterations: 15 Number of available threads: 8 Thread created... Thread created... Thread created... Thread created... Thread created... Thread created... Thread created... Fatal profiling error: cannot access TSD data in handler. Please report this as an internal PerfSuite bug to per...@li.... Thread created... Fatal profiling error: cannot access TSD data in handler. Please report this as an internal PerfSuite bug to per...@li.... libpsrun fatal error: calling sequence not allowed It is strange that sometimes it works well. Some forementioned problems also occur on my x86/Linux platform. And we notice that message "Fatal profiling error: cannot access TSD data in handler." always appears. Note that for all serial and MPI NPB benchmarks, perfsuite works well. Any suggestion? Regards, Jie Jiang ------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ PerfSuite-users mailing list Per...@li... https://lists.sourceforge.net/lists/listinfo/perfsuite-users |