Menu ▾ ▴

Understanding the comparison table (output of test)

Help
gundamlh
2014-09-11
2014-09-12

  • gundamlh

    gundamlh - 2014-09-11

    Dear friends,

    I have spent quite much time on compiling this math library ATLAS. However the improvement is not satisfactory. I want to figure out why... :(

    Any enlightening explanation is highly appreciated.

    From http://math-atlas.sourceforge.net/atlas_install/node41.html#sec-time,
    Roughly speaking, it should be expected that most values under "Present" are larger than the corresponding value under "Refrenc", or any misunderstanding? However in my case, depression showed in many rows...

    My PC and OS configuration

    1. OS is openSUSE 13.1.
    2. The package is successfully compiled.
    3. Although the "performance" governor is chosen for all four CPU cores, the frequencies (in MHz) are different: 3509.000, 2581.000, 2813.000, 1450.000.
    4. I cannot set the CPU frequency manually because of the CPU driver intel_pstate and some other problems, and hence I use "DWALL":

    The configure step

    /opt/ATLAS/ATLAS_suse> sudo ../configure -v 2 -b 64 -D c -DWALL -Fa alg -fPIC --shared --prefix=/usr/local/atlas --incdir=/usr/local/atlas/include --libdir=/usr/local/atlas/lib --with-netlib-lapack-tarfile=/opt/lapack-3.5.0.tgz

    The comparison table of test output

    Reference clock rate=3292Mhz, new rate=3538Mhz
   Refrenc : % of clock rate achieved by reference install
   Present : % of clock rate achieved by present ATLAS install

                    single precision                  double precision
            ********************************   *******************************
                  real           complex           real           complex
            ---------------  ---------------  ---------------  ---------------
Benchmark   Refrenc Present  Refrenc Present  Refrenc Present  Refrenc Present
=========   ======= =======  ======= =======  ======= =======  ======= =======
  kSelMM     1289.9  1314.8   1188.7  1175.3    686.7   703.5    647.4   641.9
  kGenMM      198.2   194.6    198.5   194.4    193.9   178.1    196.0   191.1
  kMM_NT      193.7   179.9    195.2   192.5    184.2   173.6    188.5   186.0
  kMM_TN      198.5   193.1    197.9   194.9    189.8   183.4    189.5   185.5
  BIG_MM     1213.8  1153.2   1241.3  1195.0    652.0   632.1    661.4   635.0
   kMV_N      224.3   149.7    438.8   296.7    115.9    73.4    205.8   140.4
   kMV_T      224.6   140.1    460.3   295.4    123.2    73.5    211.3   139.0
    kGER      148.3    80.2    290.2   158.2     73.3    39.7    144.3    79.0

    Full test output:

    /opt/ATLAS/ATLAS_suse> sudo make time

gcc -I/opt/ATLAS/ATLAS_suse/..//CONFIG/include  -g -w -DATL_DYLIBS -c /opt/ATLAS/ATLAS_suse/..//CONFIG/src/atlbench.c
gcc -I/opt/ATLAS/ATLAS_suse/..//CONFIG/include  -g -w -DATL_DYLIBS -c /opt/ATLAS/ATLAS_suse/..//CONFIG/src/atlconf_misc.c
gcc -I/opt/ATLAS/ATLAS_suse/..//CONFIG/include  -g -w -DATL_DYLIBS -o xatlbench atlbench.o atlconf_misc.o
atlbench.o: In function `ATL_tmpnam':
/opt/ATLAS/ATLAS_suse/..//CONFIG/include/atlas_sys.h:224: warning: the use of `tmpnam' is dangerous, better use `mkstemp'
make -f Make.top time
make[1]: Entering directory `/opt/ATLAS/ATLAS_suse'
./xatlbench -dc /opt/ATLAS/ATLAS_suse/bin/INSTALL_LOG -dp /opt/ATLAS/ATLAS_suse/ARCHS/Corei264AVX
make[2]: Entering directory `/opt/ATLAS/ATLAS_suse/bin'
/usr/bin/gcc-4.8 -o sgemmtst_big.o -c -DL2SIZE=4194304 -I/opt/ATLAS/ATLAS_suse/include -I/opt/ATLAS/ATLAS_suse/..//include -I/opt/ATLAS/ATLAS_suse/..//include/contrib -DAdd_ -DF77_INTEGER=int -DStringSunStyle -DATL_OS_Linux -DATL_ARCH_Corei2 -DATL_CPUMHZ=3538 -DATL_AVX -DATL_SSE3 -DATL_SSE2 -DATL_SSE1 -DATL_USE64BITS -DATL_GAS_x8664 -m64 -DWALL -DATL_DYLIBS -DATL_FULL_LAPACK -DATL_NCPU=4 -fomit-frame-pointer -mfpmath=sse -O2 -fno-schedule-insns2 -mavx -fPIC -m64 -fPIC -DSREAL -DTRUST_BIG   \
               /opt/ATLAS/ATLAS_suse/..//bin/gemmtst.c
cd /opt/ATLAS/ATLAS_suse/src/auxil ; make lib
make[3]: Entering directory `/opt/ATLAS/ATLAS_suse/src/auxil'
make[3]: Nothing to be done for `lib'.
make[3]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/auxil'
cd /opt/ATLAS/ATLAS_suse/src/blas/gemm ; make slib
make[3]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make auxillib scleanuplib susergemm
make[4]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
cd /opt/ATLAS/ATLAS_suse/src/auxil ; make lib
make[5]: Entering directory `/opt/ATLAS/ATLAS_suse/src/auxil'
make[5]: Nothing to be done for `lib'.
make[5]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/auxil'
cd KERNEL ; make -f sMakefile slib
make[5]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm/KERNEL'
make[5]: Nothing to be done for `slib'.
make[5]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm/KERNEL'
make[4]: Nothing to be done for `susergemm'.
make[4]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make -j 4 slib.grd
make[4]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make[4]: `slib.grd' is up to date.
make[4]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make[3]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
cd /opt/ATLAS/ATLAS_suse/src/testing ; make slib
make[3]: Entering directory `/opt/ATLAS/ATLAS_suse/src/testing'
make -j 4 slib.grd
make[4]: Entering directory `/opt/ATLAS/ATLAS_suse/src/testing'
make[4]: `slib.grd' is up to date.
make[4]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/testing'
make[3]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/testing'
/usr/bin/gfortran -O -mavx -fPIC -m64 -fPIC -o xsmmtst_big sgemmtst_big.o \
                   /opt/ATLAS/ATLAS_suse/lib/libtstatlas.a /opt/ATLAS/ATLAS_suse/lib/libf77refblas.a    /opt/ATLAS/ATLAS_suse/src/blas/gemm/ATL_sbig_mm.o /opt/ATLAS/ATLAS_suse/src/blas/gemm/ATL_sbignork_mm.o /opt/ATLAS/ATLAS_suse/src/blas/gemm/ATL_ssmall_mm.o /opt/ATLAS/ATLAS_suse/src/blas/gemm/ATL_ssmallK_mm.o /opt/ATLAS/ATLAS_suse/lib/libatlas.a -lpthread -lm
make[2]: Leaving directory `/opt/ATLAS/ATLAS_suse/bin'
res+off=39468.9  1.00   ---

BIG_MM N=1600, mf=39468.90,40800.10!
make[2]: Entering directory `/opt/ATLAS/ATLAS_suse/bin'
/usr/bin/gcc-4.8 -o cgemmtst_big.o -c -DL2SIZE=4194304 -I/opt/ATLAS/ATLAS_suse/include -I/opt/ATLAS/ATLAS_suse/..//include -I/opt/ATLAS/ATLAS_suse/..//include/contrib -DAdd_ -DF77_INTEGER=int -DStringSunStyle -DATL_OS_Linux -DATL_ARCH_Corei2 -DATL_CPUMHZ=3538 -DATL_AVX -DATL_SSE3 -DATL_SSE2 -DATL_SSE1 -DATL_USE64BITS -DATL_GAS_x8664 -m64 -DWALL -DATL_DYLIBS -DATL_FULL_LAPACK -DATL_NCPU=4 -fomit-frame-pointer -mfpmath=sse -O2 -fno-schedule-insns2 -mavx -fPIC -m64 -fPIC -DSCPLX -DTRUST_BIG   \
               /opt/ATLAS/ATLAS_suse/..//bin/gemmtst.c
cd /opt/ATLAS/ATLAS_suse/src/auxil ; make lib
make[3]: Entering directory `/opt/ATLAS/ATLAS_suse/src/auxil'
make[3]: Nothing to be done for `lib'.
make[3]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/auxil'
cd /opt/ATLAS/ATLAS_suse/src/blas/gemm ; make clib
make[3]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make auxillib ccleanuplib cusergemm
make[4]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
cd /opt/ATLAS/ATLAS_suse/src/auxil ; make lib
make[5]: Entering directory `/opt/ATLAS/ATLAS_suse/src/auxil'
make[5]: Nothing to be done for `lib'.
make[5]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/auxil'
cd KERNEL ; make -f cMakefile clib
make[5]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm/KERNEL'
make[5]: Nothing to be done for `clib'.
make[5]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm/KERNEL'
make[4]: Nothing to be done for `cusergemm'.
make[4]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make -j 4 clib.grd
make[4]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make[4]: `clib.grd' is up to date.
make[4]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make[3]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
cd /opt/ATLAS/ATLAS_suse/src/testing ; make clib
make[3]: Entering directory `/opt/ATLAS/ATLAS_suse/src/testing'
make -j 4 clib.grd
make[4]: Entering directory `/opt/ATLAS/ATLAS_suse/src/testing'
make[4]: `clib.grd' is up to date.
make[4]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/testing'
make[3]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/testing'
/usr/bin/gfortran -O -mavx -fPIC -m64 -fPIC -o xcmmtst_big cgemmtst_big.o \
                   /opt/ATLAS/ATLAS_suse/lib/libtstatlas.a /opt/ATLAS/ATLAS_suse/lib/libf77refblas.a    /opt/ATLAS/ATLAS_suse/src/blas/gemm/ATL_cbig_mm.o /opt/ATLAS/ATLAS_suse/src/blas/gemm/ATL_csmall_mm.o /opt/ATLAS/ATLAS_suse/src/blas/gemm/ATL_csmallK_mm.o /opt/ATLAS/ATLAS_suse/lib/libatlas.a -lpthread -lm
make[2]: Leaving directory `/opt/ATLAS/ATLAS_suse/bin'
res+off= 42280.0 1.00   ---

BIG_MM N=1600, mf=42280.00,42115.40!
make[2]: Entering directory `/opt/ATLAS/ATLAS_suse/bin'
/usr/bin/gcc-4.8 -o dgemmtst_big.o -c -DL2SIZE=4194304 -I/opt/ATLAS/ATLAS_suse/include -I/opt/ATLAS/ATLAS_suse/..//include -I/opt/ATLAS/ATLAS_suse/..//include/contrib -DAdd_ -DF77_INTEGER=int -DStringSunStyle -DATL_OS_Linux -DATL_ARCH_Corei2 -DATL_CPUMHZ=3538 -DATL_AVX -DATL_SSE3 -DATL_SSE2 -DATL_SSE1 -DATL_USE64BITS -DATL_GAS_x8664 -m64 -DWALL -DATL_DYLIBS -DATL_FULL_LAPACK -DATL_NCPU=4 -fomit-frame-pointer -mfpmath=sse -O2 -fno-schedule-insns2 -mavx -fPIC -m64 -fPIC -DDREAL -DTRUST_BIG   \
               /opt/ATLAS/ATLAS_suse/..//bin/gemmtst.c
cd /opt/ATLAS/ATLAS_suse/src/auxil ; make lib
make[3]: Entering directory `/opt/ATLAS/ATLAS_suse/src/auxil'
make[3]: Nothing to be done for `lib'.
make[3]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/auxil'
cd /opt/ATLAS/ATLAS_suse/src/blas/gemm ; make dlib
make[3]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make auxillib dcleanuplib dusergemm
make[4]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
cd /opt/ATLAS/ATLAS_suse/src/auxil ; make lib
make[5]: Entering directory `/opt/ATLAS/ATLAS_suse/src/auxil'
make[5]: Nothing to be done for `lib'.
make[5]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/auxil'
cd KERNEL ; make -f dMakefile dlib
make[5]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm/KERNEL'
make[5]: Nothing to be done for `dlib'.
make[5]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm/KERNEL'
make[4]: Nothing to be done for `dusergemm'.
make[4]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make -j 4 dlib.grd
make[4]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make[4]: `dlib.grd' is up to date.
make[4]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make[3]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
cd /opt/ATLAS/ATLAS_suse/src/testing ; make dlib
make[3]: Entering directory `/opt/ATLAS/ATLAS_suse/src/testing'
make -j 4 dlib.grd
make[4]: Entering directory `/opt/ATLAS/ATLAS_suse/src/testing'
make[4]: `dlib.grd' is up to date.
make[4]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/testing'
make[3]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/testing'
/usr/bin/gfortran -O -mavx -fPIC -m64 -fPIC -o xdmmtst_big dgemmtst_big.o \
                   /opt/ATLAS/ATLAS_suse/lib/libtstatlas.a /opt/ATLAS/ATLAS_suse/lib/libf77refblas.a    /opt/ATLAS/ATLAS_suse/src/blas/gemm/ATL_dbig_mm.o /opt/ATLAS/ATLAS_suse/src/blas/gemm/ATL_dbignork_mm.o /opt/ATLAS/ATLAS_suse/src/blas/gemm/ATL_dsmall_mm.o /opt/ATLAS/ATLAS_suse/src/blas/gemm/ATL_dsmallK_mm.o /opt/ATLAS/ATLAS_suse/lib/libatlas.a -lpthread -lm
make[2]: Leaving directory `/opt/ATLAS/ATLAS_suse/bin'
res+off=22365.0  1.00   ---

BIG_MM N=1600, mf=22365.00,21936.70!
make[2]: Entering directory `/opt/ATLAS/ATLAS_suse/bin'
/usr/bin/gcc-4.8 -o zgemmtst_big.o -c -DL2SIZE=4194304 -I/opt/ATLAS/ATLAS_suse/include -I/opt/ATLAS/ATLAS_suse/..//include -I/opt/ATLAS/ATLAS_suse/..//include/contrib -DAdd_ -DF77_INTEGER=int -DStringSunStyle -DATL_OS_Linux -DATL_ARCH_Corei2 -DATL_CPUMHZ=3538 -DATL_AVX -DATL_SSE3 -DATL_SSE2 -DATL_SSE1 -DATL_USE64BITS -DATL_GAS_x8664 -m64 -DWALL -DATL_DYLIBS -DATL_FULL_LAPACK -DATL_NCPU=4 -fomit-frame-pointer -mfpmath=sse -O2 -fno-schedule-insns2 -mavx -fPIC -m64 -fPIC -DDCPLX -DTRUST_BIG   \
               /opt/ATLAS/ATLAS_suse/..//bin/gemmtst.c
cd /opt/ATLAS/ATLAS_suse/src/auxil ; make lib
make[3]: Entering directory `/opt/ATLAS/ATLAS_suse/src/auxil'
make[3]: Nothing to be done for `lib'.
make[3]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/auxil'
cd /opt/ATLAS/ATLAS_suse/src/blas/gemm ; make zlib
make[3]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make auxillib zcleanuplib zusergemm
make[4]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
cd /opt/ATLAS/ATLAS_suse/src/auxil ; make lib
make[5]: Entering directory `/opt/ATLAS/ATLAS_suse/src/auxil'
make[5]: Nothing to be done for `lib'.
make[5]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/auxil'
cd KERNEL ; make -f zMakefile zlib
make[5]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm/KERNEL'
make[5]: Nothing to be done for `zlib'.
make[5]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm/KERNEL'
make[4]: Nothing to be done for `zusergemm'.
make[4]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make -j 4 zlib.grd
make[4]: Entering directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make[4]: `zlib.grd' is up to date.
make[4]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
make[3]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/blas/gemm'
cd /opt/ATLAS/ATLAS_suse/src/testing ; make zlib
make[3]: Entering directory `/opt/ATLAS/ATLAS_suse/src/testing'
make -j 4 zlib.grd
make[4]: Entering directory `/opt/ATLAS/ATLAS_suse/src/testing'
make[4]: `zlib.grd' is up to date.
make[4]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/testing'
make[3]: Leaving directory `/opt/ATLAS/ATLAS_suse/src/testing'
/usr/bin/gfortran -O -mavx -fPIC -m64 -fPIC -o xzmmtst_big zgemmtst_big.o \
                   /opt/ATLAS/ATLAS_suse/lib/libtstatlas.a /opt/ATLAS/ATLAS_suse/lib/libf77refblas.a    /opt/ATLAS/ATLAS_suse/src/blas/gemm/ATL_zbig_mm.o /opt/ATLAS/ATLAS_suse/src/blas/gemm/ATL_zsmall_mm.o /opt/ATLAS/ATLAS_suse/src/blas/gemm/ATL_zsmallK_mm.o /opt/ATLAS/ATLAS_suse/lib/libatlas.a -lpthread -lm
make[2]: Leaving directory `/opt/ATLAS/ATLAS_suse/bin'
res+off= 22390.6 1.00   ---

BIG_MM N=1600, mf=22390.60,22467.70!

The times labeled Reference are for ATLAS as installed by the authors.
NAMING ABBREVIATIONS:
   kSelMM : selected matmul kernel (may be hand-tuned)
   kGenMM : generated matmul kernel
   kMM_NT : worst no-copy kernel
   kMM_TN : best no-copy kernel
   BIG_MM : large GEMM timing (usually N=1600); estimate of asymptotic peak
   kMV_N  : NoTranspose matvec kernel
   kMV_T  : Transpose matvec kernel
   kGER   : GER (rank-1 update) kernel
Kernel routines are not called by the user directly, and their
performance is often somewhat different than the total
algorithm (eg, dGER perf may differ from dkGER)

Reference clock rate=3292Mhz, new rate=3538Mhz
   Refrenc : % of clock rate achieved by reference install
   Present : % of clock rate achieved by present ATLAS install

                    single precision                  double precision
            ********************************   *******************************
                  real           complex           real           complex
            ---------------  ---------------  ---------------  ---------------
Benchmark   Refrenc Present  Refrenc Present  Refrenc Present  Refrenc Present
=========   ======= =======  ======= =======  ======= =======  ======= =======
  kSelMM     1289.9  1314.8   1188.7  1175.3    686.7   703.5    647.4   641.9
  kGenMM      198.2   194.6    198.5   194.4    193.9   178.1    196.0   191.1
  kMM_NT      193.7   179.9    195.2   192.5    184.2   173.6    188.5   186.0
  kMM_TN      198.5   193.1    197.9   194.9    189.8   183.4    189.5   185.5
  BIG_MM     1213.8  1153.2   1241.3  1195.0    652.0   632.1    661.4   635.0
   kMV_N      224.3   149.7    438.8   296.7    115.9    73.4    205.8   140.4
   kMV_T      224.6   140.1    460.3   295.4    123.2    73.5    211.3   139.0
    kGER      148.3    80.2    290.2   158.2     73.3    39.7    144.3    79.0
make[1]: Leaving directory `/opt/ATLAS/ATLAS_suse'

    Thank you all in advance!
    gundamlh

     

    Last edit: gundamlh 2014-09-11

  • gundamlh

    gundamlh - 2014-09-12

    Hi friends,

    I am now able to set each CPU core at 2900MHz on openSUSE 13.1 and compiled ATLAS once again.

    :/opt/ATLAS> sudo ../configure -v 2 -b 64 -D c -DPentiumCPS=2900 -Fa alg -fPIC --shared --prefix=/usr/local/atlas --incdir=/usr/local/atlas/include --libdir=/usr/local/atlas/lib --with-netlib-lapack-tarfile=/opt/lapack-3.5.0.tgz

    The test result

    Reference clock rate=3292Mhz, new rate=2901Mhz
   Refrenc : % of clock rate achieved by reference install
   Present : % of clock rate achieved by present ATLAS install

                    single precision                  double precision
            ********************************   *******************************
                  real           complex           real           complex
            ---------------  ---------------  ---------------  ---------------
Benchmark   Refrenc Present  Refrenc Present  Refrenc Present  Refrenc Present
=========   ======= =======  ======= =======  ======= =======  ======= =======
  kSelMM     1289.9  1596.4   1188.7  1432.2    686.7   848.5    647.4   779.5
  kGenMM      198.2   235.6    198.5   234.3    193.9   213.9    196.0   231.9
  kMM_NT      193.7   221.4    195.2   229.9    184.2   211.1    188.5   224.2
  kMM_TN      198.5   233.3    197.9   234.5    189.8   219.4    189.5   223.3
  BIG_MM     1213.8  1432.2   1241.3  1456.2    652.0   766.3    661.4   774.4
   kMV_N      224.3   179.8    438.8   362.1    115.9    89.6    205.8   170.7
   kMV_T      224.6   172.5    460.3   358.5    123.2    92.1    211.3   171.4
    kGER      148.3    95.4    290.2   193.6     73.3    48.0    144.3    97.1

    The result looks good. :)

    Thanks,
    gundamlh

     

    Last edit: gundamlh 2014-09-12

Log in to post a comment.