Menu
▾
▴
kaldi-users — Kaldi Users
You can subscribe to this list here.
| 2011 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
(2) |
Aug
(2) |
Sep
(1) |
Oct
(1) |
Nov
|
Dec
|
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2012 |
Jan
|
Feb
|
Mar
(8) |
Apr
(4) |
May
(2) |
Jun
(1) |
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
| 2013 |
Jan
|
Feb
(2) |
Mar
(2) |
Apr
(7) |
May
(31) |
Jun
(40) |
Jul
(65) |
Aug
(37) |
Sep
(12) |
Oct
(57) |
Nov
(15) |
Dec
(35) |
| 2014 |
Jan
(3) |
Feb
(30) |
Mar
(57) |
Apr
(26) |
May
(49) |
Jun
(26) |
Jul
(63) |
Aug
(33) |
Sep
(20) |
Oct
(153) |
Nov
(62) |
Dec
(20) |
| 2015 |
Jan
(6) |
Feb
(21) |
Mar
(42) |
Apr
(33) |
May
(76) |
Jun
(102) |
Jul
(39) |
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-29 22:19:59
|
I was curious likely logical next-steps for improving training / decoding might be give other user's experience. It does very well with significant background noise, but I think that there is definitely room to do better. 1 - I have a training set of around 5K words, though I could bring that up to around 20K 2 - I am using the kaldi_lm, though I could use SRILM . . not sure if it would necessarily improve results 3 - I am decoding about 1 minute of text, though training data is in 10 second epochs. I can mix some of the test data in if that would help. 4 - When I am training deltas I use a very small # of leaves / gauss (100 / 1000) to get the best results. The best results are with tri1. Further training yields worse results. 5 - I use the same lexicon for the training and decoding (though a more restrictive language model for decoding). Any help / thoughts are appreciated. Thanks, Nathan |
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-29 16:58:05
|
I previously spoke to Michael Deisher at Intel about this, he says he has asked the relevant team. So I think they are aware of the problem. Dan On Mon, Jul 29, 2013 at 12:06 PM, Mailing list used for User Communication and Updates <kal...@li...> wrote: > It has been reported on intel dev forum. > http://software.intel.com/en-us/forums/topic/402436 > http://software.intel.com/en-us/forums/topic/402473 > > The problem is caused by the incorrect query result of workspace size given > by dgesvd(). > > 11.0.5 seems to be a very buggy version. > > > > On Mon, Jul 29, 2013 at 11:39 PM, Mailing list used for User Communication > and Updates <kal...@li...> wrote: >> >> I just checked different versions of MKL and indeed, this was introduced >> in the update 5. Anyone with the commercial MKL support cares to submit a >> ticket to Intel? >> y. >> >> >> On Wed, Jul 24, 2013 at 12:42 PM, Mailing list used for User Communication >> and Updates <kal...@li...> wrote: >>> >>> You are right.... I just downgraded to MKL 11.0update1 and passed the >>> test. >>> >>> >>> >>> On Thu, Jul 25, 2013 at 12:28 AM, Mailing list used for User >>> Communication and Updates <kal...@li...> wrote: >>>> >>>> I saw some changes regarding improving performance of *GESVD in the MKL >>>> 11.0 update5 changelog. I wonder if they messed something up? How about >>>> trying slightly "older" version of the MKL? If you are on the subscription >>>> of Intel Software Network, you can download older versions of the MKL at no >>>> charge... >>>> >>>> We are using Intel 11.0 and the tests pass without any problem... >>>> >>>> yenda >>>> >>>> >>>> >>>> On Wed, Jul 24, 2013 at 12:14 PM, Mailing list used for User >>>> Communication and Updates <kal...@li...> wrote: >>>>> >>>>> I can't see any problems in the Kaldi code. Perhaps this is an older >>>>> version of MKL? It could be a bug in MKL itself. MKL tests OK for >>>>> me. >>>>> Dan >>>>> >>>>> >>>>> On Wed, Jul 24, 2013 at 11:55 AM, Mailing list used for User >>>>> Communication and Updates <kal...@li...> wrote: >>>>> > here's the dbg info copied from eclipse. >>>>> > PS: I can pass the test with atlas provided by centos repo >>>>> > atlas-sse3.x86_64 3.8.4-2.el6 >>>>> > @base >>>>> > atlas-sse3-devel.x86_64 3.8.4-2.el6 >>>>> > @base >>>>> > >>>>> > >>>>> > >>>>> > stack: >>>>> > >>>>> > matrix-lib-test [C/C++ Application] >>>>> > matrix-lib-test [11312] [cores: 1] >>>>> > Thread [1] 11312 [core: 1] (Suspended : Signal : SIGABRT:Aborted) >>>>> > raise() at 0x33090328a5 >>>>> > abort() at 0x3309034085 >>>>> > kaldi::KaldiAssertFailure_() at kaldi-error.cc:136 0x4cf401 >>>>> > kaldi::MatrixBase<double>::LapackGesvd() at kaldi-matrix.cc:401 >>>>> > 0x48fdd3 >>>>> > kaldi::MatrixBase<double>::DestructiveSvd() at kaldi-matrix.cc:1,330 >>>>> > 0x48b902 >>>>> > kaldi::MatrixBase<double>::Svd() at kaldi-matrix.cc:1,352 0x48b9bb >>>>> > kaldi::MatrixBase<double>::Svd() at kaldi-matrix.h:315 0x468e50 >>>>> > kaldi::MatrixBase<double>::Cond() at kaldi-matrix.cc:1,222 0x48bf47 >>>>> > kaldi::InitRand<double>() at matrix-lib-test.cc:74 0x42dd7e >>>>> > kaldi::UnitTestCompressedMatrix<double>() at matrix-lib-test.cc:3,532 >>>>> > 0x43055a >>>>> > kaldi::MatrixUnitTest<double>() at matrix-lib-test.cc:3,705 0x42de8b >>>>> > main() at matrix-lib-test.cc:3,829 0x42dac7 >>>>> > >>>>> > >>>>> > >>>>> > variable list after invoking the following @line393 >>>>> > kaldi-matrix.cc >>>>> > clapack_Xgesvd(v_job, u_job, >>>>> > &M, &N, data_, &LDA, >>>>> > s->Data(), >>>>> > V->Data(), &V_stride, >>>>> > U->Data(), &U_stride, >>>>> > p_work, &l_work, >>>>> > &result); >>>>> > >>>>> > >>>>> > __func__ char [12] 0x4d5418 >>>>> > M KaldiBlasInt 1 >>>>> > LDA KaldiBlasInt 2 >>>>> > U kaldi::MatrixBase<double> * 0x7ffffffface0 >>>>> > data_ double * 0x7413b0 >>>>> > *data_ double 0 >>>>> > num_cols_ kaldi::MatrixIndexT 1 >>>>> > num_rows_ kaldi::MatrixIndexT 10 >>>>> > stride_ kaldi::MatrixIndexT 2 >>>>> > l_work KaldiBlasInt 5 >>>>> > p_work double * 0x741460 >>>>> > *p_work double 1.0829823019173015e-312 >>>>> > temp void * 0x741460 >>>>> > N KaldiBlasInt 10 >>>>> > V kaldi::MatrixBase<double> * 0x7fffffffacc0 >>>>> > data_ double * 0x7406a0 >>>>> > *data_ double 0 >>>>> > num_cols_ kaldi::MatrixIndexT 1 >>>>> > num_rows_ kaldi::MatrixIndexT 1 >>>>> > stride_ kaldi::MatrixIndexT 2 >>>>> > result KaldiBlasInt -13 >>>>> > tmpU kaldi::Matrix<double> {...} >>>>> > V_stride KaldiBlasInt 2 >>>>> > work_query double 5 >>>>> > u_job char * 0x4d4fea "N" >>>>> > tmpV kaldi::Matrix<double> {...} >>>>> > U_stride KaldiBlasInt 2 >>>>> > v_job char * 0x4d4fea "N" >>>>> > this kaldi::MatrixBase<double> * const 0x7fffffffaf80 >>>>> > data_ double * 0x741300 >>>>> > *data_ double 0.78239572048187256 >>>>> > num_cols_ kaldi::MatrixIndexT 1 >>>>> > num_rows_ kaldi::MatrixIndexT 10 >>>>> > stride_ kaldi::MatrixIndexT 2 >>>>> > s kaldi::VectorBase<double> * 0x7fffffffb190 >>>>> > data_ double * 0x7404a0 >>>>> > *data_ double 0 >>>>> > dim_ kaldi::MatrixIndexT 1 >>>>> > U_in kaldi::MatrixBase<double> * 0x0 >>>>> > V_in kaldi::MatrixBase<double> * 0x0 >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > On Wed, Jul 24, 2013 at 11:04 PM, Mailing list used for User >>>>> > Communication >>>>> > and Updates <kal...@li...> wrote: >>>>> >> >>>>> >> Could you please run this in a debugger and show me the values of >>>>> >> p_work, l_work and result, e.g. >>>>> >> >>>>> >> gdb matrix-lib >>>>> >> (gdb) r >>>>> >> [wait till it crashes] >>>>> >> (gdb) up >>>>> >> (gdb) up # not sure how many times >>>>> >> (gdb) up >>>>> >> (gdb) p l_work >>>>> >> (gdb) p p_work >>>>> >> (gdb) p result >>>>> >> >>>>> >> Dan >>>>> >> >>>>> >> >>>>> >> >>>>> >> On Wed, Jul 24, 2013 at 10:34 AM, Mailing list used for User >>>>> >> Communication and Updates <kal...@li...> wrote: >>>>> >> > Hi, >>>>> >> > >>>>> >> > I tried latest trunk version with MKL. I have no problem when >>>>> >> > running >>>>> >> > `make >>>>> >> > all`, but get a FAIL when testing. Can anyone help? Thanks. >>>>> >> > >>>>> >> > >>>>> >> > svn revision 2720 trunk >>>>> >> > >>>>> >> > >>>>> >> > configuration line: >>>>> >> > $ ./configure --threaded-math=yes --mathlib=MKL --use-cuda=yes >>>>> >> > --mkl-root=$MKLROOT --omp-libdir=/opt/intel/lib/intel64 >>>>> >> > >>>>> >> > >>>>> >> > MKL version 11.0 update 5 (latest) >>>>> >> > >>>>> >> > >>>>> >> > Linux version CentOS 6.4 >>>>> >> > $ uname -a >>>>> >> > Linux 2.6.32-358.6.2.el6.x86_64 #1 SMP Thu May 16 20:59:36 UTC >>>>> >> > 2013 >>>>> >> > x86_64 >>>>> >> > x86_64 x86_64 GNU/Linux >>>>> >> > >>>>> >> > >>>>> >> > $ gcc -v >>>>> >> > Using built-in specs. >>>>> >> > Target: x86_64-redhat-linux >>>>> >> > Configured with: ../configure --prefix=/usr >>>>> >> > --mandir=/usr/share/man >>>>> >> > --infodir=/usr/share/info >>>>> >> > --with-bugurl=http://bugzilla.redhat.com/bugzilla >>>>> >> > --enable-bootstrap --enable-shared --enable-threads=posix >>>>> >> > --enable-checking=release --with-system-zlib --enable-__cxa_atexit >>>>> >> > --disable-libunwind-exceptions --enable-gnu-unique-object >>>>> >> > --enable-languages=c,c++,objc,obj-c++,java,fortran,ada >>>>> >> > --enable-java-awt=gtk >>>>> >> > --disable-dssi >>>>> >> > --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre >>>>> >> > --enable-libgcj-multifile --enable-java-maintainer-mode >>>>> >> > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar >>>>> >> > --disable-libjava-multilib >>>>> >> > --with-ppl --with-cloog --with-tune=generic --with-arch_32=i686 >>>>> >> > --build=x86_64-redhat-linux >>>>> >> > Thread model: posix >>>>> >> > gcc version 4.4.7 20120313 (Red Hat 4.4.7-3) (GCC) >>>>> >> > >>>>> >> > >>>>> >> > ~/kaldi/trunk/src/matrix >>>>> >> > $ make test >>>>> >> > Running matrix-lib-test .../bin/sh: line 1: 5561 Aborted >>>>> >> > (core dumped) ./$x > /dev/null 2>&1 >>>>> >> > ... FAIL >>>>> >> > Running kaldi-gpsr-test ...... SUCCESS >>>>> >> > make: *** [test] Error 1 >>>>> >> > >>>>> >> > >>>>> >> > $ ./matrix-lib-test >>>>> >> > ... >>>>> >> > ... >>>>> >> > VLOG[2] (UnitTestLbfgs():matrix-lib-test.cc:2734) L-BFGS finished >>>>> >> > after >>>>> >> > 59 >>>>> >> > function evaluations. >>>>> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3623) M = [ ] >>>>> >> > >>>>> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3624) M2 = [ ] >>>>> >> > >>>>> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3626) >>>>> >> > Compressed >>>>> >> > matrix, >>>>> >> > tot = 0, diff = 0 >>>>> >> > >>>>> >> > MKL ERROR: Parameter 13 was incorrect on entry to DGESVD. >>>>> >> > KALDI_ASSERT: at LapackGesvd:kaldi-matrix.cc:401, failed: result >>>>> >> > >= 0 && >>>>> >> > "Call to CLAPACK dgesvd_ called with wrong arguments" >>>>> >> > Stack trace is: >>>>> >> > kaldi::KaldiGetStackTrace() >>>>> >> > kaldi::KaldiAssertFailure_(char const*, char const*, int, char >>>>> >> > const*) >>>>> >> > kaldi::MatrixBase<double>::LapackGesvd(kaldi::VectorBase<double>*, >>>>> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) >>>>> >> > >>>>> >> > kaldi::MatrixBase<double>::DestructiveSvd(kaldi::VectorBase<double>*, >>>>> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) >>>>> >> > kaldi::MatrixBase<double>::Svd(kaldi::VectorBase<double>*, >>>>> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) const >>>>> >> > . >>>>> >> > . >>>>> >> > . >>>>> >> > ./matrix-lib-test() [0x43055a] >>>>> >> > ./matrix-lib-test() [0x42de8b] >>>>> >> > ./matrix-lib-test(main+0x1d) [0x42dac7] >>>>> >> > /lib64/libc.so.6(__libc_start_main+0xfd) [0x330901ecdd] >>>>> >> > ./matrix-lib-test() [0x42ced9] >>>>> >> > Aborted (core dumped) >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > ------------------------------------------------------------------------------ >>>>> >> > See everything from the browser to the database with AppDynamics >>>>> >> > Get end-to-end visibility with application monitoring from >>>>> >> > AppDynamics >>>>> >> > Isolate bottlenecks and diagnose root cause in seconds. >>>>> >> > Start your free trial of AppDynamics Pro today! >>>>> >> > >>>>> >> > >>>>> >> > http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk >>>>> >> > _______________________________________________ >>>>> >> > Kaldi-users mailing list >>>>> >> > Kal...@li... >>>>> >> > https://lists.sourceforge.net/lists/listinfo/kaldi-users >>>>> >> > >>>>> >> >>>>> >> >>>>> >> >>>>> >> ------------------------------------------------------------------------------ >>>>> >> See everything from the browser to the database with AppDynamics >>>>> >> Get end-to-end visibility with application monitoring from >>>>> >> AppDynamics >>>>> >> Isolate bottlenecks and diagnose root cause in seconds. >>>>> >> Start your free trial of AppDynamics Pro today! >>>>> >> >>>>> >> >>>>> >> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk >>>>> >> _______________________________________________ >>>>> >> Kaldi-users mailing list >>>>> >> Kal...@li... >>>>> >> https://lists.sourceforge.net/lists/listinfo/kaldi-users >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > ------------------------------------------------------------------------------ >>>>> > See everything from the browser to the database with AppDynamics >>>>> > Get end-to-end visibility with application monitoring from >>>>> > AppDynamics >>>>> > Isolate bottlenecks and diagnose root cause in seconds. >>>>> > Start your free trial of AppDynamics Pro today! >>>>> > >>>>> > http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk >>>>> > _______________________________________________ >>>>> > Kaldi-users mailing list >>>>> > Kal...@li... >>>>> > https://lists.sourceforge.net/lists/listinfo/kaldi-users >>>>> > >>>>> >>>>> >>>>> ------------------------------------------------------------------------------ >>>>> See everything from the browser to the database with AppDynamics >>>>> Get end-to-end visibility with application monitoring from AppDynamics >>>>> Isolate bottlenecks and diagnose root cause in seconds. >>>>> Start your free trial of AppDynamics Pro today! >>>>> >>>>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk >>>>> _______________________________________________ >>>>> Kaldi-users mailing list >>>>> Kal...@li... >>>>> https://lists.sourceforge.net/lists/listinfo/kaldi-users >>>> >>>> >>>> >>>> >>>> ------------------------------------------------------------------------------ >>>> See everything from the browser to the database with AppDynamics >>>> Get end-to-end visibility with application monitoring from AppDynamics >>>> Isolate bottlenecks and diagnose root cause in seconds. >>>> Start your free trial of AppDynamics Pro today! >>>> >>>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk >>>> _______________________________________________ >>>> Kaldi-users mailing list >>>> Kal...@li... >>>> https://lists.sourceforge.net/lists/listinfo/kaldi-users >>>> >>> >>> >>> >>> >>> >>> ------------------------------------------------------------------------------ >>> See everything from the browser to the database with AppDynamics >>> Get end-to-end visibility with application monitoring from AppDynamics >>> Isolate bottlenecks and diagnose root cause in seconds. >>> Start your free trial of AppDynamics Pro today! >>> >>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk >>> _______________________________________________ >>> Kaldi-users mailing list >>> Kal...@li... >>> https://lists.sourceforge.net/lists/listinfo/kaldi-users >>> >> >> >> >> ------------------------------------------------------------------------------ >> See everything from the browser to the database with AppDynamics >> Get end-to-end visibility with application monitoring from AppDynamics >> Isolate bottlenecks and diagnose root cause in seconds. >> Start your free trial of AppDynamics Pro today! >> >> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk >> _______________________________________________ >> Kaldi-users mailing list >> Kal...@li... >> https://lists.sourceforge.net/lists/listinfo/kaldi-users >> > > > > ------------------------------------------------------------------------------ > See everything from the browser to the database with AppDynamics > Get end-to-end visibility with application monitoring from AppDynamics > Isolate bottlenecks and diagnose root cause in seconds. > Start your free trial of AppDynamics Pro today! > http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk > _______________________________________________ > Kaldi-users mailing list > Kal...@li... > https://lists.sourceforge.net/lists/listinfo/kaldi-users > |
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-29 16:07:08
|
It has been reported on intel dev forum. http://software.intel.com/en-us/forums/topic/402436 http://software.intel.com/en-us/forums/topic/402473 The problem is caused by the incorrect query result of workspace size given by dgesvd(). 11.0.5 seems to be a very buggy version. On Mon, Jul 29, 2013 at 11:39 PM, Mailing list used for User Communication and Updates <kal...@li...> wrote: > I just checked different versions of MKL and indeed, this was introduced > in the update 5. Anyone with the commercial MKL support cares to submit a > ticket to Intel? > y. > > > On Wed, Jul 24, 2013 at 12:42 PM, Mailing list used for User Communication > and Updates <kal...@li...> wrote: > >> You are right.... I just downgraded to MKL 11.0update1 and passed the >> test. >> >> >> >> On Thu, Jul 25, 2013 at 12:28 AM, Mailing list used for User >> Communication and Updates <kal...@li...> wrote: >> >>> I saw some changes regarding improving performance of *GESVD in the MKL >>> 11.0 update5 changelog. I wonder if they messed something up? How about >>> trying slightly "older" version of the MKL? If you are on the subscription >>> of Intel Software Network, you can download older versions of the MKL at no >>> charge... >>> >>> We are using Intel 11.0 and the tests pass without any problem... >>> >>> yenda >>> >>> >>> >>> On Wed, Jul 24, 2013 at 12:14 PM, Mailing list used for User >>> Communication and Updates <kal...@li...> wrote: >>> >>>> I can't see any problems in the Kaldi code. Perhaps this is an older >>>> version of MKL? It could be a bug in MKL itself. MKL tests OK for >>>> me. >>>> Dan >>>> >>>> >>>> On Wed, Jul 24, 2013 at 11:55 AM, Mailing list used for User >>>> Communication and Updates <kal...@li...> wrote: >>>> > here's the dbg info copied from eclipse. >>>> > PS: I can pass the test with atlas provided by centos repo >>>> > atlas-sse3.x86_64 3.8.4-2.el6 >>>> > @base >>>> > atlas-sse3-devel.x86_64 3.8.4-2.el6 >>>> > @base >>>> > >>>> > >>>> > >>>> > stack: >>>> > >>>> > matrix-lib-test [C/C++ Application] >>>> > matrix-lib-test [11312] [cores: 1] >>>> > Thread [1] 11312 [core: 1] (Suspended : Signal : SIGABRT:Aborted) >>>> > raise() at 0x33090328a5 >>>> > abort() at 0x3309034085 >>>> > kaldi::KaldiAssertFailure_() at kaldi-error.cc:136 0x4cf401 >>>> > kaldi::MatrixBase<double>::LapackGesvd() at kaldi-matrix.cc:401 >>>> 0x48fdd3 >>>> > kaldi::MatrixBase<double>::DestructiveSvd() at kaldi-matrix.cc:1,330 >>>> > 0x48b902 >>>> > kaldi::MatrixBase<double>::Svd() at kaldi-matrix.cc:1,352 0x48b9bb >>>> > kaldi::MatrixBase<double>::Svd() at kaldi-matrix.h:315 0x468e50 >>>> > kaldi::MatrixBase<double>::Cond() at kaldi-matrix.cc:1,222 0x48bf47 >>>> > kaldi::InitRand<double>() at matrix-lib-test.cc:74 0x42dd7e >>>> > kaldi::UnitTestCompressedMatrix<double>() at matrix-lib-test.cc:3,532 >>>> > 0x43055a >>>> > kaldi::MatrixUnitTest<double>() at matrix-lib-test.cc:3,705 0x42de8b >>>> > main() at matrix-lib-test.cc:3,829 0x42dac7 >>>> > >>>> > >>>> > >>>> > variable list after invoking the following @line393 kaldi-matrix.cc >>>> > clapack_Xgesvd(v_job, u_job, >>>> > &M, &N, data_, &LDA, >>>> > s->Data(), >>>> > V->Data(), &V_stride, >>>> > U->Data(), &U_stride, >>>> > p_work, &l_work, >>>> > &result); >>>> > >>>> > >>>> > __func__ char [12] 0x4d5418 >>>> > M KaldiBlasInt 1 >>>> > LDA KaldiBlasInt 2 >>>> > U kaldi::MatrixBase<double> * 0x7ffffffface0 >>>> > data_ double * 0x7413b0 >>>> > *data_ double 0 >>>> > num_cols_ kaldi::MatrixIndexT 1 >>>> > num_rows_ kaldi::MatrixIndexT 10 >>>> > stride_ kaldi::MatrixIndexT 2 >>>> > l_work KaldiBlasInt 5 >>>> > p_work double * 0x741460 >>>> > *p_work double 1.0829823019173015e-312 >>>> > temp void * 0x741460 >>>> > N KaldiBlasInt 10 >>>> > V kaldi::MatrixBase<double> * 0x7fffffffacc0 >>>> > data_ double * 0x7406a0 >>>> > *data_ double 0 >>>> > num_cols_ kaldi::MatrixIndexT 1 >>>> > num_rows_ kaldi::MatrixIndexT 1 >>>> > stride_ kaldi::MatrixIndexT 2 >>>> > result KaldiBlasInt -13 >>>> > tmpU kaldi::Matrix<double> {...} >>>> > V_stride KaldiBlasInt 2 >>>> > work_query double 5 >>>> > u_job char * 0x4d4fea "N" >>>> > tmpV kaldi::Matrix<double> {...} >>>> > U_stride KaldiBlasInt 2 >>>> > v_job char * 0x4d4fea "N" >>>> > this kaldi::MatrixBase<double> * const 0x7fffffffaf80 >>>> > data_ double * 0x741300 >>>> > *data_ double 0.78239572048187256 >>>> > num_cols_ kaldi::MatrixIndexT 1 >>>> > num_rows_ kaldi::MatrixIndexT 10 >>>> > stride_ kaldi::MatrixIndexT 2 >>>> > s kaldi::VectorBase<double> * 0x7fffffffb190 >>>> > data_ double * 0x7404a0 >>>> > *data_ double 0 >>>> > dim_ kaldi::MatrixIndexT 1 >>>> > U_in kaldi::MatrixBase<double> * 0x0 >>>> > V_in kaldi::MatrixBase<double> * 0x0 >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > On Wed, Jul 24, 2013 at 11:04 PM, Mailing list used for User >>>> Communication >>>> > and Updates <kal...@li...> wrote: >>>> >> >>>> >> Could you please run this in a debugger and show me the values of >>>> >> p_work, l_work and result, e.g. >>>> >> >>>> >> gdb matrix-lib >>>> >> (gdb) r >>>> >> [wait till it crashes] >>>> >> (gdb) up >>>> >> (gdb) up # not sure how many times >>>> >> (gdb) up >>>> >> (gdb) p l_work >>>> >> (gdb) p p_work >>>> >> (gdb) p result >>>> >> >>>> >> Dan >>>> >> >>>> >> >>>> >> >>>> >> On Wed, Jul 24, 2013 at 10:34 AM, Mailing list used for User >>>> >> Communication and Updates <kal...@li...> wrote: >>>> >> > Hi, >>>> >> > >>>> >> > I tried latest trunk version with MKL. I have no problem when >>>> running >>>> >> > `make >>>> >> > all`, but get a FAIL when testing. Can anyone help? Thanks. >>>> >> > >>>> >> > >>>> >> > svn revision 2720 trunk >>>> >> > >>>> >> > >>>> >> > configuration line: >>>> >> > $ ./configure --threaded-math=yes --mathlib=MKL --use-cuda=yes >>>> >> > --mkl-root=$MKLROOT --omp-libdir=/opt/intel/lib/intel64 >>>> >> > >>>> >> > >>>> >> > MKL version 11.0 update 5 (latest) >>>> >> > >>>> >> > >>>> >> > Linux version CentOS 6.4 >>>> >> > $ uname -a >>>> >> > Linux 2.6.32-358.6.2.el6.x86_64 #1 SMP Thu May 16 20:59:36 UTC 2013 >>>> >> > x86_64 >>>> >> > x86_64 x86_64 GNU/Linux >>>> >> > >>>> >> > >>>> >> > $ gcc -v >>>> >> > Using built-in specs. >>>> >> > Target: x86_64-redhat-linux >>>> >> > Configured with: ../configure --prefix=/usr --mandir=/usr/share/man >>>> >> > --infodir=/usr/share/info >>>> >> > --with-bugurl=http://bugzilla.redhat.com/bugzilla >>>> >> > --enable-bootstrap --enable-shared --enable-threads=posix >>>> >> > --enable-checking=release --with-system-zlib --enable-__cxa_atexit >>>> >> > --disable-libunwind-exceptions --enable-gnu-unique-object >>>> >> > --enable-languages=c,c++,objc,obj-c++,java,fortran,ada >>>> >> > --enable-java-awt=gtk >>>> >> > --disable-dssi >>>> --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre >>>> >> > --enable-libgcj-multifile --enable-java-maintainer-mode >>>> >> > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar >>>> >> > --disable-libjava-multilib >>>> >> > --with-ppl --with-cloog --with-tune=generic --with-arch_32=i686 >>>> >> > --build=x86_64-redhat-linux >>>> >> > Thread model: posix >>>> >> > gcc version 4.4.7 20120313 (Red Hat 4.4.7-3) (GCC) >>>> >> > >>>> >> > >>>> >> > ~/kaldi/trunk/src/matrix >>>> >> > $ make test >>>> >> > Running matrix-lib-test .../bin/sh: line 1: 5561 Aborted >>>> >> > (core dumped) ./$x > /dev/null 2>&1 >>>> >> > ... FAIL >>>> >> > Running kaldi-gpsr-test ...... SUCCESS >>>> >> > make: *** [test] Error 1 >>>> >> > >>>> >> > >>>> >> > $ ./matrix-lib-test >>>> >> > ... >>>> >> > ... >>>> >> > VLOG[2] (UnitTestLbfgs():matrix-lib-test.cc:2734) L-BFGS finished >>>> after >>>> >> > 59 >>>> >> > function evaluations. >>>> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3623) M = [ ] >>>> >> > >>>> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3624) M2 = [ ] >>>> >> > >>>> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3626) Compressed >>>> >> > matrix, >>>> >> > tot = 0, diff = 0 >>>> >> > >>>> >> > MKL ERROR: Parameter 13 was incorrect on entry to DGESVD. >>>> >> > KALDI_ASSERT: at LapackGesvd:kaldi-matrix.cc:401, failed: result >>>> >= 0 && >>>> >> > "Call to CLAPACK dgesvd_ called with wrong arguments" >>>> >> > Stack trace is: >>>> >> > kaldi::KaldiGetStackTrace() >>>> >> > kaldi::KaldiAssertFailure_(char const*, char const*, int, char >>>> const*) >>>> >> > kaldi::MatrixBase<double>::LapackGesvd(kaldi::VectorBase<double>*, >>>> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) >>>> >> > >>>> kaldi::MatrixBase<double>::DestructiveSvd(kaldi::VectorBase<double>*, >>>> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) >>>> >> > kaldi::MatrixBase<double>::Svd(kaldi::VectorBase<double>*, >>>> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) const >>>> >> > . >>>> >> > . >>>> >> > . >>>> >> > ./matrix-lib-test() [0x43055a] >>>> >> > ./matrix-lib-test() [0x42de8b] >>>> >> > ./matrix-lib-test(main+0x1d) [0x42dac7] >>>> >> > /lib64/libc.so.6(__libc_start_main+0xfd) [0x330901ecdd] >>>> >> > ./matrix-lib-test() [0x42ced9] >>>> >> > Aborted (core dumped) >>>> >> > >>>> >> > >>>> >> > >>>> >> > >>>> >> > >>>> >> > >>>> >> > >>>> >> > >>>> >> > >>>> >> > >>>> >> > >>>> >> > >>>> >> > >>>> ------------------------------------------------------------------------------ >>>> >> > See everything from the browser to the database with AppDynamics >>>> >> > Get end-to-end visibility with application monitoring from >>>> AppDynamics >>>> >> > Isolate bottlenecks and diagnose root cause in seconds. >>>> >> > Start your free trial of AppDynamics Pro today! >>>> >> > >>>> >> > >>>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk >>>> >> > _______________________________________________ >>>> >> > Kaldi-users mailing list >>>> >> > Kal...@li... >>>> >> > https://lists.sourceforge.net/lists/listinfo/kaldi-users >>>> >> > >>>> >> >>>> >> >>>> >> >>>> ------------------------------------------------------------------------------ >>>> >> See everything from the browser to the database with AppDynamics >>>> >> Get end-to-end visibility with application monitoring from >>>> AppDynamics >>>> >> Isolate bottlenecks and diagnose root cause in seconds. >>>> >> Start your free trial of AppDynamics Pro today! >>>> >> >>>> >> >>>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk >>>> >> _______________________________________________ >>>> >> Kaldi-users mailing list >>>> >> Kal...@li... >>>> >> https://lists.sourceforge.net/lists/listinfo/kaldi-users >>>> > >>>> > >>>> > >>>> > >>>> > >>>> ------------------------------------------------------------------------------ >>>> > See everything from the browser to the database with AppDynamics >>>> > Get end-to-end visibility with application monitoring from AppDynamics >>>> > Isolate bottlenecks and diagnose root cause in seconds. >>>> > Start your free trial of AppDynamics Pro today! >>>> > >>>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk >>>> > _______________________________________________ >>>> > Kaldi-users mailing list >>>> > Kal...@li... >>>> > https://lists.sourceforge.net/lists/listinfo/kaldi-users >>>> > >>>> >>>> >>>> ------------------------------------------------------------------------------ >>>> See everything from the browser to the database with AppDynamics >>>> Get end-to-end visibility with application monitoring from AppDynamics >>>> Isolate bottlenecks and diagnose root cause in seconds. >>>> Start your free trial of AppDynamics Pro today! >>>> >>>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk >>>> _______________________________________________ >>>> Kaldi-users mailing list >>>> Kal...@li... >>>> https://lists.sourceforge.net/lists/listinfo/kaldi-users >>>> >>> >>> >>> >>> ------------------------------------------------------------------------------ >>> See everything from the browser to the database with AppDynamics >>> Get end-to-end visibility with application monitoring from AppDynamics >>> Isolate bottlenecks and diagnose root cause in seconds. >>> Start your free trial of AppDynamics Pro today! >>> >>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk >>> _______________________________________________ >>> Kaldi-users mailing list >>> Kal...@li... >>> https://lists.sourceforge.net/lists/listinfo/kaldi-users >>> >>> >> >> >> >> >> ------------------------------------------------------------------------------ >> See everything from the browser to the database with AppDynamics >> Get end-to-end visibility with application monitoring from AppDynamics >> Isolate bottlenecks and diagnose root cause in seconds. >> Start your free trial of AppDynamics Pro today! >> >> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk >> _______________________________________________ >> Kaldi-users mailing list >> Kal...@li... >> https://lists.sourceforge.net/lists/listinfo/kaldi-users >> >> > > > ------------------------------------------------------------------------------ > See everything from the browser to the database with AppDynamics > Get end-to-end visibility with application monitoring from AppDynamics > Isolate bottlenecks and diagnose root cause in seconds. > Start your free trial of AppDynamics Pro today! > http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk > _______________________________________________ > Kaldi-users mailing list > Kal...@li... > https://lists.sourceforge.net/lists/listinfo/kaldi-users > > |
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-29 15:39:11
|
I just checked different versions of MKL and indeed, this was introduced in
the update 5. Anyone with the commercial MKL support cares to submit a
ticket to Intel?
y.
On Wed, Jul 24, 2013 at 12:42 PM, Mailing list used for User Communication
and Updates <kal...@li...> wrote:
> You are right.... I just downgraded to MKL 11.0update1 and passed the test.
>
>
>
> On Thu, Jul 25, 2013 at 12:28 AM, Mailing list used for User Communication
> and Updates <kal...@li...> wrote:
>
>> I saw some changes regarding improving performance of *GESVD in the MKL
>> 11.0 update5 changelog. I wonder if they messed something up? How about
>> trying slightly "older" version of the MKL? If you are on the subscription
>> of Intel Software Network, you can download older versions of the MKL at no
>> charge...
>>
>> We are using Intel 11.0 and the tests pass without any problem...
>>
>> yenda
>>
>>
>>
>> On Wed, Jul 24, 2013 at 12:14 PM, Mailing list used for User
>> Communication and Updates <kal...@li...> wrote:
>>
>>> I can't see any problems in the Kaldi code. Perhaps this is an older
>>> version of MKL? It could be a bug in MKL itself. MKL tests OK for
>>> me.
>>> Dan
>>>
>>>
>>> On Wed, Jul 24, 2013 at 11:55 AM, Mailing list used for User
>>> Communication and Updates <kal...@li...> wrote:
>>> > here's the dbg info copied from eclipse.
>>> > PS: I can pass the test with atlas provided by centos repo
>>> > atlas-sse3.x86_64 3.8.4-2.el6
>>> > @base
>>> > atlas-sse3-devel.x86_64 3.8.4-2.el6
>>> > @base
>>> >
>>> >
>>> >
>>> > stack:
>>> >
>>> > matrix-lib-test [C/C++ Application]
>>> > matrix-lib-test [11312] [cores: 1]
>>> > Thread [1] 11312 [core: 1] (Suspended : Signal : SIGABRT:Aborted)
>>> > raise() at 0x33090328a5
>>> > abort() at 0x3309034085
>>> > kaldi::KaldiAssertFailure_() at kaldi-error.cc:136 0x4cf401
>>> > kaldi::MatrixBase<double>::LapackGesvd() at kaldi-matrix.cc:401
>>> 0x48fdd3
>>> > kaldi::MatrixBase<double>::DestructiveSvd() at kaldi-matrix.cc:1,330
>>> > 0x48b902
>>> > kaldi::MatrixBase<double>::Svd() at kaldi-matrix.cc:1,352 0x48b9bb
>>> > kaldi::MatrixBase<double>::Svd() at kaldi-matrix.h:315 0x468e50
>>> > kaldi::MatrixBase<double>::Cond() at kaldi-matrix.cc:1,222 0x48bf47
>>> > kaldi::InitRand<double>() at matrix-lib-test.cc:74 0x42dd7e
>>> > kaldi::UnitTestCompressedMatrix<double>() at matrix-lib-test.cc:3,532
>>> > 0x43055a
>>> > kaldi::MatrixUnitTest<double>() at matrix-lib-test.cc:3,705 0x42de8b
>>> > main() at matrix-lib-test.cc:3,829 0x42dac7
>>> >
>>> >
>>> >
>>> > variable list after invoking the following @line393 kaldi-matrix.cc
>>> > clapack_Xgesvd(v_job, u_job,
>>> > &M, &N, data_, &LDA,
>>> > s->Data(),
>>> > V->Data(), &V_stride,
>>> > U->Data(), &U_stride,
>>> > p_work, &l_work,
>>> > &result);
>>> >
>>> >
>>> > __func__ char [12] 0x4d5418
>>> > M KaldiBlasInt 1
>>> > LDA KaldiBlasInt 2
>>> > U kaldi::MatrixBase<double> * 0x7ffffffface0
>>> > data_ double * 0x7413b0
>>> > *data_ double 0
>>> > num_cols_ kaldi::MatrixIndexT 1
>>> > num_rows_ kaldi::MatrixIndexT 10
>>> > stride_ kaldi::MatrixIndexT 2
>>> > l_work KaldiBlasInt 5
>>> > p_work double * 0x741460
>>> > *p_work double 1.0829823019173015e-312
>>> > temp void * 0x741460
>>> > N KaldiBlasInt 10
>>> > V kaldi::MatrixBase<double> * 0x7fffffffacc0
>>> > data_ double * 0x7406a0
>>> > *data_ double 0
>>> > num_cols_ kaldi::MatrixIndexT 1
>>> > num_rows_ kaldi::MatrixIndexT 1
>>> > stride_ kaldi::MatrixIndexT 2
>>> > result KaldiBlasInt -13
>>> > tmpU kaldi::Matrix<double> {...}
>>> > V_stride KaldiBlasInt 2
>>> > work_query double 5
>>> > u_job char * 0x4d4fea "N"
>>> > tmpV kaldi::Matrix<double> {...}
>>> > U_stride KaldiBlasInt 2
>>> > v_job char * 0x4d4fea "N"
>>> > this kaldi::MatrixBase<double> * const 0x7fffffffaf80
>>> > data_ double * 0x741300
>>> > *data_ double 0.78239572048187256
>>> > num_cols_ kaldi::MatrixIndexT 1
>>> > num_rows_ kaldi::MatrixIndexT 10
>>> > stride_ kaldi::MatrixIndexT 2
>>> > s kaldi::VectorBase<double> * 0x7fffffffb190
>>> > data_ double * 0x7404a0
>>> > *data_ double 0
>>> > dim_ kaldi::MatrixIndexT 1
>>> > U_in kaldi::MatrixBase<double> * 0x0
>>> > V_in kaldi::MatrixBase<double> * 0x0
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > On Wed, Jul 24, 2013 at 11:04 PM, Mailing list used for User
>>> Communication
>>> > and Updates <kal...@li...> wrote:
>>> >>
>>> >> Could you please run this in a debugger and show me the values of
>>> >> p_work, l_work and result, e.g.
>>> >>
>>> >> gdb matrix-lib
>>> >> (gdb) r
>>> >> [wait till it crashes]
>>> >> (gdb) up
>>> >> (gdb) up # not sure how many times
>>> >> (gdb) up
>>> >> (gdb) p l_work
>>> >> (gdb) p p_work
>>> >> (gdb) p result
>>> >>
>>> >> Dan
>>> >>
>>> >>
>>> >>
>>> >> On Wed, Jul 24, 2013 at 10:34 AM, Mailing list used for User
>>> >> Communication and Updates <kal...@li...> wrote:
>>> >> > Hi,
>>> >> >
>>> >> > I tried latest trunk version with MKL. I have no problem when
>>> running
>>> >> > `make
>>> >> > all`, but get a FAIL when testing. Can anyone help? Thanks.
>>> >> >
>>> >> >
>>> >> > svn revision 2720 trunk
>>> >> >
>>> >> >
>>> >> > configuration line:
>>> >> > $ ./configure --threaded-math=yes --mathlib=MKL --use-cuda=yes
>>> >> > --mkl-root=$MKLROOT --omp-libdir=/opt/intel/lib/intel64
>>> >> >
>>> >> >
>>> >> > MKL version 11.0 update 5 (latest)
>>> >> >
>>> >> >
>>> >> > Linux version CentOS 6.4
>>> >> > $ uname -a
>>> >> > Linux 2.6.32-358.6.2.el6.x86_64 #1 SMP Thu May 16 20:59:36 UTC 2013
>>> >> > x86_64
>>> >> > x86_64 x86_64 GNU/Linux
>>> >> >
>>> >> >
>>> >> > $ gcc -v
>>> >> > Using built-in specs.
>>> >> > Target: x86_64-redhat-linux
>>> >> > Configured with: ../configure --prefix=/usr --mandir=/usr/share/man
>>> >> > --infodir=/usr/share/info
>>> >> > --with-bugurl=http://bugzilla.redhat.com/bugzilla
>>> >> > --enable-bootstrap --enable-shared --enable-threads=posix
>>> >> > --enable-checking=release --with-system-zlib --enable-__cxa_atexit
>>> >> > --disable-libunwind-exceptions --enable-gnu-unique-object
>>> >> > --enable-languages=c,c++,objc,obj-c++,java,fortran,ada
>>> >> > --enable-java-awt=gtk
>>> >> > --disable-dssi
>>> --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre
>>> >> > --enable-libgcj-multifile --enable-java-maintainer-mode
>>> >> > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar
>>> >> > --disable-libjava-multilib
>>> >> > --with-ppl --with-cloog --with-tune=generic --with-arch_32=i686
>>> >> > --build=x86_64-redhat-linux
>>> >> > Thread model: posix
>>> >> > gcc version 4.4.7 20120313 (Red Hat 4.4.7-3) (GCC)
>>> >> >
>>> >> >
>>> >> > ~/kaldi/trunk/src/matrix
>>> >> > $ make test
>>> >> > Running matrix-lib-test .../bin/sh: line 1: 5561 Aborted
>>> >> > (core dumped) ./$x > /dev/null 2>&1
>>> >> > ... FAIL
>>> >> > Running kaldi-gpsr-test ...... SUCCESS
>>> >> > make: *** [test] Error 1
>>> >> >
>>> >> >
>>> >> > $ ./matrix-lib-test
>>> >> > ...
>>> >> > ...
>>> >> > VLOG[2] (UnitTestLbfgs():matrix-lib-test.cc:2734) L-BFGS finished
>>> after
>>> >> > 59
>>> >> > function evaluations.
>>> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3623) M = [ ]
>>> >> >
>>> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3624) M2 = [ ]
>>> >> >
>>> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3626) Compressed
>>> >> > matrix,
>>> >> > tot = 0, diff = 0
>>> >> >
>>> >> > MKL ERROR: Parameter 13 was incorrect on entry to DGESVD.
>>> >> > KALDI_ASSERT: at LapackGesvd:kaldi-matrix.cc:401, failed: result >=
>>> 0 &&
>>> >> > "Call to CLAPACK dgesvd_ called with wrong arguments"
>>> >> > Stack trace is:
>>> >> > kaldi::KaldiGetStackTrace()
>>> >> > kaldi::KaldiAssertFailure_(char const*, char const*, int, char
>>> const*)
>>> >> > kaldi::MatrixBase<double>::LapackGesvd(kaldi::VectorBase<double>*,
>>> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*)
>>> >> >
>>> kaldi::MatrixBase<double>::DestructiveSvd(kaldi::VectorBase<double>*,
>>> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*)
>>> >> > kaldi::MatrixBase<double>::Svd(kaldi::VectorBase<double>*,
>>> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) const
>>> >> > .
>>> >> > .
>>> >> > .
>>> >> > ./matrix-lib-test() [0x43055a]
>>> >> > ./matrix-lib-test() [0x42de8b]
>>> >> > ./matrix-lib-test(main+0x1d) [0x42dac7]
>>> >> > /lib64/libc.so.6(__libc_start_main+0xfd) [0x330901ecdd]
>>> >> > ./matrix-lib-test() [0x42ced9]
>>> >> > Aborted (core dumped)
>>> >> >
>>> >> >
>>> >> >
>>> >> >
>>> >> >
>>> >> >
>>> >> >
>>> >> >
>>> >> >
>>> >> >
>>> >> >
>>> >> >
>>> >> >
>>> ------------------------------------------------------------------------------
>>> >> > See everything from the browser to the database with AppDynamics
>>> >> > Get end-to-end visibility with application monitoring from
>>> AppDynamics
>>> >> > Isolate bottlenecks and diagnose root cause in seconds.
>>> >> > Start your free trial of AppDynamics Pro today!
>>> >> >
>>> >> >
>>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
>>> >> > _______________________________________________
>>> >> > Kaldi-users mailing list
>>> >> > Kal...@li...
>>> >> > https://lists.sourceforge.net/lists/listinfo/kaldi-users
>>> >> >
>>> >>
>>> >>
>>> >>
>>> ------------------------------------------------------------------------------
>>> >> See everything from the browser to the database with AppDynamics
>>> >> Get end-to-end visibility with application monitoring from AppDynamics
>>> >> Isolate bottlenecks and diagnose root cause in seconds.
>>> >> Start your free trial of AppDynamics Pro today!
>>> >>
>>> >>
>>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
>>> >> _______________________________________________
>>> >> Kaldi-users mailing list
>>> >> Kal...@li...
>>> >> https://lists.sourceforge.net/lists/listinfo/kaldi-users
>>> >
>>> >
>>> >
>>> >
>>> >
>>> ------------------------------------------------------------------------------
>>> > See everything from the browser to the database with AppDynamics
>>> > Get end-to-end visibility with application monitoring from AppDynamics
>>> > Isolate bottlenecks and diagnose root cause in seconds.
>>> > Start your free trial of AppDynamics Pro today!
>>> >
>>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
>>> > _______________________________________________
>>> > Kaldi-users mailing list
>>> > Kal...@li...
>>> > https://lists.sourceforge.net/lists/listinfo/kaldi-users
>>> >
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> See everything from the browser to the database with AppDynamics
>>> Get end-to-end visibility with application monitoring from AppDynamics
>>> Isolate bottlenecks and diagnose root cause in seconds.
>>> Start your free trial of AppDynamics Pro today!
>>>
>>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
>>> _______________________________________________
>>> Kaldi-users mailing list
>>> Kal...@li...
>>> https://lists.sourceforge.net/lists/listinfo/kaldi-users
>>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> See everything from the browser to the database with AppDynamics
>> Get end-to-end visibility with application monitoring from AppDynamics
>> Isolate bottlenecks and diagnose root cause in seconds.
>> Start your free trial of AppDynamics Pro today!
>>
>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
>> _______________________________________________
>> Kaldi-users mailing list
>> Kal...@li...
>> https://lists.sourceforge.net/lists/listinfo/kaldi-users
>>
>>
>
>
>
>
> ------------------------------------------------------------------------------
> See everything from the browser to the database with AppDynamics
> Get end-to-end visibility with application monitoring from AppDynamics
> Isolate bottlenecks and diagnose root cause in seconds.
> Start your free trial of AppDynamics Pro today!
> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
> _______________________________________________
> Kaldi-users mailing list
> Kal...@li...
> https://lists.sourceforge.net/lists/listinfo/kaldi-users
>
>
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-25 16:10:15
|
Modifying it to use the standard s5 util scripts worked great. It is fully decoded with timings:
lattice-1best "ark:gunzip -c exp/tri1/decode_cmu_test/lat.1.gz|" ark:- | lattice-align-words exp/tri1/graph/phones/word_boundary.int exp/tri1/final.mdl ark:- ark:- | nbest-to-ctm ark:- - | ./utils/int2sym.pl -f 5 exp/tri1/graph/words.txt
I'm still using the Kaldi LM tools, but as I have more time, I will switch them to use the SRILM.
Your help was much appreciated.
Thanks,
Nathan
On Jul 19, 2013, at 3:28 PM, Daniel Povey wrote:
> You should be able to modify the script, yes. I'm surprised that
> variable doesn't work-- try removing everything from the directory
> where it's working. There's a variable set to 10000 that you should
> set to a smaller value. But the Kaldi LM tools aren't great-- I
> recommend SRILM.
> Dan
>
>
> On Fri, Jul 19, 2013 at 2:54 PM, Nathan Dunn <nd...@ca...> wrote:
>>
>> Sorry, I came to the same conclusion about the word_map afterwords.
>>
>> I have only 5K utterances, so that might be the problem.
>>
>> 1 - Can I use less by modifying the script? There is a holdout_sent, but modifying that variable has little effect.
>> 2 - Is there a good model to look at this (wsj/s5 or use swbd/s6, swbd/s5/swbd1_train_lms_edin,babel/s5/local/train_lms_srilm.sh)?
>>
>> Thanks,
>>
>> Nathan
>>
>>
>>
>> On Jul 19, 2013, at 11:26 AM, Daniel Povey wrote:
>>
>>> The word_map is correct, it has to do with a form of compression.
>>> How many utterances are in your training set? By default it uses the
>>> 1st 10k as validation set; if your #utts is less than this, then the
>>> training set will be empty. You should investigate SRILM too, you'll
>>> probably find it easier to use.
>>> Dan
>>>
>>>
>>> On Fri, Jul 19, 2013 at 1:46 PM, Nathan Dunn <nd...@ca...> wrote:
>>>>
>>>> I am adapting an earlier script to use mirror what switchboard/s5 is doing.
>>>>
>>>>
>>>>
>>>> train_lm.sh --arpa --lmtype 3gram-mincount $dir || exit 1;
>>>>
>>>> on this line:
>>>> sort -m <(gunzip -c $subdir/heldout_ngrams.gz) - | compute_perplexity
>>>>
>>>> I get:
>>>> Not installing the kaldi_lm toolkit since it is already there.
>>>> Getting raw N-gram counts
>>>> discount_ngrams: for n-gram order 1, D=0.000000, tau=0.000000 phi=1.000000
>>>> discount_ngrams: for n-gram order 2, D=0.000000, tau=0.000000 phi=1.000000
>>>> discount_ngrams: for n-gram order 3, D=1.000000, tau=0.000000 phi=1.000000
>>>> Iteration 1/6 of optimizing discounting parameters
>>>> discount_ngrams: for n-gram order 1, D=0.600000, tau=0.675000 phi=2.000000
>>>> discount_ngrams: for n-gram order 2, D=0.800000, tau=0.675000 phi=2.000000
>>>> discount_ngrams: for n-gram order 3, D=0.000000, tau=0.825000 phi=2.000000
>>>> discount_ngrams: for n-gram order 1, D=0.600000, tau=0.900000 phi=2.000000
>>>> discount_ngrams: for n-gram order 2, D=0.800000, tau=0.900000 phi=2.000000
>>>> discount_ngrams: for n-gram order 3, D=0.000000, tau=1.100000 phi=2.000000
>>>> discount_ngrams: for n-gram order 1, D=0.600000, tau=1.215000 phi=2.000000
>>>> discount_ngrams: for n-gram order 2, D=0.800000, tau=1.215000 phi=2.000000
>>>> discount_ngrams: for n-gram order 3, D=0.000000, tau=1.485000 phi=2.000000
>>>> interpolate_ngrams: 116456 words in wordslist
>>>> compute_perplexity: for history-state "", no total-count % is seen
>>>> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>>>>
>>>> real 0m0.027s
>>>> user 0m0.016s
>>>> sys 0m0.004s
>>>> interpolate_ngrams: 116456 words in wordslist
>>>> interpolate_ngrams: 116456 words in wordslist
>>>> compute_perplexity: for history-state "", no total-count % is seen
>>>> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>>>>
>>>> real 0m0.031s
>>>> user 0m0.020s
>>>> sys 0m0.000s
>>>> compute_perplexity: for history-state "", no total-count % is seen
>>>> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>>>>
>>>> real 0m0.029s
>>>> user 0m0.020s
>>>> sys 0m0.000s
>>>> Usage: optimize_alpha.pl alpha1 perplexity@alpha1 alpha2 perplexity@alpha2 alpha3 perplexity@alph3 at /home/ndunn/svn/kaldi-stable/egs/childspeech/s5/../../../tools/kaldi_lm/optimize_alpha.pl line 23.
>>>> Preparing train and test data
>>>> No such file data/local/lm/3gram-mincount/lm_unpruned.gz
>>>> steps/make_mfcc.sh --nj 20 --cmd scripts/run.pl data/train exp/make_mfcc/train /home
>>>>
>>>> dies . . ..
>>>>
>>>> THEORY - get_word_map.pl script is generating a bad word_map. In vim, <80> <81> and <82> show-up as non-ascii characters as below:
>>>>
>>>> Using the switchboard script this line uses get "get_word_map.pl" in kaldi_lm tools:
>>>> cat $dir/unigram.counts | awk '{print $2}' | get_word_map.pl "<s>" "</s>" "<UNK>"
>>>>
>>>> Bu this generates this, where the second-column is wonky.
>>>>
>>>> S(/S/) s
>>>> AH(/AH/) v
>>>> IX(/IX/) w
>>>> THEIR x
>>>> /W y
>>>> SOME z
>>>> AA(/AA/) <80>
>>>> /K <81>
>>>> WATER <82>
>>>>
>>>> Similar results on Linux and the Mac.
>>>>
>>>> Any other ideas?
>>>>
>>>> Thanks,
>>>>
>>>> Nathan
>>>>
>>>>
>>>>
>>
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-25 15:33:10
|
> Scratch that! I was just going over the icpc discussion thread you > pointed to. From the "non-integral operation not allowed in nontype > template argument" error message, I am guessing that icpc is not > treating '&& "string"' as a constant integral expression, which seems > to be wrong... unless I am missing something. it's hard to say... the string is constant and can be determined at compile time. but the position/pointer of the const string seems not? anyway, my post on stackoverflow may give some suggestion on compile time assert with custom messages for your reference. http://stackoverflow.com/questions/17860727/template-based-compile-time-assert-with-custom-messages-can-only-be-compiled-in |
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-25 15:21:38
|
On Thu, Jul 25, 2013 at 3:55 PM, Arnab Ghoshal <ar...@gm...> wrote:
> Well, the implicit casting of const char* to true is
> probably not guaranteed to work with every compiler.
Scratch that! I was just going over the icpc discussion thread you
pointed to. From the "non-integral operation not allowed in nontype
template argument" error message, I am guessing that icpc is not
treating '&& "string"' as a constant integral expression, which seems
to be wrong... unless I am missing something.
> Could you check
> if all the tests pass? Such && "error message" shows up in many places
> with KALDI_ASSERT. -Arnab
>
> On Thu, Jul 25, 2013 at 2:55 PM, Mailing list used for User
> Communication and Updates <kal...@li...> wrote:
>> Hi Vassil,
>>
>> Just found that
>> changing push-lattice.cc(line131) from
>>
>> KALDI_COMPILE_TIME_ASSERT(static_cast<StateId>(-1) <
>> static_cast<StateId>(0) &&
>> "This code only works if StateId is signed;
>> otherwise, fix.");
>>
>> to
>>
>> KALDI_COMPILE_TIME_ASSERT(static_cast<StateId>(-1) <
>> static_cast<StateId>(0));
>>
>> can solve problem.
>>
>>
>> KALDI_COMPILE_TIME_ASSERT() is acceptable to icpc if const char* (the error
>> msg) is not involved in the its argument.
>>
>> It seems KALDI_COMPILE_TIME_ASSERT() has been used many times in kaldi, and
>> only this one has a error msg like this {&& "blabla"}
>>
>>
>>
>> kangshiyin
>>
>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> See everything from the browser to the database with AppDynamics
>> Get end-to-end visibility with application monitoring from AppDynamics
>> Isolate bottlenecks and diagnose root cause in seconds.
>> Start your free trial of AppDynamics Pro today!
>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
>> _______________________________________________
>> Kaldi-users mailing list
>> Kal...@li...
>> https://lists.sourceforge.net/lists/listinfo/kaldi-users
>>
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-25 14:55:52
|
It's fixed now. Well, the implicit casting of const char* to true is
probably not guaranteed to work with every compiler. Could you check
if all the tests pass? Such && "error message" shows up in many places
with KALDI_ASSERT. -Arnab
On Thu, Jul 25, 2013 at 2:55 PM, Mailing list used for User
Communication and Updates <kal...@li...> wrote:
> Hi Vassil,
>
> Just found that
> changing push-lattice.cc(line131) from
>
> KALDI_COMPILE_TIME_ASSERT(static_cast<StateId>(-1) <
> static_cast<StateId>(0) &&
> "This code only works if StateId is signed;
> otherwise, fix.");
>
> to
>
> KALDI_COMPILE_TIME_ASSERT(static_cast<StateId>(-1) <
> static_cast<StateId>(0));
>
> can solve problem.
>
>
> KALDI_COMPILE_TIME_ASSERT() is acceptable to icpc if const char* (the error
> msg) is not involved in the its argument.
>
> It seems KALDI_COMPILE_TIME_ASSERT() has been used many times in kaldi, and
> only this one has a error msg like this {&& "blabla"}
>
>
>
> kangshiyin
>
>
>
>
>
> ------------------------------------------------------------------------------
> See everything from the browser to the database with AppDynamics
> Get end-to-end visibility with application monitoring from AppDynamics
> Isolate bottlenecks and diagnose root cause in seconds.
> Start your free trial of AppDynamics Pro today!
> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
> _______________________________________________
> Kaldi-users mailing list
> Kal...@li...
> https://lists.sourceforge.net/lists/listinfo/kaldi-users
>
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-25 13:55:23
|
Hi Vassil,
Just found that
changing push-lattice.cc(line131) from
KALDI_COMPILE_TIME_ASSERT(static_cast<StateId>(-1) <
static_cast<StateId>(0) &&
"This code only works if StateId is signed;
otherwise, fix.");
to
KALDI_COMPILE_TIME_ASSERT(static_cast<StateId>(-1) <
static_cast<StateId>(0));
can solve problem.
KALDI_COMPILE_TIME_ASSERT() is acceptable to icpc if const char* (the error
msg) is not involved in the its argument.
It seems KALDI_COMPILE_TIME_ASSERT() has been used many times in kaldi, and
only this one has a error msg like this {&& "blabla"}
kangshiyin
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-25 12:46:55
|
Hi, I don't know much about the compile time assertions in C++, but probably we could check if icpc(presumably it defines the relevant macros) is used and if so we could use another implementation of KALDI_COMPILE_TIME_ASSERT, which doesn't rely on templates. Maybe something like C_ASSERT macro from Windows(http://msdn.microsoft.com/en-us/library/ms679289.aspx)? Vassil On Thu, Jul 25, 2013 at 1:35 PM, Mailing list used for User Communication and Updates <kal...@li...> wrote: > Hi, kaldi developers > > I tried to compile trunk with icc/icpc. > But I found only one line incompatible to icpc. > Maybe you guys want to fix it. > > > > > Here's the kaldi code failed in icpc compiling. > > icpc -m64 -msse -msse2 -Wall -I.. -DKALDI_DOUBLEPRECISION=0 > -DHAVE_POSIX_MEMALIGN -Wno-sign-compare -Winit-self -DHAVE_EXECINFO_H=1 > -rdynamic -DHAVE_CXXABI_H -DHAVE_MKL > -I/opt/intel/composer_xe_2013.1.117/mkl/include > -I/data/sykang/work/asr/kaldi/trunk/tools/openfst/include -Wno-sign-compare > -O3 -DNDEBUG -DHAVE_CUDA -I/usr/local/cuda/include -c -o push-lattice.o > push-lattice.cc > > push-lattice.cc(131): error: non-integral operation not allowed in nontype > template argument KALDI_COMPILE_TIME_ASSERT(static_cast<StateId>(-1) < > static_cast<StateId>(0) && > ^ > > push-lattice.cc(131): error: class > "KaldiCompileTimeAssert<<error-constant>>" has no member "Check" > KALDI_COMPILE_TIME_ASSERT(static_cast<StateId>(-1) < > static_cast<StateId>(0) && > ^ > > compilation aborted for push-lattice.cc (code 2) > > > > > It seems the following line can only be compiled by g++. > KALDI_COMPILE_TIME_ASSERT(true && "string"); > > I also posted a demo code on intel's dev forum. > http://software.intel.com/en-us/forums/topic/402465 > > > > > kangshiyin > > > ------------------------------------------------------------------------------ > See everything from the browser to the database with AppDynamics > Get end-to-end visibility with application monitoring from AppDynamics > Isolate bottlenecks and diagnose root cause in seconds. > Start your free trial of AppDynamics Pro today! > http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk > _______________________________________________ > Kaldi-users mailing list > Kal...@li... > https://lists.sourceforge.net/lists/listinfo/kaldi-users > |
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-25 10:35:29
|
Hi, kaldi developers
I tried to compile trunk with icc/icpc.
But I found only one line incompatible to icpc.
Maybe you guys want to fix it.
Here's the kaldi code failed in icpc compiling.
icpc -m64 -msse -msse2 -Wall -I.. -DKALDI_DOUBLEPRECISION=0
-DHAVE_POSIX_MEMALIGN -Wno-sign-compare -Winit-self -DHAVE_EXECINFO_H=1
-rdynamic -DHAVE_CXXABI_H -DHAVE_MKL
-I/opt/intel/composer_xe_2013.1.117/mkl/include
-I/data/sykang/work/asr/kaldi/trunk/tools/openfst/include -Wno-sign-compare
-O3 -DNDEBUG -DHAVE_CUDA -I/usr/local/cuda/include -c -o push-lattice.o
push-lattice.cc
push-lattice.cc(131): error: non-integral operation not allowed in nontype
template argument KALDI_COMPILE_TIME_ASSERT(static_cast<StateId>(-1) <
static_cast<StateId>(0) &&
^
push-lattice.cc(131): error: class
"KaldiCompileTimeAssert<<error-constant>>" has no member "Check"
KALDI_COMPILE_TIME_ASSERT(static_cast<StateId>(-1) <
static_cast<StateId>(0) &&
^
compilation aborted for push-lattice.cc (code 2)
It seems the following line can only be compiled by g++.
KALDI_COMPILE_TIME_ASSERT(true && "string");
I also posted a demo code on intel's dev forum.
http://software.intel.com/en-us/forums/topic/402465
kangshiyin
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-24 16:42:16
|
You are right.... I just downgraded to MKL 11.0update1 and passed the test.
On Thu, Jul 25, 2013 at 12:28 AM, Mailing list used for User Communication
and Updates <kal...@li...> wrote:
> I saw some changes regarding improving performance of *GESVD in the MKL
> 11.0 update5 changelog. I wonder if they messed something up? How about
> trying slightly "older" version of the MKL? If you are on the subscription
> of Intel Software Network, you can download older versions of the MKL at no
> charge...
>
> We are using Intel 11.0 and the tests pass without any problem...
>
> yenda
>
>
>
> On Wed, Jul 24, 2013 at 12:14 PM, Mailing list used for User Communication
> and Updates <kal...@li...> wrote:
>
>> I can't see any problems in the Kaldi code. Perhaps this is an older
>> version of MKL? It could be a bug in MKL itself. MKL tests OK for
>> me.
>> Dan
>>
>>
>> On Wed, Jul 24, 2013 at 11:55 AM, Mailing list used for User
>> Communication and Updates <kal...@li...> wrote:
>> > here's the dbg info copied from eclipse.
>> > PS: I can pass the test with atlas provided by centos repo
>> > atlas-sse3.x86_64 3.8.4-2.el6
>> > @base
>> > atlas-sse3-devel.x86_64 3.8.4-2.el6
>> > @base
>> >
>> >
>> >
>> > stack:
>> >
>> > matrix-lib-test [C/C++ Application]
>> > matrix-lib-test [11312] [cores: 1]
>> > Thread [1] 11312 [core: 1] (Suspended : Signal : SIGABRT:Aborted)
>> > raise() at 0x33090328a5
>> > abort() at 0x3309034085
>> > kaldi::KaldiAssertFailure_() at kaldi-error.cc:136 0x4cf401
>> > kaldi::MatrixBase<double>::LapackGesvd() at kaldi-matrix.cc:401 0x48fdd3
>> > kaldi::MatrixBase<double>::DestructiveSvd() at kaldi-matrix.cc:1,330
>> > 0x48b902
>> > kaldi::MatrixBase<double>::Svd() at kaldi-matrix.cc:1,352 0x48b9bb
>> > kaldi::MatrixBase<double>::Svd() at kaldi-matrix.h:315 0x468e50
>> > kaldi::MatrixBase<double>::Cond() at kaldi-matrix.cc:1,222 0x48bf47
>> > kaldi::InitRand<double>() at matrix-lib-test.cc:74 0x42dd7e
>> > kaldi::UnitTestCompressedMatrix<double>() at matrix-lib-test.cc:3,532
>> > 0x43055a
>> > kaldi::MatrixUnitTest<double>() at matrix-lib-test.cc:3,705 0x42de8b
>> > main() at matrix-lib-test.cc:3,829 0x42dac7
>> >
>> >
>> >
>> > variable list after invoking the following @line393 kaldi-matrix.cc
>> > clapack_Xgesvd(v_job, u_job,
>> > &M, &N, data_, &LDA,
>> > s->Data(),
>> > V->Data(), &V_stride,
>> > U->Data(), &U_stride,
>> > p_work, &l_work,
>> > &result);
>> >
>> >
>> > __func__ char [12] 0x4d5418
>> > M KaldiBlasInt 1
>> > LDA KaldiBlasInt 2
>> > U kaldi::MatrixBase<double> * 0x7ffffffface0
>> > data_ double * 0x7413b0
>> > *data_ double 0
>> > num_cols_ kaldi::MatrixIndexT 1
>> > num_rows_ kaldi::MatrixIndexT 10
>> > stride_ kaldi::MatrixIndexT 2
>> > l_work KaldiBlasInt 5
>> > p_work double * 0x741460
>> > *p_work double 1.0829823019173015e-312
>> > temp void * 0x741460
>> > N KaldiBlasInt 10
>> > V kaldi::MatrixBase<double> * 0x7fffffffacc0
>> > data_ double * 0x7406a0
>> > *data_ double 0
>> > num_cols_ kaldi::MatrixIndexT 1
>> > num_rows_ kaldi::MatrixIndexT 1
>> > stride_ kaldi::MatrixIndexT 2
>> > result KaldiBlasInt -13
>> > tmpU kaldi::Matrix<double> {...}
>> > V_stride KaldiBlasInt 2
>> > work_query double 5
>> > u_job char * 0x4d4fea "N"
>> > tmpV kaldi::Matrix<double> {...}
>> > U_stride KaldiBlasInt 2
>> > v_job char * 0x4d4fea "N"
>> > this kaldi::MatrixBase<double> * const 0x7fffffffaf80
>> > data_ double * 0x741300
>> > *data_ double 0.78239572048187256
>> > num_cols_ kaldi::MatrixIndexT 1
>> > num_rows_ kaldi::MatrixIndexT 10
>> > stride_ kaldi::MatrixIndexT 2
>> > s kaldi::VectorBase<double> * 0x7fffffffb190
>> > data_ double * 0x7404a0
>> > *data_ double 0
>> > dim_ kaldi::MatrixIndexT 1
>> > U_in kaldi::MatrixBase<double> * 0x0
>> > V_in kaldi::MatrixBase<double> * 0x0
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > On Wed, Jul 24, 2013 at 11:04 PM, Mailing list used for User
>> Communication
>> > and Updates <kal...@li...> wrote:
>> >>
>> >> Could you please run this in a debugger and show me the values of
>> >> p_work, l_work and result, e.g.
>> >>
>> >> gdb matrix-lib
>> >> (gdb) r
>> >> [wait till it crashes]
>> >> (gdb) up
>> >> (gdb) up # not sure how many times
>> >> (gdb) up
>> >> (gdb) p l_work
>> >> (gdb) p p_work
>> >> (gdb) p result
>> >>
>> >> Dan
>> >>
>> >>
>> >>
>> >> On Wed, Jul 24, 2013 at 10:34 AM, Mailing list used for User
>> >> Communication and Updates <kal...@li...> wrote:
>> >> > Hi,
>> >> >
>> >> > I tried latest trunk version with MKL. I have no problem when running
>> >> > `make
>> >> > all`, but get a FAIL when testing. Can anyone help? Thanks.
>> >> >
>> >> >
>> >> > svn revision 2720 trunk
>> >> >
>> >> >
>> >> > configuration line:
>> >> > $ ./configure --threaded-math=yes --mathlib=MKL --use-cuda=yes
>> >> > --mkl-root=$MKLROOT --omp-libdir=/opt/intel/lib/intel64
>> >> >
>> >> >
>> >> > MKL version 11.0 update 5 (latest)
>> >> >
>> >> >
>> >> > Linux version CentOS 6.4
>> >> > $ uname -a
>> >> > Linux 2.6.32-358.6.2.el6.x86_64 #1 SMP Thu May 16 20:59:36 UTC 2013
>> >> > x86_64
>> >> > x86_64 x86_64 GNU/Linux
>> >> >
>> >> >
>> >> > $ gcc -v
>> >> > Using built-in specs.
>> >> > Target: x86_64-redhat-linux
>> >> > Configured with: ../configure --prefix=/usr --mandir=/usr/share/man
>> >> > --infodir=/usr/share/info
>> >> > --with-bugurl=http://bugzilla.redhat.com/bugzilla
>> >> > --enable-bootstrap --enable-shared --enable-threads=posix
>> >> > --enable-checking=release --with-system-zlib --enable-__cxa_atexit
>> >> > --disable-libunwind-exceptions --enable-gnu-unique-object
>> >> > --enable-languages=c,c++,objc,obj-c++,java,fortran,ada
>> >> > --enable-java-awt=gtk
>> >> > --disable-dssi
>> --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre
>> >> > --enable-libgcj-multifile --enable-java-maintainer-mode
>> >> > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar
>> >> > --disable-libjava-multilib
>> >> > --with-ppl --with-cloog --with-tune=generic --with-arch_32=i686
>> >> > --build=x86_64-redhat-linux
>> >> > Thread model: posix
>> >> > gcc version 4.4.7 20120313 (Red Hat 4.4.7-3) (GCC)
>> >> >
>> >> >
>> >> > ~/kaldi/trunk/src/matrix
>> >> > $ make test
>> >> > Running matrix-lib-test .../bin/sh: line 1: 5561 Aborted
>> >> > (core dumped) ./$x > /dev/null 2>&1
>> >> > ... FAIL
>> >> > Running kaldi-gpsr-test ...... SUCCESS
>> >> > make: *** [test] Error 1
>> >> >
>> >> >
>> >> > $ ./matrix-lib-test
>> >> > ...
>> >> > ...
>> >> > VLOG[2] (UnitTestLbfgs():matrix-lib-test.cc:2734) L-BFGS finished
>> after
>> >> > 59
>> >> > function evaluations.
>> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3623) M = [ ]
>> >> >
>> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3624) M2 = [ ]
>> >> >
>> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3626) Compressed
>> >> > matrix,
>> >> > tot = 0, diff = 0
>> >> >
>> >> > MKL ERROR: Parameter 13 was incorrect on entry to DGESVD.
>> >> > KALDI_ASSERT: at LapackGesvd:kaldi-matrix.cc:401, failed: result >=
>> 0 &&
>> >> > "Call to CLAPACK dgesvd_ called with wrong arguments"
>> >> > Stack trace is:
>> >> > kaldi::KaldiGetStackTrace()
>> >> > kaldi::KaldiAssertFailure_(char const*, char const*, int, char
>> const*)
>> >> > kaldi::MatrixBase<double>::LapackGesvd(kaldi::VectorBase<double>*,
>> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*)
>> >> > kaldi::MatrixBase<double>::DestructiveSvd(kaldi::VectorBase<double>*,
>> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*)
>> >> > kaldi::MatrixBase<double>::Svd(kaldi::VectorBase<double>*,
>> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) const
>> >> > .
>> >> > .
>> >> > .
>> >> > ./matrix-lib-test() [0x43055a]
>> >> > ./matrix-lib-test() [0x42de8b]
>> >> > ./matrix-lib-test(main+0x1d) [0x42dac7]
>> >> > /lib64/libc.so.6(__libc_start_main+0xfd) [0x330901ecdd]
>> >> > ./matrix-lib-test() [0x42ced9]
>> >> > Aborted (core dumped)
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> ------------------------------------------------------------------------------
>> >> > See everything from the browser to the database with AppDynamics
>> >> > Get end-to-end visibility with application monitoring from
>> AppDynamics
>> >> > Isolate bottlenecks and diagnose root cause in seconds.
>> >> > Start your free trial of AppDynamics Pro today!
>> >> >
>> >> >
>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
>> >> > _______________________________________________
>> >> > Kaldi-users mailing list
>> >> > Kal...@li...
>> >> > https://lists.sourceforge.net/lists/listinfo/kaldi-users
>> >> >
>> >>
>> >>
>> >>
>> ------------------------------------------------------------------------------
>> >> See everything from the browser to the database with AppDynamics
>> >> Get end-to-end visibility with application monitoring from AppDynamics
>> >> Isolate bottlenecks and diagnose root cause in seconds.
>> >> Start your free trial of AppDynamics Pro today!
>> >>
>> >>
>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
>> >> _______________________________________________
>> >> Kaldi-users mailing list
>> >> Kal...@li...
>> >> https://lists.sourceforge.net/lists/listinfo/kaldi-users
>> >
>> >
>> >
>> >
>> >
>> ------------------------------------------------------------------------------
>> > See everything from the browser to the database with AppDynamics
>> > Get end-to-end visibility with application monitoring from AppDynamics
>> > Isolate bottlenecks and diagnose root cause in seconds.
>> > Start your free trial of AppDynamics Pro today!
>> >
>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
>> > _______________________________________________
>> > Kaldi-users mailing list
>> > Kal...@li...
>> > https://lists.sourceforge.net/lists/listinfo/kaldi-users
>> >
>>
>>
>> ------------------------------------------------------------------------------
>> See everything from the browser to the database with AppDynamics
>> Get end-to-end visibility with application monitoring from AppDynamics
>> Isolate bottlenecks and diagnose root cause in seconds.
>> Start your free trial of AppDynamics Pro today!
>>
>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
>> _______________________________________________
>> Kaldi-users mailing list
>> Kal...@li...
>> https://lists.sourceforge.net/lists/listinfo/kaldi-users
>>
>
>
>
> ------------------------------------------------------------------------------
> See everything from the browser to the database with AppDynamics
> Get end-to-end visibility with application monitoring from AppDynamics
> Isolate bottlenecks and diagnose root cause in seconds.
> Start your free trial of AppDynamics Pro today!
> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
> _______________________________________________
> Kaldi-users mailing list
> Kal...@li...
> https://lists.sourceforge.net/lists/listinfo/kaldi-users
>
>
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-24 16:29:00
|
I saw some changes regarding improving performance of *GESVD in the MKL
11.0 update5 changelog. I wonder if they messed something up? How about
trying slightly "older" version of the MKL? If you are on the subscription
of Intel Software Network, you can download older versions of the MKL at no
charge...
We are using Intel 11.0 and the tests pass without any problem...
yenda
On Wed, Jul 24, 2013 at 12:14 PM, Mailing list used for User Communication
and Updates <kal...@li...> wrote:
> I can't see any problems in the Kaldi code. Perhaps this is an older
> version of MKL? It could be a bug in MKL itself. MKL tests OK for
> me.
> Dan
>
>
> On Wed, Jul 24, 2013 at 11:55 AM, Mailing list used for User
> Communication and Updates <kal...@li...> wrote:
> > here's the dbg info copied from eclipse.
> > PS: I can pass the test with atlas provided by centos repo
> > atlas-sse3.x86_64 3.8.4-2.el6
> > @base
> > atlas-sse3-devel.x86_64 3.8.4-2.el6
> > @base
> >
> >
> >
> > stack:
> >
> > matrix-lib-test [C/C++ Application]
> > matrix-lib-test [11312] [cores: 1]
> > Thread [1] 11312 [core: 1] (Suspended : Signal : SIGABRT:Aborted)
> > raise() at 0x33090328a5
> > abort() at 0x3309034085
> > kaldi::KaldiAssertFailure_() at kaldi-error.cc:136 0x4cf401
> > kaldi::MatrixBase<double>::LapackGesvd() at kaldi-matrix.cc:401 0x48fdd3
> > kaldi::MatrixBase<double>::DestructiveSvd() at kaldi-matrix.cc:1,330
> > 0x48b902
> > kaldi::MatrixBase<double>::Svd() at kaldi-matrix.cc:1,352 0x48b9bb
> > kaldi::MatrixBase<double>::Svd() at kaldi-matrix.h:315 0x468e50
> > kaldi::MatrixBase<double>::Cond() at kaldi-matrix.cc:1,222 0x48bf47
> > kaldi::InitRand<double>() at matrix-lib-test.cc:74 0x42dd7e
> > kaldi::UnitTestCompressedMatrix<double>() at matrix-lib-test.cc:3,532
> > 0x43055a
> > kaldi::MatrixUnitTest<double>() at matrix-lib-test.cc:3,705 0x42de8b
> > main() at matrix-lib-test.cc:3,829 0x42dac7
> >
> >
> >
> > variable list after invoking the following @line393 kaldi-matrix.cc
> > clapack_Xgesvd(v_job, u_job,
> > &M, &N, data_, &LDA,
> > s->Data(),
> > V->Data(), &V_stride,
> > U->Data(), &U_stride,
> > p_work, &l_work,
> > &result);
> >
> >
> > __func__ char [12] 0x4d5418
> > M KaldiBlasInt 1
> > LDA KaldiBlasInt 2
> > U kaldi::MatrixBase<double> * 0x7ffffffface0
> > data_ double * 0x7413b0
> > *data_ double 0
> > num_cols_ kaldi::MatrixIndexT 1
> > num_rows_ kaldi::MatrixIndexT 10
> > stride_ kaldi::MatrixIndexT 2
> > l_work KaldiBlasInt 5
> > p_work double * 0x741460
> > *p_work double 1.0829823019173015e-312
> > temp void * 0x741460
> > N KaldiBlasInt 10
> > V kaldi::MatrixBase<double> * 0x7fffffffacc0
> > data_ double * 0x7406a0
> > *data_ double 0
> > num_cols_ kaldi::MatrixIndexT 1
> > num_rows_ kaldi::MatrixIndexT 1
> > stride_ kaldi::MatrixIndexT 2
> > result KaldiBlasInt -13
> > tmpU kaldi::Matrix<double> {...}
> > V_stride KaldiBlasInt 2
> > work_query double 5
> > u_job char * 0x4d4fea "N"
> > tmpV kaldi::Matrix<double> {...}
> > U_stride KaldiBlasInt 2
> > v_job char * 0x4d4fea "N"
> > this kaldi::MatrixBase<double> * const 0x7fffffffaf80
> > data_ double * 0x741300
> > *data_ double 0.78239572048187256
> > num_cols_ kaldi::MatrixIndexT 1
> > num_rows_ kaldi::MatrixIndexT 10
> > stride_ kaldi::MatrixIndexT 2
> > s kaldi::VectorBase<double> * 0x7fffffffb190
> > data_ double * 0x7404a0
> > *data_ double 0
> > dim_ kaldi::MatrixIndexT 1
> > U_in kaldi::MatrixBase<double> * 0x0
> > V_in kaldi::MatrixBase<double> * 0x0
> >
> >
> >
> >
> >
> >
> >
> > On Wed, Jul 24, 2013 at 11:04 PM, Mailing list used for User
> Communication
> > and Updates <kal...@li...> wrote:
> >>
> >> Could you please run this in a debugger and show me the values of
> >> p_work, l_work and result, e.g.
> >>
> >> gdb matrix-lib
> >> (gdb) r
> >> [wait till it crashes]
> >> (gdb) up
> >> (gdb) up # not sure how many times
> >> (gdb) up
> >> (gdb) p l_work
> >> (gdb) p p_work
> >> (gdb) p result
> >>
> >> Dan
> >>
> >>
> >>
> >> On Wed, Jul 24, 2013 at 10:34 AM, Mailing list used for User
> >> Communication and Updates <kal...@li...> wrote:
> >> > Hi,
> >> >
> >> > I tried latest trunk version with MKL. I have no problem when running
> >> > `make
> >> > all`, but get a FAIL when testing. Can anyone help? Thanks.
> >> >
> >> >
> >> > svn revision 2720 trunk
> >> >
> >> >
> >> > configuration line:
> >> > $ ./configure --threaded-math=yes --mathlib=MKL --use-cuda=yes
> >> > --mkl-root=$MKLROOT --omp-libdir=/opt/intel/lib/intel64
> >> >
> >> >
> >> > MKL version 11.0 update 5 (latest)
> >> >
> >> >
> >> > Linux version CentOS 6.4
> >> > $ uname -a
> >> > Linux 2.6.32-358.6.2.el6.x86_64 #1 SMP Thu May 16 20:59:36 UTC 2013
> >> > x86_64
> >> > x86_64 x86_64 GNU/Linux
> >> >
> >> >
> >> > $ gcc -v
> >> > Using built-in specs.
> >> > Target: x86_64-redhat-linux
> >> > Configured with: ../configure --prefix=/usr --mandir=/usr/share/man
> >> > --infodir=/usr/share/info
> >> > --with-bugurl=http://bugzilla.redhat.com/bugzilla
> >> > --enable-bootstrap --enable-shared --enable-threads=posix
> >> > --enable-checking=release --with-system-zlib --enable-__cxa_atexit
> >> > --disable-libunwind-exceptions --enable-gnu-unique-object
> >> > --enable-languages=c,c++,objc,obj-c++,java,fortran,ada
> >> > --enable-java-awt=gtk
> >> > --disable-dssi
> --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre
> >> > --enable-libgcj-multifile --enable-java-maintainer-mode
> >> > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar
> >> > --disable-libjava-multilib
> >> > --with-ppl --with-cloog --with-tune=generic --with-arch_32=i686
> >> > --build=x86_64-redhat-linux
> >> > Thread model: posix
> >> > gcc version 4.4.7 20120313 (Red Hat 4.4.7-3) (GCC)
> >> >
> >> >
> >> > ~/kaldi/trunk/src/matrix
> >> > $ make test
> >> > Running matrix-lib-test .../bin/sh: line 1: 5561 Aborted
> >> > (core dumped) ./$x > /dev/null 2>&1
> >> > ... FAIL
> >> > Running kaldi-gpsr-test ...... SUCCESS
> >> > make: *** [test] Error 1
> >> >
> >> >
> >> > $ ./matrix-lib-test
> >> > ...
> >> > ...
> >> > VLOG[2] (UnitTestLbfgs():matrix-lib-test.cc:2734) L-BFGS finished
> after
> >> > 59
> >> > function evaluations.
> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3623) M = [ ]
> >> >
> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3624) M2 = [ ]
> >> >
> >> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3626) Compressed
> >> > matrix,
> >> > tot = 0, diff = 0
> >> >
> >> > MKL ERROR: Parameter 13 was incorrect on entry to DGESVD.
> >> > KALDI_ASSERT: at LapackGesvd:kaldi-matrix.cc:401, failed: result >= 0
> &&
> >> > "Call to CLAPACK dgesvd_ called with wrong arguments"
> >> > Stack trace is:
> >> > kaldi::KaldiGetStackTrace()
> >> > kaldi::KaldiAssertFailure_(char const*, char const*, int, char const*)
> >> > kaldi::MatrixBase<double>::LapackGesvd(kaldi::VectorBase<double>*,
> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*)
> >> > kaldi::MatrixBase<double>::DestructiveSvd(kaldi::VectorBase<double>*,
> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*)
> >> > kaldi::MatrixBase<double>::Svd(kaldi::VectorBase<double>*,
> >> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) const
> >> > .
> >> > .
> >> > .
> >> > ./matrix-lib-test() [0x43055a]
> >> > ./matrix-lib-test() [0x42de8b]
> >> > ./matrix-lib-test(main+0x1d) [0x42dac7]
> >> > /lib64/libc.so.6(__libc_start_main+0xfd) [0x330901ecdd]
> >> > ./matrix-lib-test() [0x42ced9]
> >> > Aborted (core dumped)
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> ------------------------------------------------------------------------------
> >> > See everything from the browser to the database with AppDynamics
> >> > Get end-to-end visibility with application monitoring from AppDynamics
> >> > Isolate bottlenecks and diagnose root cause in seconds.
> >> > Start your free trial of AppDynamics Pro today!
> >> >
> >> >
> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
> >> > _______________________________________________
> >> > Kaldi-users mailing list
> >> > Kal...@li...
> >> > https://lists.sourceforge.net/lists/listinfo/kaldi-users
> >> >
> >>
> >>
> >>
> ------------------------------------------------------------------------------
> >> See everything from the browser to the database with AppDynamics
> >> Get end-to-end visibility with application monitoring from AppDynamics
> >> Isolate bottlenecks and diagnose root cause in seconds.
> >> Start your free trial of AppDynamics Pro today!
> >>
> >>
> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
> >> _______________________________________________
> >> Kaldi-users mailing list
> >> Kal...@li...
> >> https://lists.sourceforge.net/lists/listinfo/kaldi-users
> >
> >
> >
> >
> >
> ------------------------------------------------------------------------------
> > See everything from the browser to the database with AppDynamics
> > Get end-to-end visibility with application monitoring from AppDynamics
> > Isolate bottlenecks and diagnose root cause in seconds.
> > Start your free trial of AppDynamics Pro today!
> >
> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
> > _______________________________________________
> > Kaldi-users mailing list
> > Kal...@li...
> > https://lists.sourceforge.net/lists/listinfo/kaldi-users
> >
>
>
> ------------------------------------------------------------------------------
> See everything from the browser to the database with AppDynamics
> Get end-to-end visibility with application monitoring from AppDynamics
> Isolate bottlenecks and diagnose root cause in seconds.
> Start your free trial of AppDynamics Pro today!
> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
> _______________________________________________
> Kaldi-users mailing list
> Kal...@li...
> https://lists.sourceforge.net/lists/listinfo/kaldi-users
>
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-24 16:14:51
|
I can't see any problems in the Kaldi code. Perhaps this is an older
version of MKL? It could be a bug in MKL itself. MKL tests OK for
me.
Dan
On Wed, Jul 24, 2013 at 11:55 AM, Mailing list used for User
Communication and Updates <kal...@li...> wrote:
> here's the dbg info copied from eclipse.
> PS: I can pass the test with atlas provided by centos repo
> atlas-sse3.x86_64 3.8.4-2.el6
> @base
> atlas-sse3-devel.x86_64 3.8.4-2.el6
> @base
>
>
>
> stack:
>
> matrix-lib-test [C/C++ Application]
> matrix-lib-test [11312] [cores: 1]
> Thread [1] 11312 [core: 1] (Suspended : Signal : SIGABRT:Aborted)
> raise() at 0x33090328a5
> abort() at 0x3309034085
> kaldi::KaldiAssertFailure_() at kaldi-error.cc:136 0x4cf401
> kaldi::MatrixBase<double>::LapackGesvd() at kaldi-matrix.cc:401 0x48fdd3
> kaldi::MatrixBase<double>::DestructiveSvd() at kaldi-matrix.cc:1,330
> 0x48b902
> kaldi::MatrixBase<double>::Svd() at kaldi-matrix.cc:1,352 0x48b9bb
> kaldi::MatrixBase<double>::Svd() at kaldi-matrix.h:315 0x468e50
> kaldi::MatrixBase<double>::Cond() at kaldi-matrix.cc:1,222 0x48bf47
> kaldi::InitRand<double>() at matrix-lib-test.cc:74 0x42dd7e
> kaldi::UnitTestCompressedMatrix<double>() at matrix-lib-test.cc:3,532
> 0x43055a
> kaldi::MatrixUnitTest<double>() at matrix-lib-test.cc:3,705 0x42de8b
> main() at matrix-lib-test.cc:3,829 0x42dac7
>
>
>
> variable list after invoking the following @line393 kaldi-matrix.cc
> clapack_Xgesvd(v_job, u_job,
> &M, &N, data_, &LDA,
> s->Data(),
> V->Data(), &V_stride,
> U->Data(), &U_stride,
> p_work, &l_work,
> &result);
>
>
> __func__ char [12] 0x4d5418
> M KaldiBlasInt 1
> LDA KaldiBlasInt 2
> U kaldi::MatrixBase<double> * 0x7ffffffface0
> data_ double * 0x7413b0
> *data_ double 0
> num_cols_ kaldi::MatrixIndexT 1
> num_rows_ kaldi::MatrixIndexT 10
> stride_ kaldi::MatrixIndexT 2
> l_work KaldiBlasInt 5
> p_work double * 0x741460
> *p_work double 1.0829823019173015e-312
> temp void * 0x741460
> N KaldiBlasInt 10
> V kaldi::MatrixBase<double> * 0x7fffffffacc0
> data_ double * 0x7406a0
> *data_ double 0
> num_cols_ kaldi::MatrixIndexT 1
> num_rows_ kaldi::MatrixIndexT 1
> stride_ kaldi::MatrixIndexT 2
> result KaldiBlasInt -13
> tmpU kaldi::Matrix<double> {...}
> V_stride KaldiBlasInt 2
> work_query double 5
> u_job char * 0x4d4fea "N"
> tmpV kaldi::Matrix<double> {...}
> U_stride KaldiBlasInt 2
> v_job char * 0x4d4fea "N"
> this kaldi::MatrixBase<double> * const 0x7fffffffaf80
> data_ double * 0x741300
> *data_ double 0.78239572048187256
> num_cols_ kaldi::MatrixIndexT 1
> num_rows_ kaldi::MatrixIndexT 10
> stride_ kaldi::MatrixIndexT 2
> s kaldi::VectorBase<double> * 0x7fffffffb190
> data_ double * 0x7404a0
> *data_ double 0
> dim_ kaldi::MatrixIndexT 1
> U_in kaldi::MatrixBase<double> * 0x0
> V_in kaldi::MatrixBase<double> * 0x0
>
>
>
>
>
>
>
> On Wed, Jul 24, 2013 at 11:04 PM, Mailing list used for User Communication
> and Updates <kal...@li...> wrote:
>>
>> Could you please run this in a debugger and show me the values of
>> p_work, l_work and result, e.g.
>>
>> gdb matrix-lib
>> (gdb) r
>> [wait till it crashes]
>> (gdb) up
>> (gdb) up # not sure how many times
>> (gdb) up
>> (gdb) p l_work
>> (gdb) p p_work
>> (gdb) p result
>>
>> Dan
>>
>>
>>
>> On Wed, Jul 24, 2013 at 10:34 AM, Mailing list used for User
>> Communication and Updates <kal...@li...> wrote:
>> > Hi,
>> >
>> > I tried latest trunk version with MKL. I have no problem when running
>> > `make
>> > all`, but get a FAIL when testing. Can anyone help? Thanks.
>> >
>> >
>> > svn revision 2720 trunk
>> >
>> >
>> > configuration line:
>> > $ ./configure --threaded-math=yes --mathlib=MKL --use-cuda=yes
>> > --mkl-root=$MKLROOT --omp-libdir=/opt/intel/lib/intel64
>> >
>> >
>> > MKL version 11.0 update 5 (latest)
>> >
>> >
>> > Linux version CentOS 6.4
>> > $ uname -a
>> > Linux 2.6.32-358.6.2.el6.x86_64 #1 SMP Thu May 16 20:59:36 UTC 2013
>> > x86_64
>> > x86_64 x86_64 GNU/Linux
>> >
>> >
>> > $ gcc -v
>> > Using built-in specs.
>> > Target: x86_64-redhat-linux
>> > Configured with: ../configure --prefix=/usr --mandir=/usr/share/man
>> > --infodir=/usr/share/info
>> > --with-bugurl=http://bugzilla.redhat.com/bugzilla
>> > --enable-bootstrap --enable-shared --enable-threads=posix
>> > --enable-checking=release --with-system-zlib --enable-__cxa_atexit
>> > --disable-libunwind-exceptions --enable-gnu-unique-object
>> > --enable-languages=c,c++,objc,obj-c++,java,fortran,ada
>> > --enable-java-awt=gtk
>> > --disable-dssi --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre
>> > --enable-libgcj-multifile --enable-java-maintainer-mode
>> > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar
>> > --disable-libjava-multilib
>> > --with-ppl --with-cloog --with-tune=generic --with-arch_32=i686
>> > --build=x86_64-redhat-linux
>> > Thread model: posix
>> > gcc version 4.4.7 20120313 (Red Hat 4.4.7-3) (GCC)
>> >
>> >
>> > ~/kaldi/trunk/src/matrix
>> > $ make test
>> > Running matrix-lib-test .../bin/sh: line 1: 5561 Aborted
>> > (core dumped) ./$x > /dev/null 2>&1
>> > ... FAIL
>> > Running kaldi-gpsr-test ...... SUCCESS
>> > make: *** [test] Error 1
>> >
>> >
>> > $ ./matrix-lib-test
>> > ...
>> > ...
>> > VLOG[2] (UnitTestLbfgs():matrix-lib-test.cc:2734) L-BFGS finished after
>> > 59
>> > function evaluations.
>> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3623) M = [ ]
>> >
>> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3624) M2 = [ ]
>> >
>> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3626) Compressed
>> > matrix,
>> > tot = 0, diff = 0
>> >
>> > MKL ERROR: Parameter 13 was incorrect on entry to DGESVD.
>> > KALDI_ASSERT: at LapackGesvd:kaldi-matrix.cc:401, failed: result >= 0 &&
>> > "Call to CLAPACK dgesvd_ called with wrong arguments"
>> > Stack trace is:
>> > kaldi::KaldiGetStackTrace()
>> > kaldi::KaldiAssertFailure_(char const*, char const*, int, char const*)
>> > kaldi::MatrixBase<double>::LapackGesvd(kaldi::VectorBase<double>*,
>> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*)
>> > kaldi::MatrixBase<double>::DestructiveSvd(kaldi::VectorBase<double>*,
>> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*)
>> > kaldi::MatrixBase<double>::Svd(kaldi::VectorBase<double>*,
>> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) const
>> > .
>> > .
>> > .
>> > ./matrix-lib-test() [0x43055a]
>> > ./matrix-lib-test() [0x42de8b]
>> > ./matrix-lib-test(main+0x1d) [0x42dac7]
>> > /lib64/libc.so.6(__libc_start_main+0xfd) [0x330901ecdd]
>> > ./matrix-lib-test() [0x42ced9]
>> > Aborted (core dumped)
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > ------------------------------------------------------------------------------
>> > See everything from the browser to the database with AppDynamics
>> > Get end-to-end visibility with application monitoring from AppDynamics
>> > Isolate bottlenecks and diagnose root cause in seconds.
>> > Start your free trial of AppDynamics Pro today!
>> >
>> > http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
>> > _______________________________________________
>> > Kaldi-users mailing list
>> > Kal...@li...
>> > https://lists.sourceforge.net/lists/listinfo/kaldi-users
>> >
>>
>>
>> ------------------------------------------------------------------------------
>> See everything from the browser to the database with AppDynamics
>> Get end-to-end visibility with application monitoring from AppDynamics
>> Isolate bottlenecks and diagnose root cause in seconds.
>> Start your free trial of AppDynamics Pro today!
>>
>> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
>> _______________________________________________
>> Kaldi-users mailing list
>> Kal...@li...
>> https://lists.sourceforge.net/lists/listinfo/kaldi-users
>
>
>
>
> ------------------------------------------------------------------------------
> See everything from the browser to the database with AppDynamics
> Get end-to-end visibility with application monitoring from AppDynamics
> Isolate bottlenecks and diagnose root cause in seconds.
> Start your free trial of AppDynamics Pro today!
> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
> _______________________________________________
> Kaldi-users mailing list
> Kal...@li...
> https://lists.sourceforge.net/lists/listinfo/kaldi-users
>
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-24 15:56:06
|
here's the dbg info copied from eclipse.
PS: I can pass the test with atlas provided by centos repo
atlas-sse3.x86_64 3.8.4-2.el6
@base
atlas-sse3-devel.x86_64 3.8.4-2.el6
@base
stack:
matrix-lib-test [C/C++ Application]
matrix-lib-test [11312] [cores: 1]
Thread [1] 11312 [core: 1] (Suspended : Signal : SIGABRT:Aborted)
raise() at 0x33090328a5
abort() at 0x3309034085
kaldi::KaldiAssertFailure_() at kaldi-error.cc:136 0x4cf401
kaldi::MatrixBase<double>::LapackGesvd() at kaldi-matrix.cc:401 0x48fdd3
kaldi::MatrixBase<double>::DestructiveSvd() at kaldi-matrix.cc:1,330
0x48b902
kaldi::MatrixBase<double>::Svd() at kaldi-matrix.cc:1,352 0x48b9bb
kaldi::MatrixBase<double>::Svd() at kaldi-matrix.h:315 0x468e50
kaldi::MatrixBase<double>::Cond() at kaldi-matrix.cc:1,222 0x48bf47
kaldi::InitRand<double>() at matrix-lib-test.cc:74 0x42dd7e
kaldi::UnitTestCompressedMatrix<double>() at matrix-lib-test.cc:3,532
0x43055a
kaldi::MatrixUnitTest<double>() at matrix-lib-test.cc:3,705 0x42de8b
main() at matrix-lib-test.cc:3,829 0x42dac7
variable list after invoking the following @line393 kaldi-matrix.cc
clapack_Xgesvd(v_job, u_job,
&M, &N, data_, &LDA,
s->Data(),
V->Data(), &V_stride,
U->Data(), &U_stride,
p_work, &l_work,
&result);
__func__ char [12] 0x4d5418
M KaldiBlasInt 1
LDA KaldiBlasInt 2
U kaldi::MatrixBase<double> * 0x7ffffffface0
data_ double * 0x7413b0
*data_ double 0
num_cols_ kaldi::MatrixIndexT 1
num_rows_ kaldi::MatrixIndexT 10
stride_ kaldi::MatrixIndexT 2
l_work KaldiBlasInt 5
p_work double * 0x741460
*p_work double 1.0829823019173015e-312
temp void * 0x741460
N KaldiBlasInt 10
V kaldi::MatrixBase<double> * 0x7fffffffacc0
data_ double * 0x7406a0
*data_ double 0
num_cols_ kaldi::MatrixIndexT 1
num_rows_ kaldi::MatrixIndexT 1
stride_ kaldi::MatrixIndexT 2
result KaldiBlasInt -13
tmpU kaldi::Matrix<double> {...}
V_stride KaldiBlasInt 2
work_query double 5
u_job char * 0x4d4fea "N"
tmpV kaldi::Matrix<double> {...}
U_stride KaldiBlasInt 2
v_job char * 0x4d4fea "N"
this kaldi::MatrixBase<double> * const 0x7fffffffaf80
data_ double * 0x741300
*data_ double 0.78239572048187256
num_cols_ kaldi::MatrixIndexT 1
num_rows_ kaldi::MatrixIndexT 10
stride_ kaldi::MatrixIndexT 2
s kaldi::VectorBase<double> * 0x7fffffffb190
data_ double * 0x7404a0
*data_ double 0
dim_ kaldi::MatrixIndexT 1
U_in kaldi::MatrixBase<double> * 0x0
V_in kaldi::MatrixBase<double> * 0x0
On Wed, Jul 24, 2013 at 11:04 PM, Mailing list used for User Communication
and Updates <kal...@li...> wrote:
> Could you please run this in a debugger and show me the values of
> p_work, l_work and result, e.g.
>
> gdb matrix-lib
> (gdb) r
> [wait till it crashes]
> (gdb) up
> (gdb) up # not sure how many times
> (gdb) up
> (gdb) p l_work
> (gdb) p p_work
> (gdb) p result
>
> Dan
>
>
>
> On Wed, Jul 24, 2013 at 10:34 AM, Mailing list used for User
> Communication and Updates <kal...@li...> wrote:
> > Hi,
> >
> > I tried latest trunk version with MKL. I have no problem when running
> `make
> > all`, but get a FAIL when testing. Can anyone help? Thanks.
> >
> >
> > svn revision 2720 trunk
> >
> >
> > configuration line:
> > $ ./configure --threaded-math=yes --mathlib=MKL --use-cuda=yes
> > --mkl-root=$MKLROOT --omp-libdir=/opt/intel/lib/intel64
> >
> >
> > MKL version 11.0 update 5 (latest)
> >
> >
> > Linux version CentOS 6.4
> > $ uname -a
> > Linux 2.6.32-358.6.2.el6.x86_64 #1 SMP Thu May 16 20:59:36 UTC 2013
> x86_64
> > x86_64 x86_64 GNU/Linux
> >
> >
> > $ gcc -v
> > Using built-in specs.
> > Target: x86_64-redhat-linux
> > Configured with: ../configure --prefix=/usr --mandir=/usr/share/man
> > --infodir=/usr/share/info --with-bugurl=
> http://bugzilla.redhat.com/bugzilla
> > --enable-bootstrap --enable-shared --enable-threads=posix
> > --enable-checking=release --with-system-zlib --enable-__cxa_atexit
> > --disable-libunwind-exceptions --enable-gnu-unique-object
> > --enable-languages=c,c++,objc,obj-c++,java,fortran,ada
> --enable-java-awt=gtk
> > --disable-dssi --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre
> > --enable-libgcj-multifile --enable-java-maintainer-mode
> > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --disable-libjava-multilib
> > --with-ppl --with-cloog --with-tune=generic --with-arch_32=i686
> > --build=x86_64-redhat-linux
> > Thread model: posix
> > gcc version 4.4.7 20120313 (Red Hat 4.4.7-3) (GCC)
> >
> >
> > ~/kaldi/trunk/src/matrix
> > $ make test
> > Running matrix-lib-test .../bin/sh: line 1: 5561 Aborted
> > (core dumped) ./$x > /dev/null 2>&1
> > ... FAIL
> > Running kaldi-gpsr-test ...... SUCCESS
> > make: *** [test] Error 1
> >
> >
> > $ ./matrix-lib-test
> > ...
> > ...
> > VLOG[2] (UnitTestLbfgs():matrix-lib-test.cc:2734) L-BFGS finished after
> 59
> > function evaluations.
> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3623) M = [ ]
> >
> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3624) M2 = [ ]
> >
> > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3626) Compressed
> matrix,
> > tot = 0, diff = 0
> >
> > MKL ERROR: Parameter 13 was incorrect on entry to DGESVD.
> > KALDI_ASSERT: at LapackGesvd:kaldi-matrix.cc:401, failed: result >= 0 &&
> > "Call to CLAPACK dgesvd_ called with wrong arguments"
> > Stack trace is:
> > kaldi::KaldiGetStackTrace()
> > kaldi::KaldiAssertFailure_(char const*, char const*, int, char const*)
> > kaldi::MatrixBase<double>::LapackGesvd(kaldi::VectorBase<double>*,
> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*)
> > kaldi::MatrixBase<double>::DestructiveSvd(kaldi::VectorBase<double>*,
> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*)
> > kaldi::MatrixBase<double>::Svd(kaldi::VectorBase<double>*,
> > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) const
> > .
> > .
> > .
> > ./matrix-lib-test() [0x43055a]
> > ./matrix-lib-test() [0x42de8b]
> > ./matrix-lib-test(main+0x1d) [0x42dac7]
> > /lib64/libc.so.6(__libc_start_main+0xfd) [0x330901ecdd]
> > ./matrix-lib-test() [0x42ced9]
> > Aborted (core dumped)
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> ------------------------------------------------------------------------------
> > See everything from the browser to the database with AppDynamics
> > Get end-to-end visibility with application monitoring from AppDynamics
> > Isolate bottlenecks and diagnose root cause in seconds.
> > Start your free trial of AppDynamics Pro today!
> >
> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
> > _______________________________________________
> > Kaldi-users mailing list
> > Kal...@li...
> > https://lists.sourceforge.net/lists/listinfo/kaldi-users
> >
>
>
> ------------------------------------------------------------------------------
> See everything from the browser to the database with AppDynamics
> Get end-to-end visibility with application monitoring from AppDynamics
> Isolate bottlenecks and diagnose root cause in seconds.
> Start your free trial of AppDynamics Pro today!
> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
> _______________________________________________
> Kaldi-users mailing list
> Kal...@li...
> https://lists.sourceforge.net/lists/listinfo/kaldi-users
>
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-24 15:04:22
|
Could you please run this in a debugger and show me the values of p_work, l_work and result, e.g. gdb matrix-lib (gdb) r [wait till it crashes] (gdb) up (gdb) up # not sure how many times (gdb) up (gdb) p l_work (gdb) p p_work (gdb) p result Dan On Wed, Jul 24, 2013 at 10:34 AM, Mailing list used for User Communication and Updates <kal...@li...> wrote: > Hi, > > I tried latest trunk version with MKL. I have no problem when running `make > all`, but get a FAIL when testing. Can anyone help? Thanks. > > > svn revision 2720 trunk > > > configuration line: > $ ./configure --threaded-math=yes --mathlib=MKL --use-cuda=yes > --mkl-root=$MKLROOT --omp-libdir=/opt/intel/lib/intel64 > > > MKL version 11.0 update 5 (latest) > > > Linux version CentOS 6.4 > $ uname -a > Linux 2.6.32-358.6.2.el6.x86_64 #1 SMP Thu May 16 20:59:36 UTC 2013 x86_64 > x86_64 x86_64 GNU/Linux > > > $ gcc -v > Using built-in specs. > Target: x86_64-redhat-linux > Configured with: ../configure --prefix=/usr --mandir=/usr/share/man > --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla > --enable-bootstrap --enable-shared --enable-threads=posix > --enable-checking=release --with-system-zlib --enable-__cxa_atexit > --disable-libunwind-exceptions --enable-gnu-unique-object > --enable-languages=c,c++,objc,obj-c++,java,fortran,ada --enable-java-awt=gtk > --disable-dssi --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre > --enable-libgcj-multifile --enable-java-maintainer-mode > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --disable-libjava-multilib > --with-ppl --with-cloog --with-tune=generic --with-arch_32=i686 > --build=x86_64-redhat-linux > Thread model: posix > gcc version 4.4.7 20120313 (Red Hat 4.4.7-3) (GCC) > > > ~/kaldi/trunk/src/matrix > $ make test > Running matrix-lib-test .../bin/sh: line 1: 5561 Aborted > (core dumped) ./$x > /dev/null 2>&1 > ... FAIL > Running kaldi-gpsr-test ...... SUCCESS > make: *** [test] Error 1 > > > $ ./matrix-lib-test > ... > ... > VLOG[2] (UnitTestLbfgs():matrix-lib-test.cc:2734) L-BFGS finished after 59 > function evaluations. > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3623) M = [ ] > > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3624) M2 = [ ] > > LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3626) Compressed matrix, > tot = 0, diff = 0 > > MKL ERROR: Parameter 13 was incorrect on entry to DGESVD. > KALDI_ASSERT: at LapackGesvd:kaldi-matrix.cc:401, failed: result >= 0 && > "Call to CLAPACK dgesvd_ called with wrong arguments" > Stack trace is: > kaldi::KaldiGetStackTrace() > kaldi::KaldiAssertFailure_(char const*, char const*, int, char const*) > kaldi::MatrixBase<double>::LapackGesvd(kaldi::VectorBase<double>*, > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) > kaldi::MatrixBase<double>::DestructiveSvd(kaldi::VectorBase<double>*, > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) > kaldi::MatrixBase<double>::Svd(kaldi::VectorBase<double>*, > kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) const > . > . > . > ./matrix-lib-test() [0x43055a] > ./matrix-lib-test() [0x42de8b] > ./matrix-lib-test(main+0x1d) [0x42dac7] > /lib64/libc.so.6(__libc_start_main+0xfd) [0x330901ecdd] > ./matrix-lib-test() [0x42ced9] > Aborted (core dumped) > > > > > > > > > > > > ------------------------------------------------------------------------------ > See everything from the browser to the database with AppDynamics > Get end-to-end visibility with application monitoring from AppDynamics > Isolate bottlenecks and diagnose root cause in seconds. > Start your free trial of AppDynamics Pro today! > http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk > _______________________________________________ > Kaldi-users mailing list > Kal...@li... > https://lists.sourceforge.net/lists/listinfo/kaldi-users > |
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-24 14:34:59
|
Hi, I tried latest trunk version with MKL. I have no problem when running `make all`, but get a FAIL when testing. Can anyone help? Thanks. svn revision 2720 trunk configuration line: $ ./configure --threaded-math=yes --mathlib=MKL --use-cuda=yes --mkl-root=$MKLROOT --omp-libdir=/opt/intel/lib/intel64 MKL version 11.0 update 5 (latest) Linux version CentOS 6.4 $ uname -a Linux 2.6.32-358.6.2.el6.x86_64 #1 SMP Thu May 16 20:59:36 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux $ gcc -v Using built-in specs. Target: x86_64-redhat-linux Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla--enable-bootstrap --enable-shared --enable-threads=posix --enable-checking=release --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-languages=c,c++,objc,obj-c++,java,fortran,ada --enable-java-awt=gtk --disable-dssi --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre --enable-libgcj-multifile --enable-java-maintainer-mode --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --disable-libjava-multilib --with-ppl --with-cloog --with-tune=generic --with-arch_32=i686 --build=x86_64-redhat-linux Thread model: posix gcc version 4.4.7 20120313 (Red Hat 4.4.7-3) (GCC) ~/kaldi/trunk/src/matrix $ make test Running matrix-lib-test .../bin/sh: line 1: 5561 Aborted (core dumped) ./$x > /dev/null 2>&1 ... FAIL Running kaldi-gpsr-test ...... SUCCESS make: *** [test] Error 1 $ ./matrix-lib-test ... ... VLOG[2] (UnitTestLbfgs():matrix-lib-test.cc:2734) L-BFGS finished after 59 function evaluations. LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3623) M = [ ] LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3624) M2 = [ ] LOG (UnitTestCompressedMatrix():matrix-lib-test.cc:3626) Compressed matrix, tot = 0, diff = 0 MKL ERROR: Parameter 13 was incorrect on entry to DGESVD. KALDI_ASSERT: at LapackGesvd:kaldi-matrix.cc:401, failed: result >= 0 && "Call to CLAPACK dgesvd_ called with wrong arguments" Stack trace is: kaldi::KaldiGetStackTrace() kaldi::KaldiAssertFailure_(char const*, char const*, int, char const*) kaldi::MatrixBase<double>::LapackGesvd(kaldi::VectorBase<double>*, kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) kaldi::MatrixBase<double>::DestructiveSvd(kaldi::VectorBase<double>*, kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) kaldi::MatrixBase<double>::Svd(kaldi::VectorBase<double>*, kaldi::MatrixBase<double>*, kaldi::MatrixBase<double>*) const . . . ./matrix-lib-test() [0x43055a] ./matrix-lib-test() [0x42de8b] ./matrix-lib-test(main+0x1d) [0x42dac7] /lib64/libc.so.6(__libc_start_main+0xfd) [0x330901ecdd] ./matrix-lib-test() [0x42ced9] Aborted (core dumped) |
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-20 04:20:16
|
Okay. I will take a look at both. Thanks,
Nathan
On Jul 19, 2013, at 3:28 PM, Daniel Povey wrote:
> You should be able to modify the script, yes. I'm surprised that
> variable doesn't work-- try removing everything from the directory
> where it's working. There's a variable set to 10000 that you should
> set to a smaller value. But the Kaldi LM tools aren't great-- I
> recommend SRILM.
> Dan
>
>
> On Fri, Jul 19, 2013 at 2:54 PM, Nathan Dunn <nd...@ca...> wrote:
>>
>> Sorry, I came to the same conclusion about the word_map afterwords.
>>
>> I have only 5K utterances, so that might be the problem.
>>
>> 1 - Can I use less by modifying the script? There is a holdout_sent, but modifying that variable has little effect.
>> 2 - Is there a good model to look at this (wsj/s5 or use swbd/s6, swbd/s5/swbd1_train_lms_edin,babel/s5/local/train_lms_srilm.sh)?
>>
>> Thanks,
>>
>> Nathan
>>
>>
>>
>> On Jul 19, 2013, at 11:26 AM, Daniel Povey wrote:
>>
>>> The word_map is correct, it has to do with a form of compression.
>>> How many utterances are in your training set? By default it uses the
>>> 1st 10k as validation set; if your #utts is less than this, then the
>>> training set will be empty. You should investigate SRILM too, you'll
>>> probably find it easier to use.
>>> Dan
>>>
>>>
>>> On Fri, Jul 19, 2013 at 1:46 PM, Nathan Dunn <nd...@ca...> wrote:
>>>>
>>>> I am adapting an earlier script to use mirror what switchboard/s5 is doing.
>>>>
>>>>
>>>>
>>>> train_lm.sh --arpa --lmtype 3gram-mincount $dir || exit 1;
>>>>
>>>> on this line:
>>>> sort -m <(gunzip -c $subdir/heldout_ngrams.gz) - | compute_perplexity
>>>>
>>>> I get:
>>>> Not installing the kaldi_lm toolkit since it is already there.
>>>> Getting raw N-gram counts
>>>> discount_ngrams: for n-gram order 1, D=0.000000, tau=0.000000 phi=1.000000
>>>> discount_ngrams: for n-gram order 2, D=0.000000, tau=0.000000 phi=1.000000
>>>> discount_ngrams: for n-gram order 3, D=1.000000, tau=0.000000 phi=1.000000
>>>> Iteration 1/6 of optimizing discounting parameters
>>>> discount_ngrams: for n-gram order 1, D=0.600000, tau=0.675000 phi=2.000000
>>>> discount_ngrams: for n-gram order 2, D=0.800000, tau=0.675000 phi=2.000000
>>>> discount_ngrams: for n-gram order 3, D=0.000000, tau=0.825000 phi=2.000000
>>>> discount_ngrams: for n-gram order 1, D=0.600000, tau=0.900000 phi=2.000000
>>>> discount_ngrams: for n-gram order 2, D=0.800000, tau=0.900000 phi=2.000000
>>>> discount_ngrams: for n-gram order 3, D=0.000000, tau=1.100000 phi=2.000000
>>>> discount_ngrams: for n-gram order 1, D=0.600000, tau=1.215000 phi=2.000000
>>>> discount_ngrams: for n-gram order 2, D=0.800000, tau=1.215000 phi=2.000000
>>>> discount_ngrams: for n-gram order 3, D=0.000000, tau=1.485000 phi=2.000000
>>>> interpolate_ngrams: 116456 words in wordslist
>>>> compute_perplexity: for history-state "", no total-count % is seen
>>>> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>>>>
>>>> real 0m0.027s
>>>> user 0m0.016s
>>>> sys 0m0.004s
>>>> interpolate_ngrams: 116456 words in wordslist
>>>> interpolate_ngrams: 116456 words in wordslist
>>>> compute_perplexity: for history-state "", no total-count % is seen
>>>> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>>>>
>>>> real 0m0.031s
>>>> user 0m0.020s
>>>> sys 0m0.000s
>>>> compute_perplexity: for history-state "", no total-count % is seen
>>>> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>>>>
>>>> real 0m0.029s
>>>> user 0m0.020s
>>>> sys 0m0.000s
>>>> Usage: optimize_alpha.pl alpha1 perplexity@alpha1 alpha2 perplexity@alpha2 alpha3 perplexity@alph3 at /home/ndunn/svn/kaldi-stable/egs/childspeech/s5/../../../tools/kaldi_lm/optimize_alpha.pl line 23.
>>>> Preparing train and test data
>>>> No such file data/local/lm/3gram-mincount/lm_unpruned.gz
>>>> steps/make_mfcc.sh --nj 20 --cmd scripts/run.pl data/train exp/make_mfcc/train /home
>>>>
>>>> dies . . ..
>>>>
>>>> THEORY - get_word_map.pl script is generating a bad word_map. In vim, <80> <81> and <82> show-up as non-ascii characters as below:
>>>>
>>>> Using the switchboard script this line uses get "get_word_map.pl" in kaldi_lm tools:
>>>> cat $dir/unigram.counts | awk '{print $2}' | get_word_map.pl "<s>" "</s>" "<UNK>"
>>>>
>>>> Bu this generates this, where the second-column is wonky.
>>>>
>>>> S(/S/) s
>>>> AH(/AH/) v
>>>> IX(/IX/) w
>>>> THEIR x
>>>> /W y
>>>> SOME z
>>>> AA(/AA/) <80>
>>>> /K <81>
>>>> WATER <82>
>>>>
>>>> Similar results on Linux and the Mac.
>>>>
>>>> Any other ideas?
>>>>
>>>> Thanks,
>>>>
>>>> Nathan
>>>>
>>>>
>>>>
>>
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-20 00:21:27
|
Hi Teo, In speech recognition, we use gaussian units on the DNN input, because it reflects the nature of the input features. In your case, when you use the pixel values, it is better to use Bernoulli units on the DNN front-end. This you can do by modifying the training script in a way that you remove special handling of the 1st RBM, which will effectively make it use Bernoulli visible units. Alternatively you can use PCA on your data, which will make it more 'Gaussian'. With regards, Karel Dne 19.7.2013 12:33, Mailing list used for User Communication and Updates napsal(a): > Hi, > > I ran into some issue regarding rbm training. My features are pixels values (I work on handwriting recognition), and some of them are often zero (so on a subset of data, the stdev might be zero..). > I applied an adaptation of wsj/s5 recipe with Karel's method to train DNN and got this : > > LOG (rbm-train-cd1-frmshuff:main():rbm-train-cd1-frmshuff.cc:140) RBM TRAINING STARTED > LOG (rbm-train-cd1-frmshuff:main():rbm-train-cd1-frmshuff.cc:143) Iteration 1/2 > VLOG[1] (rbm-train-cd1-frmshuff:main():rbm-train-cd1-frmshuff.cc:243) Setting momentum 0.5 and learning rate 0.005 after processing 0.000277778h > ERROR (rbm-train-cd1-frmshuff:ApplyPow():kaldi-vector.cc:421) Cannot take square root of negative value -3.72529e-09 > ERROR (copy-feats:Write():kaldi-matrix.cc:962) Failed to write matrix to stream > > I reckon we can say -3.72529e-09 is actually zero (?). > > Anyways, I added Gaussian noise to my features and that solved the problem, but maybe we don't need a precision of 1e-8 for this check in RbmUpdate. Moreover, for the neg_vis stdev, there is a check forcing it to zero if negative. > > Cheers, > > téo > ------------------------------------------------------------------------------ > See everything from the browser to the database with AppDynamics > Get end-to-end visibility with application monitoring from AppDynamics > Isolate bottlenecks and diagnose root cause in seconds. > Start your free trial of AppDynamics Pro today! > http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk > _______________________________________________ > Kaldi-users mailing list > Kal...@li... > https://lists.sourceforge.net/lists/listinfo/kaldi-users |
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-19 22:28:59
|
You should be able to modify the script, yes. I'm surprised that
variable doesn't work-- try removing everything from the directory
where it's working. There's a variable set to 10000 that you should
set to a smaller value. But the Kaldi LM tools aren't great-- I
recommend SRILM.
Dan
On Fri, Jul 19, 2013 at 2:54 PM, Nathan Dunn <nd...@ca...> wrote:
>
> Sorry, I came to the same conclusion about the word_map afterwords.
>
> I have only 5K utterances, so that might be the problem.
>
> 1 - Can I use less by modifying the script? There is a holdout_sent, but modifying that variable has little effect.
> 2 - Is there a good model to look at this (wsj/s5 or use swbd/s6, swbd/s5/swbd1_train_lms_edin,babel/s5/local/train_lms_srilm.sh)?
>
> Thanks,
>
> Nathan
>
>
>
> On Jul 19, 2013, at 11:26 AM, Daniel Povey wrote:
>
>> The word_map is correct, it has to do with a form of compression.
>> How many utterances are in your training set? By default it uses the
>> 1st 10k as validation set; if your #utts is less than this, then the
>> training set will be empty. You should investigate SRILM too, you'll
>> probably find it easier to use.
>> Dan
>>
>>
>> On Fri, Jul 19, 2013 at 1:46 PM, Nathan Dunn <nd...@ca...> wrote:
>>>
>>> I am adapting an earlier script to use mirror what switchboard/s5 is doing.
>>>
>>>
>>>
>>> train_lm.sh --arpa --lmtype 3gram-mincount $dir || exit 1;
>>>
>>> on this line:
>>> sort -m <(gunzip -c $subdir/heldout_ngrams.gz) - | compute_perplexity
>>>
>>> I get:
>>> Not installing the kaldi_lm toolkit since it is already there.
>>> Getting raw N-gram counts
>>> discount_ngrams: for n-gram order 1, D=0.000000, tau=0.000000 phi=1.000000
>>> discount_ngrams: for n-gram order 2, D=0.000000, tau=0.000000 phi=1.000000
>>> discount_ngrams: for n-gram order 3, D=1.000000, tau=0.000000 phi=1.000000
>>> Iteration 1/6 of optimizing discounting parameters
>>> discount_ngrams: for n-gram order 1, D=0.600000, tau=0.675000 phi=2.000000
>>> discount_ngrams: for n-gram order 2, D=0.800000, tau=0.675000 phi=2.000000
>>> discount_ngrams: for n-gram order 3, D=0.000000, tau=0.825000 phi=2.000000
>>> discount_ngrams: for n-gram order 1, D=0.600000, tau=0.900000 phi=2.000000
>>> discount_ngrams: for n-gram order 2, D=0.800000, tau=0.900000 phi=2.000000
>>> discount_ngrams: for n-gram order 3, D=0.000000, tau=1.100000 phi=2.000000
>>> discount_ngrams: for n-gram order 1, D=0.600000, tau=1.215000 phi=2.000000
>>> discount_ngrams: for n-gram order 2, D=0.800000, tau=1.215000 phi=2.000000
>>> discount_ngrams: for n-gram order 3, D=0.000000, tau=1.485000 phi=2.000000
>>> interpolate_ngrams: 116456 words in wordslist
>>> compute_perplexity: for history-state "", no total-count % is seen
>>> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>>>
>>> real 0m0.027s
>>> user 0m0.016s
>>> sys 0m0.004s
>>> interpolate_ngrams: 116456 words in wordslist
>>> interpolate_ngrams: 116456 words in wordslist
>>> compute_perplexity: for history-state "", no total-count % is seen
>>> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>>>
>>> real 0m0.031s
>>> user 0m0.020s
>>> sys 0m0.000s
>>> compute_perplexity: for history-state "", no total-count % is seen
>>> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>>>
>>> real 0m0.029s
>>> user 0m0.020s
>>> sys 0m0.000s
>>> Usage: optimize_alpha.pl alpha1 perplexity@alpha1 alpha2 perplexity@alpha2 alpha3 perplexity@alph3 at /home/ndunn/svn/kaldi-stable/egs/childspeech/s5/../../../tools/kaldi_lm/optimize_alpha.pl line 23.
>>> Preparing train and test data
>>> No such file data/local/lm/3gram-mincount/lm_unpruned.gz
>>> steps/make_mfcc.sh --nj 20 --cmd scripts/run.pl data/train exp/make_mfcc/train /home
>>>
>>> dies . . ..
>>>
>>> THEORY - get_word_map.pl script is generating a bad word_map. In vim, <80> <81> and <82> show-up as non-ascii characters as below:
>>>
>>> Using the switchboard script this line uses get "get_word_map.pl" in kaldi_lm tools:
>>> cat $dir/unigram.counts | awk '{print $2}' | get_word_map.pl "<s>" "</s>" "<UNK>"
>>>
>>> Bu this generates this, where the second-column is wonky.
>>>
>>> S(/S/) s
>>> AH(/AH/) v
>>> IX(/IX/) w
>>> THEIR x
>>> /W y
>>> SOME z
>>> AA(/AA/) <80>
>>> /K <81>
>>> WATER <82>
>>>
>>> Similar results on Linux and the Mac.
>>>
>>> Any other ideas?
>>>
>>> Thanks,
>>>
>>> Nathan
>>>
>>>
>>>
>
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-19 18:54:11
|
Sorry, I came to the same conclusion about the word_map afterwords.
I have only 5K utterances, so that might be the problem.
1 - Can I use less by modifying the script? There is a holdout_sent, but modifying that variable has little effect.
2 - Is there a good model to look at this (wsj/s5 or use swbd/s6, swbd/s5/swbd1_train_lms_edin,babel/s5/local/train_lms_srilm.sh)?
Thanks,
Nathan
On Jul 19, 2013, at 11:26 AM, Daniel Povey wrote:
> The word_map is correct, it has to do with a form of compression.
> How many utterances are in your training set? By default it uses the
> 1st 10k as validation set; if your #utts is less than this, then the
> training set will be empty. You should investigate SRILM too, you'll
> probably find it easier to use.
> Dan
>
>
> On Fri, Jul 19, 2013 at 1:46 PM, Nathan Dunn <nd...@ca...> wrote:
>>
>> I am adapting an earlier script to use mirror what switchboard/s5 is doing.
>>
>>
>>
>> train_lm.sh --arpa --lmtype 3gram-mincount $dir || exit 1;
>>
>> on this line:
>> sort -m <(gunzip -c $subdir/heldout_ngrams.gz) - | compute_perplexity
>>
>> I get:
>> Not installing the kaldi_lm toolkit since it is already there.
>> Getting raw N-gram counts
>> discount_ngrams: for n-gram order 1, D=0.000000, tau=0.000000 phi=1.000000
>> discount_ngrams: for n-gram order 2, D=0.000000, tau=0.000000 phi=1.000000
>> discount_ngrams: for n-gram order 3, D=1.000000, tau=0.000000 phi=1.000000
>> Iteration 1/6 of optimizing discounting parameters
>> discount_ngrams: for n-gram order 1, D=0.600000, tau=0.675000 phi=2.000000
>> discount_ngrams: for n-gram order 2, D=0.800000, tau=0.675000 phi=2.000000
>> discount_ngrams: for n-gram order 3, D=0.000000, tau=0.825000 phi=2.000000
>> discount_ngrams: for n-gram order 1, D=0.600000, tau=0.900000 phi=2.000000
>> discount_ngrams: for n-gram order 2, D=0.800000, tau=0.900000 phi=2.000000
>> discount_ngrams: for n-gram order 3, D=0.000000, tau=1.100000 phi=2.000000
>> discount_ngrams: for n-gram order 1, D=0.600000, tau=1.215000 phi=2.000000
>> discount_ngrams: for n-gram order 2, D=0.800000, tau=1.215000 phi=2.000000
>> discount_ngrams: for n-gram order 3, D=0.000000, tau=1.485000 phi=2.000000
>> interpolate_ngrams: 116456 words in wordslist
>> compute_perplexity: for history-state "", no total-count % is seen
>> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>>
>> real 0m0.027s
>> user 0m0.016s
>> sys 0m0.004s
>> interpolate_ngrams: 116456 words in wordslist
>> interpolate_ngrams: 116456 words in wordslist
>> compute_perplexity: for history-state "", no total-count % is seen
>> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>>
>> real 0m0.031s
>> user 0m0.020s
>> sys 0m0.000s
>> compute_perplexity: for history-state "", no total-count % is seen
>> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>>
>> real 0m0.029s
>> user 0m0.020s
>> sys 0m0.000s
>> Usage: optimize_alpha.pl alpha1 perplexity@alpha1 alpha2 perplexity@alpha2 alpha3 perplexity@alph3 at /home/ndunn/svn/kaldi-stable/egs/childspeech/s5/../../../tools/kaldi_lm/optimize_alpha.pl line 23.
>> Preparing train and test data
>> No such file data/local/lm/3gram-mincount/lm_unpruned.gz
>> steps/make_mfcc.sh --nj 20 --cmd scripts/run.pl data/train exp/make_mfcc/train /home
>>
>> dies . . ..
>>
>> THEORY - get_word_map.pl script is generating a bad word_map. In vim, <80> <81> and <82> show-up as non-ascii characters as below:
>>
>> Using the switchboard script this line uses get "get_word_map.pl" in kaldi_lm tools:
>> cat $dir/unigram.counts | awk '{print $2}' | get_word_map.pl "<s>" "</s>" "<UNK>"
>>
>> Bu this generates this, where the second-column is wonky.
>>
>> S(/S/) s
>> AH(/AH/) v
>> IX(/IX/) w
>> THEIR x
>> /W y
>> SOME z
>> AA(/AA/) <80>
>> /K <81>
>> WATER <82>
>>
>> Similar results on Linux and the Mac.
>>
>> Any other ideas?
>>
>> Thanks,
>>
>> Nathan
>>
>>
>>
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-19 18:26:47
|
The word_map is correct, it has to do with a form of compression.
How many utterances are in your training set? By default it uses the
1st 10k as validation set; if your #utts is less than this, then the
training set will be empty. You should investigate SRILM too, you'll
probably find it easier to use.
Dan
On Fri, Jul 19, 2013 at 1:46 PM, Nathan Dunn <nd...@ca...> wrote:
>
> I am adapting an earlier script to use mirror what switchboard/s5 is doing.
>
>
>
> train_lm.sh --arpa --lmtype 3gram-mincount $dir || exit 1;
>
> on this line:
> sort -m <(gunzip -c $subdir/heldout_ngrams.gz) - | compute_perplexity
>
> I get:
> Not installing the kaldi_lm toolkit since it is already there.
> Getting raw N-gram counts
> discount_ngrams: for n-gram order 1, D=0.000000, tau=0.000000 phi=1.000000
> discount_ngrams: for n-gram order 2, D=0.000000, tau=0.000000 phi=1.000000
> discount_ngrams: for n-gram order 3, D=1.000000, tau=0.000000 phi=1.000000
> Iteration 1/6 of optimizing discounting parameters
> discount_ngrams: for n-gram order 1, D=0.600000, tau=0.675000 phi=2.000000
> discount_ngrams: for n-gram order 2, D=0.800000, tau=0.675000 phi=2.000000
> discount_ngrams: for n-gram order 3, D=0.000000, tau=0.825000 phi=2.000000
> discount_ngrams: for n-gram order 1, D=0.600000, tau=0.900000 phi=2.000000
> discount_ngrams: for n-gram order 2, D=0.800000, tau=0.900000 phi=2.000000
> discount_ngrams: for n-gram order 3, D=0.000000, tau=1.100000 phi=2.000000
> discount_ngrams: for n-gram order 1, D=0.600000, tau=1.215000 phi=2.000000
> discount_ngrams: for n-gram order 2, D=0.800000, tau=1.215000 phi=2.000000
> discount_ngrams: for n-gram order 3, D=0.000000, tau=1.485000 phi=2.000000
> interpolate_ngrams: 116456 words in wordslist
> compute_perplexity: for history-state "", no total-count % is seen
> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>
> real 0m0.027s
> user 0m0.016s
> sys 0m0.004s
> interpolate_ngrams: 116456 words in wordslist
> interpolate_ngrams: 116456 words in wordslist
> compute_perplexity: for history-state "", no total-count % is seen
> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>
> real 0m0.031s
> user 0m0.020s
> sys 0m0.000s
> compute_perplexity: for history-state "", no total-count % is seen
> (perhaps you didn't put the training n-grams through interpolate_ngrams?)
>
> real 0m0.029s
> user 0m0.020s
> sys 0m0.000s
> Usage: optimize_alpha.pl alpha1 perplexity@alpha1 alpha2 perplexity@alpha2 alpha3 perplexity@alph3 at /home/ndunn/svn/kaldi-stable/egs/childspeech/s5/../../../tools/kaldi_lm/optimize_alpha.pl line 23.
> Preparing train and test data
> No such file data/local/lm/3gram-mincount/lm_unpruned.gz
> steps/make_mfcc.sh --nj 20 --cmd scripts/run.pl data/train exp/make_mfcc/train /home
>
> dies . . ..
>
> THEORY - get_word_map.pl script is generating a bad word_map. In vim, <80> <81> and <82> show-up as non-ascii characters as below:
>
> Using the switchboard script this line uses get "get_word_map.pl" in kaldi_lm tools:
> cat $dir/unigram.counts | awk '{print $2}' | get_word_map.pl "<s>" "</s>" "<UNK>"
>
> Bu this generates this, where the second-column is wonky.
>
> S(/S/) s
> AH(/AH/) v
> IX(/IX/) w
> THEIR x
> /W y
> SOME z
> AA(/AA/) <80>
> /K <81>
> WATER <82>
>
> Similar results on Linux and the Mac.
>
> Any other ideas?
>
> Thanks,
>
> Nathan
>
>
>
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-19 17:46:45
|
I am adapting an earlier script to use mirror what switchboard/s5 is doing.
train_lm.sh --arpa --lmtype 3gram-mincount $dir || exit 1;
on this line:
sort -m <(gunzip -c $subdir/heldout_ngrams.gz) - | compute_perplexity
I get:
Not installing the kaldi_lm toolkit since it is already there.
Getting raw N-gram counts
discount_ngrams: for n-gram order 1, D=0.000000, tau=0.000000 phi=1.000000
discount_ngrams: for n-gram order 2, D=0.000000, tau=0.000000 phi=1.000000
discount_ngrams: for n-gram order 3, D=1.000000, tau=0.000000 phi=1.000000
Iteration 1/6 of optimizing discounting parameters
discount_ngrams: for n-gram order 1, D=0.600000, tau=0.675000 phi=2.000000
discount_ngrams: for n-gram order 2, D=0.800000, tau=0.675000 phi=2.000000
discount_ngrams: for n-gram order 3, D=0.000000, tau=0.825000 phi=2.000000
discount_ngrams: for n-gram order 1, D=0.600000, tau=0.900000 phi=2.000000
discount_ngrams: for n-gram order 2, D=0.800000, tau=0.900000 phi=2.000000
discount_ngrams: for n-gram order 3, D=0.000000, tau=1.100000 phi=2.000000
discount_ngrams: for n-gram order 1, D=0.600000, tau=1.215000 phi=2.000000
discount_ngrams: for n-gram order 2, D=0.800000, tau=1.215000 phi=2.000000
discount_ngrams: for n-gram order 3, D=0.000000, tau=1.485000 phi=2.000000
interpolate_ngrams: 116456 words in wordslist
compute_perplexity: for history-state "", no total-count % is seen
(perhaps you didn't put the training n-grams through interpolate_ngrams?)
real 0m0.027s
user 0m0.016s
sys 0m0.004s
interpolate_ngrams: 116456 words in wordslist
interpolate_ngrams: 116456 words in wordslist
compute_perplexity: for history-state "", no total-count % is seen
(perhaps you didn't put the training n-grams through interpolate_ngrams?)
real 0m0.031s
user 0m0.020s
sys 0m0.000s
compute_perplexity: for history-state "", no total-count % is seen
(perhaps you didn't put the training n-grams through interpolate_ngrams?)
real 0m0.029s
user 0m0.020s
sys 0m0.000s
Usage: optimize_alpha.pl alpha1 perplexity@alpha1 alpha2 perplexity@alpha2 alpha3 perplexity@alph3 at /home/ndunn/svn/kaldi-stable/egs/childspeech/s5/../../../tools/kaldi_lm/optimize_alpha.pl line 23.
Preparing train and test data
No such file data/local/lm/3gram-mincount/lm_unpruned.gz
steps/make_mfcc.sh --nj 20 --cmd scripts/run.pl data/train exp/make_mfcc/train /home
dies . . ..
THEORY - get_word_map.pl script is generating a bad word_map. In vim, <80> <81> and <82> show-up as non-ascii characters as below:
Using the switchboard script this line uses get "get_word_map.pl" in kaldi_lm tools:
cat $dir/unigram.counts | awk '{print $2}' | get_word_map.pl "<s>" "</s>" "<UNK>"
Bu this generates this, where the second-column is wonky.
S(/S/) s
AH(/AH/) v
IX(/IX/) w
THEIR x
/W y
SOME z
AA(/AA/) <80>
/K <81>
WATER <82>
Similar results on Linux and the Mac.
Any other ideas?
Thanks,
Nathan
|
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-19 16:34:07
|
Hi, I ran into some issue regarding rbm training. My features are pixels values (I work on handwriting recognition), and some of them are often zero (so on a subset of data, the stdev might be zero..). I applied an adaptation of wsj/s5 recipe with Karel's method to train DNN and got this : LOG (rbm-train-cd1-frmshuff:main():rbm-train-cd1-frmshuff.cc:140) RBM TRAINING STARTED LOG (rbm-train-cd1-frmshuff:main():rbm-train-cd1-frmshuff.cc:143) Iteration 1/2 VLOG[1] (rbm-train-cd1-frmshuff:main():rbm-train-cd1-frmshuff.cc:243) Setting momentum 0.5 and learning rate 0.005 after processing 0.000277778h ERROR (rbm-train-cd1-frmshuff:ApplyPow():kaldi-vector.cc:421) Cannot take square root of negative value -3.72529e-09 ERROR (copy-feats:Write():kaldi-matrix.cc:962) Failed to write matrix to stream I reckon we can say -3.72529e-09 is actually zero (?). Anyways, I added Gaussian noise to my features and that solved the problem, but maybe we don't need a precision of 1e-8 for this check in RbmUpdate. Moreover, for the neg_vis stdev, there is a check forcing it to zero if negative. Cheers, téo |
|
From: Mailing l. u. f. U. C. a. U. <kal...@li...> - 2013-07-18 13:01:43
|
Great, thanks! Dan On Thu, Jul 18, 2013 at 7:26 AM, Ho Yin Chan <ric...@gm...> wrote: > Hi all, > > I have added a script "install_sctk_patched.sh" in tools/extras for smooth > sctk-2.4.0 installation under Cygwin. Corresponding tools/Makefile has > changed to reflect it. > > Ricky > > On Tue, Jul 9, 2013 at 12:21 AM, Daniel Povey <dp...@gm...> wrote: >> >> Thanks, everyone! >> Dan >> >> >> On Mon, Jul 8, 2013 at 4:59 AM, ondrej platek <ond...@se...> >> wrote: >> > I just check the results for my modified Voxforge-like recipe. >> > Everything worked, training, decoding, evaluation. >> > >> > My configuration: Ubuntu 10.04, using OpenBlas and shared flag: >> > ./configure --openblas-root=`pwd`/../tools/OpenBLAS/install >> > --fst-root=`pwd`/../tools/openfst --shared >> > >> > Ondra >> > >> > >> > On Mon, Jul 8, 2013 at 7:54 AM, Ho Yin Chan <ric...@gm...> >> > wrote: >> >> >> >> Simulated mode on online decoding demo run fine on CentOS too. >> >> >> >> Ricky >> >> >> >> On Sun, Jul 7, 2013 at 10:07 PM, Vassil Panayotov >> >> <vas...@gm...> wrote: >> >>> >> >>> The compilation(including "make ext") is working OK for me too on >> >>> Ubuntu >> >>> 10.04. >> >>> Only tried to run the online decoders(voxforge/online_demo) so far - >> >>> everything seems to be fine with them. >> >>> >> >>> Vassil >> >>> >> >>> >> >>> On Sun, Jul 7, 2013 at 5:31 AM, Daniel Povey <dp...@gm...> wrote: >> >>> > Everyone, >> >>> > I have just merged from ^/sandbox/sharedlibs, where Jan Trmal, >> >>> > Ondrej >> >>> > Platek and others have been working on different build scripts that >> >>> > now support a shared-library option. If anyone can test it and make >> >>> > sure it still works for them it would be great. >> >>> > If people have made local changes to their Makefiles they may get >> >>> > conflicts. >> >>> > Dan >> >> >> >> >> > > > |
1 message has been excluded from this view by a project administrator.
