"Access is denied." errors when running sphinxtrain

[olumide]

I'm trying to run the command "python ../sphinxtrain/scripts/sphinxtrain run" as decribed in the acoustic mode training tutorial but I keep getting lots of error message "Access is denied." in the command window, plus an error dialog that reads "Windows can'topen this file: g2p_train.pl".

Please advise. Thanks.

Specs: Windows 7 (64 bit), Cygwin

[Nickolay V. Shmyrev]

Please advise.

Do not use Cygwin, use Sphinxtrain for Windows compiled with MSVC

Or properly set path to installed binaries in etc/trian.cfg after setup step.

[olumide]

I have compiled SphinxTrain for Windows with VS 2010, but I'm still struggling. When I run sphinxtrain run on my laptop (the Access denied errors are on my PC) the script hangs, i.e. does not terminate or issue any error messages after printing the message "Phase 2: Flat initialize".

I'm now trying to recompile SphinxTrain with Cygwin by running autogen.sh

[olumide]

I'm having difficulty compiling SphinxTrain with/on Cygwin. I've already compiled SphinxBase (by running autogen.sh followed by make) and now, in the SphinxTrain directory, I've run autoconf.sh followed by ./configure --with-sphinxbase-build=../sphinxbase then make but I got the error message

make[3]: Entering directory /cygdrive/c/Downloads/src/cmusphinx-code/SphinxTrain/src/libs/libclust' /bin/sh ../../../libtool --tag=CC --mode=link gcc -g -O2 -L../sphinxbase/src/libsphinxad -L.. /sphinxbase/src/libsphinxbase -L../sphinxbase/src/libsphinxbase/.libs -o libclust.la div.lo kdtre e.lo kmeans.lo metric.lo -lm -lsphinxbase ../../../libtool: line 6037: cd: ../sphinxbase/src/libsphinxad: No such file or directory libtool: link: cannot determine absolute directory name of../sphinxbase/src/libsphinxad'
Makefile:273: recipe for target `libclust.la' failed
make[3]: *** [libclust.la] Error 1

This unusual because sphinxbase/src/libsphinxbase/.libs does exist :-/

[Nickolay V. Shmyrev]

./configure --with-sphinxbase-build=../sphinxbase

This is a wrong way to configure. You should run configure without arguments or use absolute path for the argument, not a relative path. That's what message tells you about.

[olumide]

Thanks!

Am I supposed to download an4_cepstra.tar.gz in addition to an4_sphere.tar.gz. I've gone over the relevant part of the manual and it makes no mention of n4_cepstra.tar.gz. I've also made the following change to sphinx_train.cfg

$CFG_WAVFILE_EXTENSION = 'sph';
$CFG_WAVFILE_TYPE = 'nist';

Yet I'm getting numerous errors, posted here http://pastebin.com/VBAhXWZt

[olumide]

I've downloaded an4_cepstra.tar.gz as well and rerun the script. This time the training appeared ran quite well (results posted here http://pastebin.com/gMEcv6gU ) but terminated with an error while trying to find the word error rate

    Aligning results to find error rate
 Can't open /cygdrive/c/Downloads/src/cmusphinx-code/an4/result/an4-1-1.match
word_align.pl failed with error code 65280 at /usr/loca/lib/sphinxtrain/scripts/decode/slave.pl line 173.
Sphinxtrain path: /usr/local/lib/sphinxtrain
Sphinxtrain binaries path: /usr/local/libexec/sphinxtrain
...

There's no file an4-1-1.match in the result directory. (I checked.)

Also, which sphinx_train.cfg options can be used to specify that mfc features should be computed at the start of training. The feature extraction parameters, CFG_NUM_FILT etc., do not appear to be doing this.

[Nickolay V. Shmyrev]

Am I supposed to download an4_cepstra.tar.gz in addition to an4_sphere.tar.gz

No

Yet I'm getting numerous errors, posted here http://pastebin.com/VBAhXWZt

Feature extraction failed for some reason. You need to check feature extraction logs in logdir for details

There's no file an4-1-1.match in the result directory. (I checked.)

Decoding failed for some reason. You need to check decoding logs in logdir for details.

Also, which sphinx_train.cfg options can be used to specify that mfc features should be computed at the start of training.

MFC features are computed at the start by default, I'm not sure what your issue is about.

[olumide]

an4.test-1-1.log and an4.train-1-1.log are basically empty, i.e. contain

Sun Feb 17 23:04:48 2013
Sun Feb 17 23:04:48 2013

and

Sun Feb 17 23:04:47 2013
Sun Feb 17 23:04:47 2013

respectively.

I've posted my sphinx_train.cfg file here http://pastebin.com/cKDUqwa2

I'm trying to compile and rerun the script on my other machine to see how it goes there.

[olumide]

I'm trying to compile sphinxbase on another system but am getting the error message

-bash-4.1$ ./autogen.sh
**Warning**: I am going to run `configure' with no arguments.
If you wish to pass any to it, please specify them on the
`./autogen.sh' command line.

FIND: Parameter format not correct
Running ./configure ...
./configure: line 2367: syntax error near unexpected token `no-define'
./configure: line 2367: `AM_INIT_AUTOMAKE(no-define)'

What would be the reson for this error message? I've posted on the Automake forum but I fear this issue may be specific to sphinx.

Thanks.

[Nickolay V. Shmyrev]

Sun Feb 17 23:04:48 2013
Sun Feb 17 23:04:48 2013

This error means that pocketsphinx_batch and sphinx_fe executables are missing in the sphinxtrain binary folder. Probably you forgot to copy them there. You need to check binary distribution from the downloads in order to see how to prepare sphinxtrain for windows.

What would be the reson for this error message?

You do not need to run autogen on every platform, you can just run configure. Autogen is only used in a development environment

You need newer automake and autoconf if you still want to run autogen.

[olumide]

That's odd, because I checked out

svn checkout svn://svn.code.sf.net/p/cmusphinx/code/trunk cmusphinx-code

Also I updated my entire Cygwin installation yesterday, including autotools.

I'll try fetching the entire repository again and compiling sphinfx_fe for a start.

Thanks.

[olumide]

I've compiled sphinxbase and sphinxtrain on a third PC and run the training script on the an4 database but I'm still getting the error message

MODULE: DECODE Decoding using models previously trained
        Decoding 130 segments starting at 0 (part 1 of 1)
        0%
        Aligning results to find error rate
Can't open /cygdrive/c/Downloads/cmusphinx-code/an4/result/an4-1-1.match
word_align.pl failed with error code 65280 at /usr/local/lib/sphinxtrain/scripts/decode/slave.pl line 173.

On the plus side features were computed this time.

[Nickolay V. Shmyrev]

but I'm still getting the error message

Decoding failed for some reason. You need to check decoding logs in logdir for details.

[olumide]

All that's in an4-1-1.log is

Thu Feb 21 11:52:42 2013
        Thu Feb 21 11:52:42 2013

Not very helpful.

[Nickolay V. Shmyrev]

This error is actually quite helpful. It means you didn't put pocketsphinx_batch.exe and all the required dlls into the sphinxtrain binary folder together with other sphinxtrain commands.

[olumide]

I've compiled PocketSphinx on my laptop and rerun the training script. word_align.pl fails again but this time there error diagnostic is a lot more informative
http://pastebin.com/Dx3vEK7d

[Nickolay V. Shmyrev]

This last error means that you didn't configure the language model path in etc/sphinx_train.cfg. It should be an4.lm.ug.DMP, not an4.lm.DMP.

[olumide]

an4.ug.lm.DMP you mean.

SENTENCE ERROR: 46.2% (60/130) WORD ERROR RATE: 15.9% (122/773)

Now to get it to work on my laptop.

[olumide]

It works on my laptop as well. But for some reason feature computation fails on my laptop without a error message. If it helps, is it odd the "Extracting features from segments starting at (part 1 of 1)" is printed twice?

$ sphinxtrain run
Sphinxtrain path: /usr/local/lib/sphinxtrain
Sphinxtrain binaries path: /usr/local/libexec/sphinxtrain
Running the training
MODULE: 000 Computing feature from audio files
Extracting features from segments starting at (part 1 of 1)
Extracting features from segments starting at (part 1 of 1)
Feature extraction is done

[olumide]

This is highly unusual. No features are computed even when I run

perl /usr/local/lib/sphinxtrain/scripts/000.comp_feat/slave_feat.pl

from the an4 directory.

[olumide]

I've taken a look at slave_feat.pl and somehow $n_parts in the extression

$n_parts = (defined($ST::CFG_NPART) ? $ST::CFG_NPART : 1) unless defined $n_parts;

evaluates to 1. Consequently none of the for LaunchScript functions in the for-loops are called.

[Nickolay V. Shmyrev]

evaluates to 1

It is perfectly fine to have just 1 part, the issue is somewhere else. Most probably you do not have sphinx_fe in a binary folder.

[olumide]

Indeed it is. I'd compiled sphinxbase but forgot to install it.

Thanks for all your help.

[olumide]

I'm afraid I'm having difficulty running the script on yet another computer (the last, I promise). This time I'm getting the following error

    Phase 3: Forward-Backward
        Baum welch starting for 1 Gaussian(s), iteration: 1 (1 of 1)
Waiting for /cygdrive/c/Downloads/src/cmusphinx-code/an4/model_parameters/an4.ci_cont_flatinitial/mixture_weights
Waiting for /cygdrive/c/Downloads/src/cmusphinx-code/an4/model_parameters/an4.ci_cont_flatinitial/mixture_weights
Waiting for /cygdrive/c/Downloads/src/cmusphinx-code/an4/model_parameters/an4.ci_cont_flatinitial/mixture_weights
Waiting for /cygdrive/c/Downloads/src/cmusphinx-code/an4/model_parameters/an4.ci_cont_flatinitial/mixture_weights

Complete log http://pastebin.com/vKq5FuzV .