Menu

help w accumulating observation counts tut

Help
2012-06-28
2012-09-22
  • Richard Kappler

    Richard Kappler - 2012-06-28

    Wicked noob to sphinx here. Running ubuntu 12.04 on a 64 bit HP G62.
    Pocketsphinx and sphinxbase installed. sphinxtrain-1.0.7 downloaded and
    extracted, for lack of knowing better put it inside my pocketsphinx directory.
    Also created a directory (in pocketsphinx) called sphinxadapt as my working
    directory while learning this. Downloaded the arctic20 files, recorded the
    adaptation data (took SEVERAL tries to get the recordings to what I thought
    was acceptable quality, my fault, not machine or sphinx).

    Copied hub4wsj_sc_8k into sphinxadapt directory (working) and generated the
    acoustic feature files per tutorial.

    Downloaded and extracted the extras file (for now put it into pocketsphinx dir
    along with everything else), copied mixture_weights file into
    sphinxadapt/hub4wsj_sc_8k directory, made the mdef.txt file

    Now trying to collect statistics under the Accumulating Observation Counts

    feat.params file as follows:

    -nfilt 20
    -lowerf 1
    -upperf 4000
    -wlen 0.025
    -transform dct
    -round_filters no
    -remove_dc yes
    -svspec 0-12/13-25/26-38
    -feat 1s_c_d_dd
    -agc none
    -cmn current
    -cmninit 56,-3,1
    -varnorm no
    

    ran

    ./bw \
     -hmmdir hub4wsj_sc_8k \
     -moddeffn hub4wsj_sc_8k/mdef.txt \
     -ts2cbfn .semi. \
     -feat 1s_c_d_dd \
     -svspec 0-12/13-25/26-38 \
     -cmn current \
     -agc none \
     -dictfn arctic20.dic \
     -ctlfn arctic20.fileids \
     -lsnfn arctic20.transcription \
     -accumdir .
    

    getting

    ERROR: "corpus.c", line 1555: MFCC read of arctic_0001..mfc failed.  Retrying after sleep...
    

    over and over again.

    As I am wicked new to pocketsphinx I am pretty much at a loss. I know the wav
    files are okay, I listened to them, and see them in the sphinxadapt directory
    I created to work through this tutorial. Is this a directory issue? Was I to
    have put all this in the model directory instead of making a new one for the
    tutorials?

    regards, Richard

     
  • Richard Kappler

    Richard Kappler - 2012-06-28

    Oh, and I forgot, I did copy fillerdict into the working directory
    (sphinxadapt).

     
  • Nickolay V. Shmyrev

    Try to add

    -cepext mfc

    or use binaries from the snapshot. They should be more stable.

    The default value for cepext seems to be .mfc and it tries to append both .
    and .mfc, so it fails to find the file.

     
  • Nickolay V. Shmyrev

    Another reason for not synced extension might be a version mismatch. Make sure
    that sphinxbase version matches the sphinxtrain one.

     
  • Richard Kappler

    Richard Kappler - 2012-07-01

    Thanks. I'll give it a go and let you know.

    regards, Richard

     
  • Richard Kappler

    Richard Kappler - 2012-07-01

    Worked like a charm, Thank you so much, I wish I'd know that two days ago
    (-cepext mfc)

    regards, Richard

     
  • Richard Kappler

    Richard Kappler - 2012-07-01

    Is there another hidden trick for the mllr piece?

    I entered

    ./mllr_solve \
        -meanfn hub4wsj_sc_8k/means \
        -varfn hub4wsj_sc_8k/variances \
        -outmllrfn mllr_matrix -accumdir .
    

    and got back no such file or directory
    I copied the mllr_solve directory in from sphinxtrain, then it just told me
    its a directory. Granted, I'm pretty tired so maybe making some pretty obvious
    mistakes, but the tutorial seems to be seriously lacking.

    All I want to do is improve the accuracy of my pocketsphinx. I'd say it's
    running at about 70% right now. Ideally, I'd like to understand how the
    program works so I can integrate it with some other stuff I'm working on, and
    I know its more of a developers toolkit than a full on program, but man, this
    seems like an impossible battle when I can't even trust the tutorials.

    A little discouraged but not giving up, Richard

     
  • Richard Kappler

    Richard Kappler - 2012-07-01

    Nevermind. I trashed Sphinxtrain, untarred a new copy, reconfigured, make,
    etc. AND (not in the tutorial) copied mllr_solve into my working directory.
    tried again and it worked.

    One question though. If/when I make it through the entire adapt
    tutorial/process, bear in mind that I'm doing all this in a directory I
    created for the purpose called shpinxadapt. What do with all the arctic files
    and the wsj adapt directory the process creates? Does it all go into the model
    directory, pocketsphinx directory, doesn't matter?

    regards, Richard

     
  • Richard Kappler

    Richard Kappler - 2012-07-01

    Okay, now what? Sorry if I sound frustrated but I'm...well..frustrated. I am
    also appreciative of and attentive to any help I get though.

    So, on to map_adapt. The first time it said , well, here it is for you to
    read:

    ~/pocketsphinx/sphinxadapt$ map_adapt \
    >     -meanfn hub4wsj_sc_8k/means \
    >     -varfn hub4wsj_sc_8k/variances \
    >     -mixwfn hub4wsj_sc_8k/mixture_weights \
    >     -tmatfn hub4wsj_sc_8k/transition_matrices \
    >     -accumdir . \
    >     -mapmeanfn hub4wsj_sc_8kadapt/means \
    >     -mapvarfn hub4wsj_sc_8kadapt/variances \
    >     -mapmixwfn hub4wsj_sc_8kadapt/mixture_weights \
    >     -maptmatfn hub4wsj_sc_8kadapt/transition_matrices
    map_adapt: command not found
    richard@Frankenputer:~/pocketsphinx/sphinxadapt$ ./map_adapt \
    >     -meanfn hub4wsj_sc_8k/means \
    >     -varfn hub4wsj_sc_8k/variances \
    >     -mixwfn hub4wsj_sc_8k/mixture_weights \
    >     -tmatfn hub4wsj_sc_8k/transition_matrices \
    >     -accumdir . \
    >     -mapmeanfn hub4wsj_sc_8kadapt/means \
    >     -mapvarfn hub4wsj_sc_8kadapt/variances \
    >     -mapmixwfn hub4wsj_sc_8kadapt/mixture_weights \
    >     -maptmatfn hub4wsj_sc_8kadapt/transition_matrices .
    ERROR: "cmd_ln.c", line 602: Unknown argument name '.'
    *** glibc detected *** ./map_adapt: double free or corruption (fasttop): 0x0000000000efab90 ***
    ======= Backtrace: =========
    /lib/x86_64-linux-gnu/libc.so.6(+0x7e626)[0x7f68c1339626]
    /usr/local/lib/libsphinxbase.so.1(cmd_ln_val_free+0x43)[0x7f68c1688233]
    /usr/local/lib/libsphinxbase.so.1(cmd_ln_free_r+0x5d)[0x7f68c1688aad]
    /usr/local/lib/libsphinxbase.so.1(cmd_ln_parse_r+0x61c)[0x7f68c168914c]
    /usr/local/lib/libsphinxbase.so.1(cmd_ln_parse+0x1b)[0x7f68c16898fb]
    ./map_adapt[0x403518]
    ./map_adapt[0x401756]
    /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xed)[0x7f68c12dc76d]
    ./map_adapt[0x4033ed]
    ======= Memory map: ========
    00400000-00413000 r-xp 00000000 08:07 4726076                            /home/richard/pocketsphinx/sphinxadapt/map_adapt
    00612000-00613000 r--p 00012000 08:07 4726076                            /home/richard/pocketsphinx/sphinxadapt/map_adapt
    00613000-00614000 rw-p 00013000 08:07 4726076                            /home/richard/pocketsphinx/sphinxadapt/map_adapt
    00ef6000-00f17000 rw-p 00000000 00:00 0                                  [heap]
    7f68bf7b5000-7f68bf7ea000 r-xp 00000000 08:07 6815919                    /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0
    7f68bf7ea000-7f68bf9e9000 ---p 00035000 08:07 6815919                    /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0
    7f68bf9e9000-7f68bf9ea000 r--p 00034000 08:07 6815919                    /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0
    7f68bf9ea000-7f68bf9eb000 rw-p 00035000 08:07 6815919                    /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0
    7f68bf9eb000-7f68bfa00000 r-xp 00000000 08:07 4980740                    /lib/x86_64-linux-gnu/libgcc_s.so.1
    7f68bfa00000-7f68bfbff000 ---p 00015000 08:07 4980740                    /lib/x86_64-linux-gnu/libgcc_s.so.1
    7f68bfbff000-7f68bfc00000 r--p 00014000 08:07 4980740                    /lib/x86_64-linux-gnu/libgcc_s.so.1
    7f68bfc00000-7f68bfc01000 rw-p 00015000 08:07 4980740                    /lib/x86_64-linux-gnu/libgcc_s.so.1
    7f68bfc01000-7f68bfd15000 r-xp 00000000 08:07 6818161                    /usr/lib/x86_64-linux-gnu/libgfortran.so.3.0.0
    7f68bfd15000-7f68bff15000 ---p 00114000 08:07 6818161                    /usr/lib/x86_64-linux-gnu/libgfortran.so.3.0.0
    7f68bff15000-7f68bff16000 r--p 00114000 08:07 6818161                    /usr/lib/x86_64-linux-gnu/libgfortran.so.3.0.0
    7f68bff16000-7f68bff18000 rw-p 00115000 08:07 6818161                    /usr/lib/x86_64-linux-gnu/libgfortran.so.3.0.0
    7f68bff18000-7f68c0823000 r-xp 00000000 08:07 6818861                    /usr/lib/atlas-base/atlas/liblapack.so.3gf.0
    7f68c0823000-7f68c0a23000 ---p 0090b000 08:07 6818861                    /usr/lib/atlas-base/atlas/liblapack.so.3gf.0
    7f68c0a23000-7f68c0a28000 rw-p 0090b000 08:07 6818861                    /usr/lib/atlas-base/atlas/liblapack.so.3gf.0
    7f68c0a28000-7f68c0b35000 rw-p 00000000 00:00 0 
    7f68c0b35000-7f68c0e95000 r-xp 00000000 08:07 6818860                    /usr/lib/atlas-base/atlas/libblas.so.3gf.0
    7f68c0e95000-7f68c1095000 ---p 00360000 08:07 6818860                    /usr/lib/atlas-base/atlas/libblas.so.3gf.0
    7f68c1095000-7f68c109e000 rw-p 00360000 08:07 6818860                    /usr/lib/atlas-base/atlas/libblas.so.3gf.0
    7f68c109e000-7f68c10b6000 r-xp 00000000 08:07 4988276                    /lib/x86_64-linux-gnu/libpthread-2.15.so
    7f68c10b6000-7f68c12b5000 ---p 00018000 08:07 4988276                    /lib/x86_64-linux-gnu/libpthread-2.15.so
    7f68c12b5000-7f68c12b6000 r--p 00017000 08:07 4988276                    /lib/x86_64-linux-gnu/libpthread-2.15.so
    7f68c12b6000-7f68c12b7000 rw-p 00018000 08:07 4988276                    /lib/x86_64-linux-gnu/libpthread-2.15.so
    7f68c12b7000-7f68c12bb000 rw-p 00000000 00:00 0 
    7f68c12bb000-7f68c146e000 r-xp 00000000 08:07 4984435                    /lib/x86_64-linux-gnu/libc-2.15.so
    7f68c146e000-7f68c166d000 ---p 001b3000 08:07 4984435                    /lib/x86_64-linux-gnu/libc-2.15.so
    7f68c166d000-7f68c1671000 r--p 001b2000 08:07 4984435                    /lib/x86_64-linux-gnu/libc-2.15.so
    7f68c1671000-7f68c1673000 rw-p 001b6000 08:07 4984435                    /lib/x86_64-linux-gnu/libc-2.15.so
    7f68c1673000-7f68c1678000 rw-p 00000000 00:00 0 
    7f68c1678000-7f68c16b5000 r-xp 00000000 08:07 7226529                    /usr/local/lib/libsphinxbase.so.1.1.1
    7f68c16b5000-7f68c18b5000 ---p 0003d000 08:07 7226529                    /usr/local/lib/libsphinxbase.so.1.1.1
    7f68c18b5000-7f68c18b6000 r--p 0003d000 08:07 7226529                    /usr/local/lib/libsphinxbase.so.1.1.1
    7f68c18b6000-7f68c18b7000 rw-p 0003e000 08:07 7226529                    /usr/local/lib/libsphinxbase.so.1.1.1
    7f68c18b7000-7f68c18b9000 rw-p 00000000 00:00 0 
    7f68c18b9000-7f68c19b2000 r-xp 00000000 08:07 4981655                    /lib/x86_64-linux-gnu/libm-2.15.so
    7f68c19b2000-7f68c1bb1000 ---p 000f9000 08:07 4981655                    /lib/x86_64-linux-gnu/libm-2.15.so
    7f68c1bb1000-7f68c1bb2000 r--p 000f8000 08:07 4981655                    /lib/x86_64-linux-gnu/libm-2.15.so
    7f68c1bb2000-7f68c1bb3000 rw-p 000f9000 08:07 4981655                    /lib/x86_64-linux-gnu/libm-2.15.so
    7f68c1bb3000-7f68c1bd5000 r-xp 00000000 08:07 4984438                    /lib/x86_64-linux-gnu/ld-2.15.so
    7f68c1da6000-7f68c1dac000 rw-p 00000000 00:00 0 
    7f68c1dd2000-7f68c1dd5000 rw-p 00000000 00:00 0 
    7f68c1dd5000-7f68c1dd6000 r--p 00022000 08:07 4984438                    /lib/x86_64-linux-gnu/ld-2.15.so
    7f68c1dd6000-7f68c1dd8000 rw-p 00023000 08:07 4984438                    /lib/x86_64-linux-gnu/ld-2.15.so
    7ffffc7eb000-7ffffc80c000 rw-p 00000000 00:00 0                          [stack]
    7ffffc91c000-7ffffc91d000 r-xp 00000000 00:00 0                          [vdso]
    ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]
    Aborted (core dumped)
    richard@Frankenputer:~/pocketsphinx/sphinxadapt$
    

    seriously?

    grumble grumble, one very frustrated old man

     
  • Richard Kappler

    Richard Kappler - 2012-07-01

    oh, and yeah, the mapadapt executable was copied into the working directory.

    off to try to figure this one out, Richard

     
  • Richard Kappler

    Richard Kappler - 2012-07-01

    nevermind, got it figured out.

     
  • Nickolay V. Shmyrev

    and got back no such file or directory I copied the mllr_solve directory in
    from sphinxtrain, then it just told me its a directory. Granted, I'm pretty
    tired so maybe making some pretty obvious mistakes, but the tutorial seems to
    be seriously lacking.

    In Unix command line "./" before the binary means to run the binary from the
    current directory. You can specify a full path to the binary if binary is
    located somewhere else. Also, tutorial specifically says

    Copy it to the working directory along with the map_adapt and mk_s2sendump
    programs from the same directory.

    Does it all go into the model directory, pocketsphinx directory, doesn't
    matter?

    See the section:

    http://cmusphinx.sourceforge.net/wiki/tutorialadapt#using_the_model

    So, on to map_adapt. The first time it said , well, here it is for you to
    read:

    Please read the messages from the tools, they usually describe the problem. In
    this case the message says that you added extra dot to the command line.

     

Log in to post a comment.