Menu

pocketsphinx_batch failed to run during testing the adapted AM

Help
Nayak BS
2015-04-20
2016-04-08
  • Nayak BS

    Nayak BS - 2015-04-20

    Hello

    I used the following file set up for adapting EN_US(16 khz, 16 bits mono ) AM with some more 3 hours of datas.

    https://www.dropbox.com/s/hun81ls40t51yam/adapt2.tar.gz?dl=0

    Although i have got the adpated acoustic model but unable to check the WER / SER for the adapted AM with new test data sets (audio available in WAV, adaptation-test.fileids and adaptation-test.transcription). HMy problem lies in the following step

    pocketsphinx_batch \
     -adcin yes \
     -samprate 16000 \
     -cepdir wav \
     -cepext .wav \
     -ctl adaptation-test.fileids \
     -lm en-us.lm.dmp \
     -dict cmudict-en-us.dict \
     -hmm en-us-adapt \
     -hyp adapation-test.hyp
    
    word_align.pl adaptation-test.transcription adapation-test.hyp
    

    Problem shows error in the dict.c and batch.c with failed to add the filler contents and also the words which are not used in the test.transcription.

    Kindly let me know , how can i resolve this error and proceed with testing?

    Thank you

     
  • Nayak BS

    Nayak BS - 2015-04-21

    I have managed to get rid of this error and now it is calculating the total % error which is very poor and ceratinly i have done some mistakes here. I am getting more than 90% of accuracy in training the model, i assumed adaption would make it much better.

    Here it follows the results.

    ./word_align.pl adaptation-test.transcription adapation-test.hyp
    Use of the encoding pragma is deprecated at ./word_align.pl line 14.
    LEFT DOORS  open  (florian_1)
    THIS DOOR'S open  (florian_1)
    Words: 3 Correct: 1 Errors: 2 Percent correct = 33.33% Error = 66.67% Accuracy = 33.33%
    Insertions: 0 Deletions: 0 Substitutions: 2
    RIGHT DOORS  open  (florian_2)
    ROY   DOOR'S open  (florian_2)
    Words: 3 Correct: 1 Errors: 2 Percent correct = 33.33% Error = 66.67% Accuracy = 33.33%
    Insertions: 0 Deletions: 0 Substitutions: 2
    ALL DOORS  open  (florian_3)
    OR  DOOR'S open  (florian_3)
    Words: 3 Correct: 1 Errors: 2 Percent correct = 33.33% Error = 66.67% Accuracy = 33.33%
    Insertions: 0 Deletions: 0 Substitutions: 2
    LEFT CLOSE    (florian_4)
    THIS PATROLS  (florian_4)
    Words: 2 Correct: 0 Errors: 2 Percent correct = 0.00% Error = 100.00% Accuracy = 0.00%
    Insertions: 0 Deletions: 0 Substitutions: 2
    RIGHT CLOSE    (florian_5)
    LIKE  ANIMALS  (florian_5)
    Words: 2 Correct: 0 Errors: 2 Percent correct = 0.00% Error = 100.00% Accuracy = 0.00%
    Insertions: 0 Deletions: 0 Substitutions: 2
    ALL CLOSE   (florian_6)
    OR  PETALS  (florian_6)
    Words: 2 Correct: 0 Errors: 2 Percent correct = 0.00% Error = 100.00% Accuracy = 0.00%
    Insertions: 0 Deletions: 0 Substitutions: 2
    ***  LEFT DOORS ENFORCE  (florian_7)
    LIFT OFF  IN    FORCE    (florian_7)
    Words: 3 Correct: 0 Errors: 4 Percent correct = 0.00% Error = 133.33% Accuracy = -33.33%
    Insertions: 1 Deletions: 0 Substitutions: 3
    right ***   DOORS ENFORCE  (florian_8)
    right GOALS AND   FALLS    (florian_8)
    Words: 3 Correct: 1 Errors: 3 Percent correct = 33.33% Error = 100.00% Accuracy = 0.00%
    Insertions: 1 Deletions: 0 Substitutions: 2
    ALL doors *** ENFORCE  (florian_9)
    OR  doors AND FALLS    (florian_9)
    Words: 3 Correct: 1 Errors: 3 Percent correct = 33.33% Error = 100.00% Accuracy = 0.00%
    Insertions: 1 Deletions: 0 Substitutions: 2
    ***  ***  LEFT  DOORS TERMINATE  (florian_10)
    THIS DOOR STOOD IN    THE        (florian_10)
    Words: 3 Correct: 0 Errors: 5 Percent correct = 0.00% Error = 166.67% Accuracy = -66.67%
    Insertions: 2 Deletions: 0 Substitutions: 3
    TOTAL Words: 27 Correct: 5 Errors: 27
    TOTAL Percent correct = 18.52% Error = 100.00% Accuracy = 0.00%
    TOTAL Insertions: 5 Deletions: 0 Substitutions: 22
    

    All the files in the link(in previous message) are same except the dictionary file and adapt.sh, kindly reproduce the result including this two (available in the attachments) and guide me in solving this.

    Thank you a lot in advance.

     

    Last edit: Nayak BS 2015-04-21
    • Himanshu Srivastava

      Hi nayak,
      whaen i run the same command oly word_align.pl file is being opened no result on cmd screen how did you get that to see the accuracy.please tell me

       
  • Nayak BS

    Nayak BS - 2015-04-22

    Am i failing to provide necessary files? Thank you for your guidance

     

    Last edit: Nayak BS 2015-04-22

Log in to post a comment.