hub4 sphinx4

[Andrew]

I am trying to get hub4 working with sphinx so I can eventually transcribe wavfiles about around 5 mins long and varying words spoken. I thought I would first try to get hub4 working with the latticedemo.

I got the following output

Loading...
<s> <sil> <sil> what's derosa erode zero one <sil> </s>
<s> <sil> <sil> what's derosa erode zero one </s>
<s> <sil> <sil> what's derosa erode zero one <sil> <sil> </s>
<s> <sil> <sil> what's derosa erode zero one <sil> </s>
<s> <sil> <sil> what's derosa erode zero want </s>
<s> <sil> <sil> what's derosa erodes there'll want <sil> </s>
<s> <sil> <sil> what's derosa erodes there'll want </s>
<s> <sil> <sil> what's derosa erodes there'll want <sil> </s>
<s> <sil> <sil> what's derosa erodes there'll want <sil> <sil> </s>
<s> <sil> <sil> what's derosa erodes there'll walked <sil> </s>
<s> <sil> <sil> what's derosa erodes there'll walked </s>
<s> <sil> <sil> what's derosa erodes there'll walked <sil> <sil> </s>
<s> <sil> <sil> what's derosa erodes there'll walked <sil> </s>
<s> <sil> <sil> what's derosa erodes there'll want </s>
I heard: what's derosa erode zero one

<s> <sil> that o'toole uno <sil> </s>
<s> <sil> that o'toole uno </s>
<s> <sil> that o'toole uno <sil> </s>
<s> <sil> that o'toole uno <sil> <sil> </s>
<s> <sil> that o'toole uno </s>
<s> <sil> that o'toole unknowns </s>
I heard: that o'toole uno

<s> <sil> cyril one eight's erodes re <sil> </s>
<s> <sil> cyril one eight's erodes re </s>
<s> <sil> cyril one eight's erodes re <sil> <sil> </s>
<s> <sil> cyril one eight's erodes re <sil> </s>
<s> <sil> cyril one eight's erodes rea </s>
<s> <sil> cyril one eight's erodes rea <sil> </s>
<s> <sil> cyril one eight's erodes rea <sil> <sil> </s>
<s> <sil> cyril one eight's erodes rea <sil> </s>
<s> <sil> cyril one eight's erodes rhee </s>
<s> <sil> cyril one eight's erodes rhee <sil> <sil> </s>
<s> <sil> cyril one eight's erodes rhee <sil> </s>
<s> <sil> cyril one eight's erodes rhee <sil> </s>
<s> <sil> cyril one eight's erodes ree </s>
<s> <sil> cyril one eight's erodes ree <sil> </s>
<s> <sil> cyril one eight's erodes ree <sil> <sil> </s>
<s> <sil> cyril one eight's erodes ree <sil> </s>
<s> <sil> cyril one eight's erodes read </s>
<s> <sil> cyril one eight's erodes read <sil> </s>
<s> <sil> cyril one eight's erodes read <sil> <sil> </s>
<s> <sil> cyril one eight's erodes read <sil> </s>
<s> <sil> cyril one eight's erodes reid </s>
<s> <sil> cyril one eight's erodes reid <sil> </s>
<s> <sil> cyril one eight's erodes reid <sil> <sil> </s>
<s> <sil> cyril one eight's erodes reid <sil> </s>
<s> <sil> cyril one eight's erodes reed <sil> </s>
<s> <sil> cyril one eight's erodes reed </s>
<s> <sil> cyril one eight's erodes reed <sil> </s>
<s> <sil> cyril one eight's erodes reed <sil> <sil> </s>
<s> <sil> cyril one eight's erodes re </s>
<s> <sil> cyril one eight's erodes rea </s>
<s> <sil> cyril one eight's erodes ree </s>
<s> <sil> cyril one eight's erodes rhee </s>
<s> <sil> cyril one eight's erodes read </s>
<s> <sil> cyril one eights erodes re <sil> </s>
<s> <sil> cyril one eights erodes re </s>
<s> <sil> cyril one eights erodes re <sil> <sil> </s>
<s> <sil> cyril one eights erodes re <sil> </s>
<s> <sil> cyril one eights erodes rea </s>
<s> <sil> cyril one eights erodes rea <sil> </s>
<s> <sil> cyril one eights erodes rea <sil> <sil> </s>
<s> <sil> cyril one eights erodes rea <sil> </s>
<s> <sil> cyril one eights erodes rhee </s>
<s> <sil> cyril one eights erodes rhee <sil> <sil> </s>
<s> <sil> cyril one eights erodes rhee <sil> </s>
<s> <sil> cyril one eights erodes rhee <sil> </s>
<s> <sil> cyril one eights erodes ree </s>
<s> <sil> cyril one eights erodes ree <sil> </s>
<s> <sil> cyril one eights erodes ree <sil> <sil> </s>
<s> <sil> cyril one eights erodes ree <sil> </s>
<s> <sil> cyril one eights erodes read </s>
<s> <sil> cyril one eights erodes read <sil> </s>
<s> <sil> cyril one eights erodes read <sil> <sil> </s>
<s> <sil> cyril one eights erodes read <sil> </s>
<s> <sil> cyril one eights erodes reid </s>
<s> <sil> cyril one eights erodes reid <sil> </s>
<s> <sil> cyril one eights erodes reid <sil> <sil> </s>
<s> <sil> cyril one eights erodes reid <sil> </s>
<s> <sil> cyril one eights erodes reed <sil> </s>
<s> <sil> cyril one eights erodes reed </s>
<s> <sil> cyril one eights erodes reed <sil> </s>
<s> <sil> cyril one eights erodes reed <sil> <sil> </s>
<s> <sil> cyril one eights erodes re </s>
<s> <sil> cyril one eights erodes rea </s>
<s> <sil> cyril one eights erodes ree </s>
<s> <sil> cyril one eights erodes rhee </s>
<s> <sil> cyril one eights erodes read </s>
I heard: cyril one eight's erodes re

<s> </s>
I heard:

<s> </s>
I heard:

the I heard silence continues as far as I know infinitly.

Also before it executes it gives a whole bunch of warnings about missing words in the dictionary.

Any ideas on whats going wrong?

Thanks,
Andrew

[Darren Remington]

On the missing words, your current config.xml file is pointing to the WSJ acoustic model, not the HUB4 acoustic model. Also, I happen to know from experience that the dictionary in the HUB4 acoustic model (and the WSJ AM) is missing about 1130 words from the HUB4 LM.

This will certainly impact the the ability to build trees based on known words.

As for the infinite loop - not sure about that one, as I haven't run into that before.

[Andrew]

<!-- ******** -->
<!-- The linguist configuration -->
<!-- ******** -->

<component name="lexTreeLinguist" 
            type="edu.cmu.sphinx.linguist.lextree.LexTreeLinguist">
    <property name="logMath" value="logMath"/>
    <property name="acousticModel" value="wsj"/>
    <property name="languageModel" value="trigramModel"/>
    <property name="dictionary" value="dictionary"/>
    <property name="addFillerWords" value="false"/>
    <property name="fillerInsertionProbability" value="1E-10"/>
    <property name="generateUnitStates" value="false"/>
    <property name="wantUnigramSmear" value="true"/>
    <property name="unigramSmearWeight" value="1"/>
    <property name="wordInsertionProbability" 
            value="${wordInsertionProbability}"/>
    <property name="silenceInsertionProbability" 
            value="${silenceInsertionProbability}"/>
    <property name="languageWeight" value="${languageWeight}"/>
    <property name="unitManager" value="unitManager"/>
</component>


<!-- ******************************************************** -->
<!-- The Dictionary configuration                            -->
<!-- ******************************************************** -->
<component name="dictionary" 
    type="edu.cmu.sphinx.linguist.dictionary.FastDictionary">
    <property name="dictionaryPath"
              value="resource:/edu.cmu.sphinx.model.acoustic.WSJ_8gau_13dCep_16k_40mel_130Hz_6800Hz.Model!/edu/cmu/sphinx/model/acoustic/WSJ_8gau_13dCep_16k_40mel_130Hz_6800Hz/dict/cmudict.0.6d"/>
    <property name="fillerPath" 
          value="resource:/edu.cmu.sphinx.model.acoustic.WSJ_8gau_13dCep_16k_40mel_130Hz_6800Hz.Model!/edu/cmu/sphinx/model/acoustic/WSJ_8gau_13dCep_16k_40mel_130Hz_6800Hz/dict/fillerdict"/>
    <property name="addSilEndingPronunciation" value="false"/>
    <property name="wordReplacement" value="<sil>"/>
    <property name="unitManager" value="unitManager"/>
</component>


<!-- ******************************************************** -->
<!-- The Language Model configuration                         -->
<!-- ******************************************************** -->
<component name="trigramModel" 
      type="edu.cmu.sphinx.linguist.language.ngram.large.LargeTrigramModel">
    <property name="unigramWeight" value=".5"/>
    <property name="maxDepth" value="3"/>
    <property name="logMath" value="logMath"/>
    <property name="dictionary" value="dictionary"/>
    <property name="location"
     value="C://Program Files/sphinx4/bld/models/language_model.arpaformat.DMP"/>
</component>


<!-- ******************************************************** -->
<!-- The acoustic model configuration                         -->
<!-- ******************************************************** -->
<component name="wsj"
           type="edu.cmu.sphinx.model.acoustic.WSJ_8gau_13dCep_16k_40mel_130Hz_6800Hz.Model">
    <property name="loader" value="wsjLoader"/>
    <property name="unitManager" value="unitManager"/>
</component>

<component name="wsjLoader" type="edu.cmu.sphinx.model.acoustic.WSJ_8gau_13dCep_16k_40mel_130Hz_6800Hz.ModelLoader">
    <property name="logMath" value="logMath"/>
    <property name="unitManager" value="unitManager"/>
</component>

This is my current config.xml file