Alphabet and Digits

[Anonymous]

Hello,

I am trying to detect letters and numbers in a telephonic recording, and I'm finding that the configuration is a little complex for me.

I have installed Ant, and the 1.0-beta sources, and I can compile the demos. My idea was to use the WavFile demo as a base point, and modify it's configuration file to include a larger dictionary, then to create a grammar including the letters as well as digits.

My first step was to replace TIDIGITS_8gau_13dCep_16k_40mel_130Hz_6800Hz in the configuration file with WSJ_8gau_13dCep_8kHz_31mel_200Hz_3500Hz. I did notice that the name of the 'dictionary' in each of those .jar archives is different, and I changed it accordingly.

I then ran ant -buildfile demo.xml

and on running the newly compiled wavfile.jar I received the following output:

bash-3.00$ java -jar WavFile.jar 10001-90210-01803.wav
Loading Recognizer...

Exception in thread "main" java.lang.NullPointerException
at edu.cmu.sphinx.model.acoustic.WSJ_8gau_13dCep_8kHz_31mel_200Hz_3500Hz.ModelLoader.loadProperties(ModelLoader.java:372)
at edu.cmu.sphinx.model.acoustic.WSJ_8gau_13dCep_8kHz_31mel_200Hz_3500Hz.ModelLoader.getIsBinaryDefault(ModelLoader.java:386)
at edu.cmu.sphinx.model.acoustic.WSJ_8gau_13dCep_8kHz_31mel_200Hz_3500Hz.ModelLoader.newProperties(ModelLoader.java:346)
at edu.cmu.sphinx.util.props.ConfigurationManager.lookup(ConfigurationManager.java:214)
at edu.cmu.sphinx.util.props.ValidatingPropertySheet.getComponent(ValidatingPropertySheet.java:403)
at edu.cmu.sphinx.model.acoustic.WSJ_8gau_13dCep_8kHz_31mel_200Hz_3500Hz.Model.newProperties(Model.java:159)
at edu.cmu.sphinx.util.props.ConfigurationManager.lookup(ConfigurationManager.java:214)
at edu.cmu.sphinx.util.props.ValidatingPropertySheet.getComponent(ValidatingPropertySheet.java:403)
at edu.cmu.sphinx.linguist.flat.FlatLinguist.setupAcousticModel(FlatLinguist.java:299)
at edu.cmu.sphinx.linguist.flat.FlatLinguist.newProperties(FlatLinguist.java:246)
at edu.cmu.sphinx.util.props.ConfigurationManager.lookup(ConfigurationManager.java:214)
at edu.cmu.sphinx.util.props.ValidatingPropertySheet.getComponent(ValidatingPropertySheet.java:403)
at edu.cmu.sphinx.decoder.search.SimpleBreadthFirstSearchManager.newProperties(SimpleBreadthFirstSearchManager.java:180)
at edu.cmu.sphinx.util.props.ConfigurationManager.lookup(ConfigurationManager.java:214)
at edu.cmu.sphinx.util.props.ValidatingPropertySheet.getComponent(ValidatingPropertySheet.java:403)
at edu.cmu.sphinx.decoder.Decoder.newProperties(Decoder.java:71)
at edu.cmu.sphinx.util.props.ConfigurationManager.lookup(ConfigurationManager.java:214)
at edu.cmu.sphinx.util.props.ValidatingPropertySheet.getComponent(ValidatingPropertySheet.java:403)
at edu.cmu.sphinx.recognizer.Recognizer.newProperties(Recognizer.java:93)
at edu.cmu.sphinx.util.props.ConfigurationManager.lookup(ConfigurationManager.java:214)
at demo.sphinx.wavfile.WavFile.main(WavFile.java:62)

I've included my current config.xml below. I feel I've made a fairly dumb mistake, but I'm afraid this is all a little over my head :( I'd greatly appreciate any assistance, even a smack and a shove towards the bit of the docs which plainly states what it is I am missing or doing wrong.

Thank you!
Campbell

config.xml

<?xml version="1.0" encoding="UTF-8"?>

<!--
Sphinx-4 Configuration file
-->

<!-- ******** -->
<!-- an4 configuration file -->
<!-- ******** -->

<config>

<!-- ******************************************************** -->
<!-- frequently tuned properties                              -->
<!-- ******************************************************** -->

<property name="logLevel" value="WARNING"/>

<property name="absoluteBeamWidth"  value="-1"/>
<property name="relativeBeamWidth"  value="1E-80"/>
<property name="wordInsertionProbability" value="1E-36"/>
<property name="languageWeight"     value="8"/>

<property name="frontend" value="epFrontEnd"/>
<property name="recognizer" value="recognizer"/>
<property name="showCreations" value="false"/>

<!-- ******************************************************** -->
<!-- word recognizer configuration                            -->
<!-- ******************************************************** -->

<component name="recognizer" type="edu.cmu.sphinx.recognizer.Recognizer">
    <property name="decoder" value="decoder"/>
    <propertylist name="monitors">
        <item>accuracyTracker </item>
        <item>speedTracker </item>
        <item>memoryTracker </item>
    </propertylist>
</component>
<!-- ******************************************************** -->
<!-- The Decoder   configuration                              -->
<!-- ******************************************************** -->

<component name="decoder" type="edu.cmu.sphinx.decoder.Decoder">
    <property name="searchManager" value="searchManager"/>
</component>

<component name="searchManager"  
    type="edu.cmu.sphinx.decoder.search.SimpleBreadthFirstSearchManager">
    <property name="logMath" value="logMath"/>
    <property name="linguist" value="flatLinguist"/>
    <property name="pruner" value="trivialPruner"/>
    <property name="scorer" value="threadedScorer"/>
    <property name="activeListFactory" value="activeList"/>
</component>

<component name="activeList"  
         type="edu.cmu.sphinx.decoder.search.PartitionActiveListFactory">
    <property name="logMath" value="logMath"/>
    <property name="absoluteBeamWidth" value="${absoluteBeamWidth}"/>
    <property name="relativeBeamWidth" value="${relativeBeamWidth}"/>
</component>

<component name="trivialPruner"  
            type="edu.cmu.sphinx.decoder.pruner.SimplePruner"/>

<component name="threadedScorer"  
            type="edu.cmu.sphinx.decoder.scorer.ThreadedAcousticScorer">
    <property name="frontend" value="${frontend}"/>
    <property name="isCpuRelative" value="true"/>
    <property name="numThreads" value="0"/>
    <property name="minScoreablesPerThread" value="10"/>
    <property name="scoreablesKeepFeature" value="true"/>
</component>

<!-- ******************************************************** -->
<!-- The linguist  configuration                              -->
<!-- ******************************************************** -->

<component name="flatLinguist"  
            type="edu.cmu.sphinx.linguist.flat.FlatLinguist">
    <property name="logMath" value="logMath"/>
    <property name="grammar" value="jsgfGrammar"/>
    <property name="acousticModel" value="wsj"/>
    <property name="wordInsertionProbability"  
            value="${wordInsertionProbability}"/>
    <property name="languageWeight" value="${languageWeight}"/>
    <property name="unitManager" value="unitManager"/>
</component>

<!-- ******************************************************** -->
<!-- The Grammar  configuration                               -->
<!-- ******************************************************** -->

<component name="jsgfGrammar" type="edu.cmu.sphinx.jsapi.JSGFGrammar">
    <property name="dictionary" value="dictionary"/>
    <property name="grammarLocation"  
         value="resource:/demo.sphinx.wavfile.WavFile!/demo/sphinx/wavfile/"/>
    <property name="grammarName" value="digits"/>
<property name="logMath" value="logMath"/>
</component>

<!-- ******************************************************** -->
<!-- The Dictionary configuration                            -->
<!-- ******************************************************** -->

<component name="dictionary"  
    type="edu.cmu.sphinx.linguist.dictionary.FastDictionary">
    <property name="dictionaryPath" 
 value="resource:/edu.cmu.sphinx.model.acoustic.WSJ_8gau_13dCep_8kHz_31mel_200Hz_3500Hz.Model!/edu/cmu/sphinx/model/acoustic/WSJ_
    <property name="fillerPath"  
 value="resource:/edu.cmu.sphinx.model.acoustic.WSJ_8gau_13dCep_8kHz_31mel_200Hz_3500Hz.Model!/edu/cmu/sphinx/model/acoustic/WSJ_
    <property name="addSilEndingPronunciation" value="false"/>
    <property name="allowMissingWords" value="false"/>
    <property name="unitManager" value="unitManager"/>
</component>

<!-- ******************************************************** -->
<!-- The acoustic model configuration                         -->
<!-- ******************************************************** -->
<component name="wsj"  
  type="edu.cmu.sphinx.model.acoustic.WSJ_8gau_13dCep_8kHz_31mel_200Hz_3500Hz.Model">
    <property name="loader" value="wsjLoader"/>
    <property name="unitManager" value="unitManager"/>
</component>

<component name="wsjLoader" 
           type="edu.cmu.sphinx.model.acoustic.WSJ_8gau_13dCep_8kHz_31mel_200Hz_3500Hz.ModelLoader">
    <property name="logMath" value="logMath"/>
    <property name="unitManager" value="unitManager"/>
</component>
<!-- ******************************************************** -->
<!-- The unit manager configuration                           -->
<!-- ******************************************************** -->

<component name="unitManager"  
    type="edu.cmu.sphinx.linguist.acoustic.UnitManager"/>

<!-- ******************************************************** -->
<!-- The frontend configuration                               -->
<!-- ******************************************************** -->

<component name="frontEnd" type="edu.cmu.sphinx.frontend.FrontEnd">
    <propertylist name="pipeline">
        <item>microphone </item>
        <item>premphasizer </item>
        <item>windower </item>
        <item>fft </item>
        <item>melFilterBank </item>
        <item>dct </item>
        <item>liveCMN </item>
        <item>featureExtraction </item>
    </propertylist>
</component>

<!-- ******************************************************** -->
<!-- The live frontend configuration                          -->
<!-- ******************************************************** -->
<component name="epFrontEnd" type="edu.cmu.sphinx.frontend.FrontEnd">
    <propertylist name="pipeline">
        <item>microphone </item>
        <item>speechClassifier </item>
        <item>speechMarker </item>
        <item>nonSpeechDataFilter </item>
        <item>premphasizer </item>
        <item>windower </item>
        <item>fft </item>
        <item>melFilterBank </item>
        <item>dct </item>
        <item>liveCMN </item>
        <item>featureExtraction </item>
    </propertylist>
</component>
<!-- ******************************************************** -->
<!-- The frontend pipelines                                   -->
<!-- ******************************************************** -->

<component name="speechClassifier"  
           type="edu.cmu.sphinx.frontend.endpoint.SpeechClassifier">
    <property name="threshold" value="13"/>
</component>

<component name="nonSpeechDataFilter"  
           type="edu.cmu.sphinx.frontend.endpoint.NonSpeechDataFilter"/>

<component name="speechMarker"  
           type="edu.cmu.sphinx.frontend.endpoint.SpeechMarker" >
    <property name="speechTrailer" value="50"/>
</component>

<component name="premphasizer"  
           type="edu.cmu.sphinx.frontend.filter.Preemphasizer"/>

<component name="windower"  
           type="edu.cmu.sphinx.frontend.window.RaisedCosineWindower">
</component>

<component name="fft"  
        type="edu.cmu.sphinx.frontend.transform.DiscreteFourierTransform">
</component>

<component name="melFilterBank"  
    type="edu.cmu.sphinx.frontend.frequencywarp.MelFrequencyFilterBank">
</component>

<component name="dct"  
        type="edu.cmu.sphinx.frontend.transform.DiscreteCosineTransform"/>

<component name="liveCMN"  
           type="edu.cmu.sphinx.frontend.feature.LiveCMN"/>

<component name="featureExtraction"  
           type="edu.cmu.sphinx.frontend.feature.DeltasFeatureExtractor"/>

<component name="microphone"  
           type="edu.cmu.sphinx.frontend.util.Microphone">
    <property name="closeBetweenUtterances" value="false"/>
</component>

<!-- ******************************************************* -->
<!--  monitors                                               -->
<!-- ******************************************************* -->

<component name="accuracyTracker"  
            type="edu.cmu.sphinx.instrumentation.AccuracyTracker">
    <property name="recognizer" value="${recognizer}"/>
    <property name="showAlignedResults" value="false"/>
    <property name="showRawResults" value="false"/>
</component>

<component name="memoryTracker"  
            type="edu.cmu.sphinx.instrumentation.MemoryTracker">
    <property name="recognizer" value="${recognizer}"/>
<property name="showSummary" value="false"/>
<property name="showDetails" value="false"/>
</component>

<component name="speedTracker"  
            type="edu.cmu.sphinx.instrumentation.SpeedTracker">
    <property name="recognizer" value="${recognizer}"/>
    <property name="frontend" value="${frontend}"/>
<property name="showSummary" value="true"/>
<property name="showDetails" value="false"/>
</component>

<!-- ******************************************************* -->
<!--  Miscellaneous components                               -->
<!-- ******************************************************* -->

<component name="logMath" type="edu.cmu.sphinx.util.LogMath">
    <property name="logBase" value="1.0001"/>
    <property name="useAddTable" value="true"/>
</component>

</config>

[Anonymous]

Right. Scratch that, and sorry for the lengthy, clueless post. This one's not a lot better but I've got some questions, at least.

1) I've set it to use wsj 8khz data file. But since I only want to detect a-z and 0-9 (I will be able to scan the database of expected values to increase accuracy), I wonder - how can I decrease the size of the memory requirements? I'm running it with java -Xmx256m, and it's running out of memory.

2) My grammar file looks like this:

JSGF V1.0;

grammar transreport;
public <alphanumeric> = (oh | zero | one | two | three | four | five | six | seven | eight | nine | A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z) * ;

Does that seem like it is correct?

3) Is there not an available set of data files for this limited capability? This javascript compile/build setup is a lot of complexity for me, and I don't think I'm doing very well.

I won't post my config again unless it's required - it's a bit long and seems impolite.

Thanks in advance for any pointers you can give me..

Campbell