Menu

CMU Sphinx and speech therapy

2011-05-12
2012-09-22
  • Matthew Wilson

    Matthew Wilson - 2011-05-12

    My son has trouble pronouncing the letter R. It comes out as "OW" or "OH" or
    "AH". He's in speech therapy, but it's not exactly fun for him.

    I could make a game that showed him a word, and then graded him on how
    correctly he said the word, then he might enjoy practicing pronouncing letters
    more.

    For example, the game might show the word CAR. And then I'd sample him saying
    that word through the microphone. Then I need some software to parse the
    sound. If the program thinks he said "COW", then maybe he would not get a
    reward. But when the program thinks he did say "CAR". Then hurray -- maybe I
    play some animation for a reward.

    I'm not worried about game mechanics right now -- I can figure out that part
    later.

    Is Sphinx a good thing for this kind of idea? If not, I'd appreciate any
    advice you can provide. Maybe this game already exists.

     
  • Nickolay V. Shmyrev

    Is Sphinx a good thing for this kind of idea?

    Yes, you can implement this rather quickly. You need to build a finite grammar
    and put there all possible pronunciation variants for a word, correct and
    incorrect ones. Then decoder will find the closest match and you will find if
    its correct or not. You can start with HelloWorld demo and modify the
    dictionary and the grammar.

    For more details see

    http://cmusphinx.sourceforge.net/wiki/faq#qhow_to_implement_pronunciation_eva
    luation

    If not, I'd appreciate any advice you can provide. Maybe this game already
    exists.

    No, there is no such thing. It would be cool to add it into the demos we
    already have though.

     

Log in to post a comment.