I noticed that the xvoice development team is in the process of investigating open source speech recognition engines, has Julius been considered ??
it would be nice to get Julius working with the ViaVoice linux RPM engine.......
Jessica P. Hekman
xvoice discussion (what there is of it) takes place on the xvoice mailing list
I'm not going to post a substantive answer to your question here because I'm afraid it will cause other people to start posting at this forum. However, the xvoice team did look into various possibilities for alternate engines for xvoice so if I were you I would only bother to follow up on the list if you are really jazzed about doing this work yourself and want pointers as to how to begin.