Re: [Kaldi-users] LM rescoring problem

[Mailing l. u. f. U. C. a. U. <kal...@li...>]

Hi,
you might wanna look at the script egs/wsj/s5/steps/lmrescore.sh
The trouble might be that you don't call fstproject on the G fsts.
y.


On Tue, Sep 24, 2013 at 11:51 AM, Mailing list used for User Communication
and Updates <kal...@li...> wrote:

> In order to help debug the problem you could look at the word sequence
> involved (e.g. the best word sequence for that utterance; it doesn't
> matter which word sequence you take, as all word sequences were
> rejected from that utterance).  You can get this from the decoder
> logging output, or from running lattice-best-path (output to text as
> ark,t:- and then apply int2sym.pl -f 2- data/lang/words.txt to view as
> text).
>
> Then try to figure out why this word sequence might not be allowed in
> your grammar.  If you want to use OpenFST tools for debugging, you
> could do lattice-to-fst and output to scp:foo, where foo would contain
> entries like
> 001-001 bar/001-001.fst
> (make the directory bar first).
> Then you can apply OpenFst tools on that fst file, e.g. try to compose
> with G.fst.
> If you have changed your lexicon or words.txt, make sure you properly
> cleaned up, e.g. data/lang/tmp, or exp/tri4b/graph or whatever.
> Dan
>
>
> >
> > I have a problem concerning LM rescoring - when trying to obtain decoded
> > utterance with following pipeline:
> >
> > lattice-lmrescore --lm-scale=-1.0 ark:out.lat G_old.fst ark:- | \
> > lattice-lmrescore --lm-scale=1.0 ark:- G_new.fst ark:- | \
> > lattice-scale --inv_acoustic-scale=10 ark:- ark:- | \
> > lattice-best-path --word-symbol-table=words.txt ark:- ark,t:- | \
> > int2sym.pl -f 2- words.txt | \
> > sed 's/<UNK>//' > out.utt
> >
> > a warning displays:
> >> Empty lattice for utterance 001-001 (incompatible LM?)
> >
> > HCLG is of course built with G_old.fst which is unigram version of
> > G_new.fst. Both share the same lexicon. I get expected results when
> omitting
> > lmrescore part.
> > What is weird, when i try to substitute G_new.fst with G_old.fst (to get
> > "kind of" an identity transform), same warning occurs.
> > Am I missing something?
> >
> > I don't know if it is relevant, but my AM is SGMM2 on top of LDA+MLLT.
> >
> > Marcin
> > tv...@gm...
> >
> >
> ------------------------------------------------------------------------------
> > October Webinars: Code for Performance
> > Free Intel webinars can help you accelerate application performance.
> > Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most
> > from
> > the latest Intel processors and coprocessors. See abstracts and register
> >
> >
> http://pubads.g.doubleclick.net/gampad/clk?id=60133471&iu=/4140/ostg.clktrk
> > _______________________________________________
> > Kaldi-users mailing list
> > Kal...@li...
> > https://lists.sourceforge.net/lists/listinfo/kaldi-users
> >
>
>
> ------------------------------------------------------------------------------
> October Webinars: Code for Performance
> Free Intel webinars can help you accelerate application performance.
> Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most
> from
> the latest Intel processors and coprocessors. See abstracts and register >
> http://pubads.g.doubleclick.net/gampad/clk?id=60133471&iu=/4140/ostg.clktrk
> _______________________________________________
> Kaldi-users mailing list
> Kal...@li...
> https://lists.sourceforge.net/lists/listinfo/kaldi-users
>