Re: [Kaldi-users] timings don't match decoding

[Mailing l. u. f. U. C. a. U. <kal...@li...>]

Sorry for my misuse of terminology.  Let me know if there are better words for these.

What I am calling the "decoding file" is the file generated during the decoding process.  Maybe the transcription or hypothesis would be more accurate.  This is what I use for that.    I have it start at a beam of 5 and go up to 20.  I get pretty good results for the most part.  

>>>> steps/decode.sh --nj 10 --model exp/tri1/final.mdl --num-threads 1 --acwt 0.1 --cmd "$decode_cmd" --config conf/decode.config exp/tri1/graph data/local/g300_test exp/tri1/decode_g300_test


The "timings" file is what I call the file that shows the time each word starts for a decoded phrase.   It is based largely on swbd/s5/local/score_sclite.sh

>>>> lattice-1best "ark:gunzip -c exp/tri1/decode_g300_test/lat.*.gz|" ark:- | lattice-align-words ./data/local/g300_test/lang/phones/word_boundary.int exp/tri1/final.mdl ark:- ark:- | nbest-to-ctm ark:- - | ./utils/int2sym.pl -f 5 ./data/local/g300_test/lang/words.txt > exp/tri1/decode_g300_test/timings.all.txt

For some reason the "timings file" and "decoding file" do not match.   I'm wonder if they should match or is there likely an upstream error.  

Thanks,

Nathan

On Aug 1, 2013, at 12:38 PM, Daniel Povey wrote:

> I am not sure what you mean by "timing file" and "decoding file".
> Dan
> 
> 
> On Thu, Aug 1, 2013 at 3:37 PM, Nathan Dunn <nd...@uo...> wrote:
>> I'm wondering why the timing file doesn't match my decoding file.
>> 
>> They should match right?
>> 
>> Nathan
>> 
>> On Aug 1, 2013, at 12:15 PM, Daniel Povey <dp...@gm...> wrote:
>> 
>>> Nathan-- I don't really understand what you are saying or what you are asking.
>>> Dan
>>> 
>>> 
>>> On Thu, Aug 1, 2013 at 2:45 PM, Nathan Dunn <nd...@uo...> wrote:
>>>> 
>>>> Following the formal s5 scripts in wsj and the directions below, I was able to get word timings that ROUGHLY matched the decoding values I was getting.
>>>> 
>>>> in the decode file (20.txt , decoding with a beam of 20) :
>>>> 
>>>> 02.cut1 YOU ARE STANDING ON A SANDY WHITE BEACH OF THE ASSISTED AND END A THAN ANY OTHER KIND CONSISTED . . .
>>>> 
>>>> in the timings.all.txt file:
>>>> 02.cut1 1 2.64 0.03 <UNK>
>>>> 02.cut1 1 3.06 0.11 YOU
>>>> 02.cut1 1 3.17 0.22 ARE
>>>> 02.cut1 1 3.39 0.40 STANDING
>>>> 02.cut1 1 4.06 0.23 ON
>>>> 02.cut1 1 4.29 0.06 A
>>>> 02.cut1 1 4.35 0.12 IS
>>>> 02.cut1 1 4.57 0.75 INVIOLATE
>>>> 02.cut1 1 5.43 1.24 ECOSYSTEM
>>>> 02.cut1 1 6.88 0.35 NESTS
>>>> 02.cut1 1 7.64 0.65 ASSISTED(2)
>>>> 02.cut1 1 8.29 0.19 OUT
>>>> 02.cut1 1 9.76 1.06 ENLISTED(2)
>>>> 02.cut1 1 10.82 0.41 WOULD
>>>> 02.cut1 1 11.23 0.59 AN
>>>> 02.cut1 1 11.82 0.79 ALAN'S
>>>> 02.cut1 1 12.67 1.03 NETTLESOME
>>>> 02.cut1 1 13.84 1.00 INSISTED
>>>> 02.cut1 1 14.84 0.21 AND
>>>> 
>>>> Here are the commands:
>>>> 
>>>> %utils/mkgraph.sh data/local/g300_test/lang exp/tri1 exp/tri1/graph
>>>> %steps/decode.sh --nj 10 --model exp/tri1/final.mdl --num-threads 1 --acwt 0.1 --cmd "$decode_cmd" --config conf/decode.config exp/tri1/graph data/local/g300_test exp/tri1/decode_g300_test
>>>> %lattice-1best "ark:gunzip -c exp/tri1/decode_g300_test/lat.*.gz|" ark:- | lattice-align-words ./data/local/g300_test/lang/phones/word_boundary.int exp/tri1/final.mdl ark:- ark:- | nbest-to-ctm ark:- - | ./utils/int2sym.pl -f 5 ./data/local/g300_test/lang/words.txt > exp/tri1/decode_g300_test/timings.all.txt
>>>> LOG (lattice-1best:main():lattice-1best.cc:88) Done converting 339 to best path, 0 had errors.
>>>> LOG (lattice-align-words:main():lattice-align-words.cc:117) Successfully aligned 339 lattices; 0 had errors.
>>>> LOG (nbest-to-ctm:main():nbest-to-ctm.cc:95) Converted 339 linear lattices to ctm format; 0 had errors.
>>>> 
>>>> 
>>>> It should use the lattices generated from the decoding and the word_boundary and word files.   I can apply weights for language model and acoustic model, but I doubt that will have a great effect.   The words.txt file must be correct if I am getting "similar" results.
>>>> 
>>>> Anyway, any help is appreciated.
>>>> 
>>>> 
>>>> Nathan
>>> 
>