Re: [Kaldi-developers] using recipe swbd/s5b with only switchboard DDBB

[Daniel P. <dp...@gm...>]

The script will always exit if the training failed, that is your main clue.
 And the most recently produced log will generally have the errors in it,
but the script will print out which part failed.
Dan



On Tue, Jan 21, 2014 at 4:33 AM, Xavier Anguera <xan...@gm...> wrote:

> Hi Dan,
> thanks for the tip. Doing what you proposed I was able to train the system.
>
> I still have a question though. Is there any general log file where I can
> check the overall success/failure of the training? I find many small log
> files in the different exp directories, but I do not find anything to tell
> me whether the models trained correctly.
>
> Thanks,
>
> Xavier Anguera
>
>
>
> On Fri, Jan 17, 2014 at 6:38 PM, Daniel Povey <dp...@gm...> wrote:
>
>>
>> Just remove all the lines that refer to "fsh" in that script, and replace
>> "tg fsh_tgpr" with "tg", and it should work.
>> Dan
>>
>>
>> Hi Dan,
>>> I believe the option you are referring to is the variable fisher_opt.
>>> Indeed, when passing this to swbd1_train_lms.sh, if empty, the fisher data
>>> is not processed.
>>> The problem is that right after this code, in run.sh it executes:
>>>
>>> LM=data/local/lm/sw1_fsh.o3g.kn.gz
>>> utils/format_lm_sri.sh --srilm-opts "$srilm_opts" \
>>>   data/lang $LM data/local/dict/lexicon.txt data/lang_sw1_fsh_tg
>>>
>>> # For some funny reason we are still using IRSTLM for doing LM pruning :)
>>> export PATH=$PATH:../../../tools/irstlm/bin/
>>> prune-lm --threshold=1e-7 data/local/lm/sw1_fsh.o3g.kn.gz /dev/stdout \
>>>   | gzip -c > data/local/lm/sw1_fsh.o3g.pr1-7.kn.gz || exit 1
>>> LM=data/local/lm/sw1_fsh.o3g.pr1-7.kn.gz
>>> utils/format_lm_sri.sh --srilm-opts "$srilm_opts" \
>>>   data/lang $LM data/local/dict/lexicon.txt data/lang_sw1_fsh_tgpr
>>>
>>> This expects a file data/local/lm/sw1_fsh.o3g.kn.gz which is not
>>> generated anyway.
>>> It is straighforward to make the above execution conditional upon the
>>> fisher_opt variable but my fear is whether later on in the acoustic
>>> training it will again require the fisher data (I have done a quick search
>>> of fsh in the acoustic training scripts and it seems to appear in several
>>> places).
>>>
>>> On the other hand, recipe s5 does not seem to use the fisher data, but
>>> as you noted before, it is deprecated.
>>>
>>> Please advise what to do.
>>>
>>> Thanks,
>>>
>>> Xavier Anguera
>>>
>>>
>>>
>>>
>>>
>>>
>>> On Fri, Jan 17, 2014 at 5:48 PM, Daniel Povey <dp...@gm...> wrote:
>>>
>>>> I would recommend s5b.
>>>> The Fisher data, which is used for language modeling I think, is
>>>> optional anyway as you will see in the run.sh (it's an option to a script);
>>>> if you don't have the eval2000 data you can just use the training-data
>>>> subset, which the script uses as an alternative test set and which gives
>>>> very similar WERs.
>>>>
>>>> Dan
>>>>
>>>>
>>>>
>>>> On Fri, Jan 17, 2014 at 7:09 AM, Xavier Anguera <xan...@gm...>wrote:
>>>>
>>>>> Hi,
>>>>> I am trying to run the swbd/s5b recipe and I realize that it is
>>>>> somehow dependent on Switchboard (obviously...), Fisher (transcripts and
>>>>> audio) and HUB-5 (transcripts and audio).
>>>>> Given that I do not have current access to neither Fisher nor Hub-5
>>>>> datasets, is it possible to still use this recipe training with switchboard
>>>>> alone?
>>>>> Alternatively, would recipe s5 be more recommendable (i.e. does it
>>>>> also depend on these externals?).
>>>>>
>>>>> thank you all,
>>>>> Xavier Anguera
>>>>>
>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> CenturyLink Cloud: The Leader in Enterprise Cloud Services.
>>>>> Learn Why More Businesses Are Choosing CenturyLink Cloud For
>>>>> Critical Workloads, Development Environments & Everything In Between.
>>>>> Get a Quote or Start a Free Trial Today.
>>>>>
>>>>> http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
>>>>> _______________________________________________
>>>>> Kaldi-developers mailing list
>>>>> Kal...@li...
>>>>> https://lists.sourceforge.net/lists/listinfo/kaldi-developers
>>>>>
>>>>>
>>>>
>>>
>>
>