Re: [Kaldi-users] network perturbation using dropout or additive noise

[Daniel P. <dp...@gm...>]

I never created GPU versions of those because they did not seem to be helpful.
>From what I hear, dropout is tricky to get working in speech
recognition, and requires things like dropout-probability schedules,
and maybe only applying it to certain layers of the network.  I don't
think it's even that useful for larger databases.
Dan


On Fri, May 29, 2015 at 2:54 AM, Xingyu Na <asr...@gm...> wrote:
> Hi,
>
> I want to regularize the network by perturbing the parameters, not the
> samples.
> I found two components in nnet2, namely "DropoutComponent" and
> "AdditiveNoiseComponent", but they seem to work only in CPU training.
> There is also a "kDropout" in nnet1. In the egs scripts, the only
> utilization of dropout is in the
> utils/nnetc-cpu/make_nnet_config_preconditioned.pl, but not used in any
> recipe.
> Has anyone got a dropout or additive-noise recipe working, using GPU?
>
> Best,
> X.
>
> ------------------------------------------------------------------------------
> _______________________________________________
> Kaldi-users mailing list
> Kal...@li...
> https://lists.sourceforge.net/lists/listinfo/kaldi-users