Re: [Dclib-devel] [dclib-devel] question about dropouts

[Eloi Du B. <elo...@gm...>]

Is there a particular reason not to set the weight to 1? I made my own
ignore_dropout layer which basically takes a dropout as constructor and
does nothing, but I'm not sure this is right.
I'm guessing that after a big number of iterations, ignoring the dropouts
should be right as the overall network should be trained equally.

2017-12-02 20:10 GMT-06:00 Davis King <dav...@gm...>:

> It's setting the weights to 0.5.
>
> On Sat, Dec 2, 2017 at 8:42 PM, Eloi Du Bois <elo...@gm...>
> wrote:
>
>> Additionnal question: if I replace the dropouts by a multiply layer, and
>> then copying my network, is this setting the dropouts weights to 1 ? I
>> mean, is it allowing me to use my full network's weights instead of
>> cancelling some?
>>
>> Thanks,
>>
>> 2017-12-02 19:24 GMT-06:00 Eloi Du Bois <elo...@gm...>:
>>
>>> Ah ok !! That's actually good news, I was stuck at 80% of accuracy with
>>> the dropouts, so now I should get something pretty nice.
>>>
>>> Many thanks!
>>>
>>> 2017-12-02 19:23 GMT-06:00 Davis King <dav...@gm...>:
>>>
>>>> The dropout layers always do dropout. So if you don't want them to do
>>>> that then you have to replace them with something else, which is generally
>>>> what you want to do.
>>>>
>>>> ------------------------------------------------------------
>>>> ------------------
>>>> Check out the vibrant tech community on one of the world's most
>>>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>>>> _______________________________________________
>>>> Dclib-devel mailing list
>>>> Dcl...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/dclib-devel
>>>>
>>>>
>>>
>>
>> ------------------------------------------------------------
>> ------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>> _______________________________________________
>> Dclib-devel mailing list
>> Dcl...@li...
>> https://lists.sourceforge.net/lists/listinfo/dclib-devel
>>
>>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Dclib-devel mailing list
> Dcl...@li...
> https://lists.sourceforge.net/lists/listinfo/dclib-devel
>
>