Re: [Dclib-devel] [dclib-devel] question about dropouts

[Davis K. <dav...@gm...>]

Try it and see.  It's probably not good.

On Sat, Dec 2, 2017 at 9:28 PM, Eloi Du Bois <elo...@gm...> wrote:

> Is there a particular reason not to set the weight to 1? I made my own
> ignore_dropout layer which basically takes a dropout as constructor and
> does nothing, but I'm not sure this is right.
> I'm guessing that after a big number of iterations, ignoring the dropouts
> should be right as the overall network should be trained equally.
>
> 2017-12-02 20:10 GMT-06:00 Davis King <dav...@gm...>:
>
>> It's setting the weights to 0.5.
>>
>> On Sat, Dec 2, 2017 at 8:42 PM, Eloi Du Bois <elo...@gm...>
>> wrote:
>>
>>> Additionnal question: if I replace the dropouts by a multiply layer, and
>>> then copying my network, is this setting the dropouts weights to 1 ? I
>>> mean, is it allowing me to use my full network's weights instead of
>>> cancelling some?
>>>
>>> Thanks,
>>>
>>> 2017-12-02 19:24 GMT-06:00 Eloi Du Bois <elo...@gm...>:
>>>
>>>> Ah ok !! That's actually good news, I was stuck at 80% of accuracy with
>>>> the dropouts, so now I should get something pretty nice.
>>>>
>>>> Many thanks!
>>>>
>>>> 2017-12-02 19:23 GMT-06:00 Davis King <dav...@gm...>:
>>>>
>>>>> The dropout layers always do dropout. So if you don't want them to do
>>>>> that then you have to replace them with something else, which is generally
>>>>> what you want to do.
>>>>>
>>>>> ------------------------------------------------------------
>>>>> ------------------
>>>>> Check out the vibrant tech community on one of the world's most
>>>>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>>>>> _______________________________________________
>>>>> Dclib-devel mailing list
>>>>> Dcl...@li...
>>>>> https://lists.sourceforge.net/lists/listinfo/dclib-devel
>>>>>
>>>>>
>>>>
>>>
>>> ------------------------------------------------------------
>>> ------------------
>>> Check out the vibrant tech community on one of the world's most
>>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>>> _______________________________________________
>>> Dclib-devel mailing list
>>> Dcl...@li...
>>> https://lists.sourceforge.net/lists/listinfo/dclib-devel
>>>
>>>
>>
>> ------------------------------------------------------------
>> ------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>> _______________________________________________
>> Dclib-devel mailing list
>> Dcl...@li...
>> https://lists.sourceforge.net/lists/listinfo/dclib-devel
>>
>>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Dclib-devel mailing list
> Dcl...@li...
> https://lists.sourceforge.net/lists/listinfo/dclib-devel
>
>