I`m having a problem trying to add noise to a net. The messege i get is the following:
org.joone.engine.Synapse -  Cannot add noise because weight array is null.
However i'm having results different from zero:
Epoch;RMSE;d(index of agreement)
I was looking for into the souce code of joone engine, and i didn't find it. I downloaded the source code availeble from the joone page, exits any chance that the library code isn't the same from the source engine code?
ps: i would like to join to development team, plese tell me what i could do.
You need to first connect the synapse to both an input and output layer. This will then set the internals of the synapse, which, in this case, would be the dimensions of the weight array. Once that is done it should work.
Note that the weight array is randomised by default, so you don't have to do it manually actually.
The code used to build the net:
LinearLayer input = new LinearLayer("input");
TanhLayer hidden = new TanhLayer("hidden");
TanhLayer output = new TanhLayer("output");
FullSynapse input_hidden = new FullSynapse();
FullSynapse hidden_output = new FullSynapse();
NeuralNet red = new NeuralNet();
// <editor-fold desc="arquitectura" defaultstate="collapsed">
//conectando sinapsis de input -> hidden
//conectando sinapsis de hidden -> output
the code continues... file input & output configuration in the net.
The net is save in a serialized object, and then restore. I'm doing early stopping, cross-validation.
I'm having a very very sirious problem with overfitting and also the net is learning quickly... so during the validation when the difference between this epoch and the previous one is less than 0.03 i want to add some noise, and see what happens there. but i get the msg i wrote before.
I've sent you an email via your SourceForge about joining the development team.
Log in to post a comment.
Sign up for the SourceForge newsletter:
You seem to have CSS turned off.
Please don't fill out this field.