Experimenting exponential weight average.
Adding TNNet.MulMulAddWeights
API testing.
Updating experiments.
Updating batch update experiment.
Experimenting averaged weights.
Very small full connect relu backprop optimization.
Bug fixing animal machine experiment.
Speeding up depthwise backprop.
Speeding up Pointwise backprop.