Experimenting Cyclical Learning Rate.
Adding averaged weights to animal/machine experiment.
Adding experimental TNNetRandomAddMul .
Adding Weight Avg and Exponential Weight Avg.
Minor changes to the batch update experiment.
Reverting back to moving average.
Experimenting exponential weight average.
Adding TNNet.MulMulAddWeights
API testing.
Updating experiments.