sometimes the average loss starts out with value inf and then becomes a normal looking...
yes I was missing sth. I just needed to do mynewnet.subnet().subnet() = resnet.subnet().subnet()...
also trying to finetune (do transfer learning) by copying weights of resnet34. I...