Although training neural networks takes much more time
than retrieving a neural network from the Master, if
really a large set of Workers are available, the Master
(and/or Controller) might be become overloaded,
resulting in idle Workers which would be really wasteful.
I don't think this situation will occur fast, but in
the future maybe for big projects this situation might
occur.