Implement a mainenance state which can be set w/o
interrupting the system and which finishes running
tests and then stops starting new test until the
maintenance flag is unset. This can be used for
software updates without affecting active tests. The
current maintenance state should be announced on the
frontend.