We've missed seeing some new regressions this week because we've had one build within the last week on all platforms that was either a complete failure or was missing (due to ramp up). Ramp up is perhaps a one-time cost, but having a badly sick build is something that will happen from time to time.
The "new regressions in the last week" report would probably be more useful as an early warning system if it ignored sick/missing builds when deciding whether or not a regression was new this week. For example, if a previous build had less than a 90% pass rate then it's failures would be ignored in determining whether or not the current build's failures were new or not.
Log in to post a comment.