How about the idea of putting Annotation support into
rules such that, for example, you could disable a
particular check for a section of code with either an
@SuppressWarning or similar?
It would mean, probably, different builds for Java 5, but
it'd be well worth it.
I'd guess that each Check would need to test for its
Annotation in code when assessing it - unless you
could put the test into a base class or configuration.
It's the equivalent of the developer saying "I'm breaking a
rule here - but I have a good reason"