JPerf is a simple framework for writing and running automated performance and scalability tests. It's like JUnit but for performance. Simple write a class that implements PerfTest then create a PerfTestRunner instance to run the test.
JPerf has moved! The latest releases are now available from github.
https://github.com/andygrove/jperf