Hi,
Bernhard Held schrieb:
> The numbers in the regression test results are obviously mostly determined
> by the overhead. Therefore they are not very usefull when evaluating
> optimizations. I would love to see the numbers in the result minus the
> overhead. I'll supply the dummy tests and the correct mathematics, if
> somebody helps me with the python script "collate-results.py".
An intermediate solution could be to show the
diff of two consecutive regression test logs
in the snapshot page if (and only if:) the
diff returns 1.
[shameless advertising on]
"diff --unified=0" would look like:
--- regression-test-i386-unknown-linux2.3-20061109-4467.log 2006-11-10 10:48:21.000000000 +0100
+++ regression-test-i386-unknown-linux2.3-20061110-4470.log 2006-11-10 10:48:26.000000000 +0100
@@ -383 +383 @@
-Summary for 'mcs51': 0 failures, 4843 tests, 630 test cases, 881158 bytes, 64024092 ticks
+Summary for 'mcs51': 0 failures, 4843 tests, 630 test cases, 820806 bytes, 63074508 ticks
@@ -511 +511 @@
-Summary for 'mcs51-stack-auto': 0 failures, 4843 tests, 630 test cases, 998157 bytes, 69437808 ticks
+Summary for 'mcs51-stack-auto': 0 failures, 4843 tests, 630 test cases, 916618 bytes, 67340448 ticks
..
[shameless advertising off]
Greetings,
Frieder
|