Menu
▾
▴
[dacapobench-researchers] dacapo benchmarks failing validation
|
From: Muhammad U. F. <ema...@gm...> - 2009-12-23 17:17:29
|
Hi,
I'm running dacapo suite (dacapo-2006-10-MR2.jar) using Simics. I'm
simulating a Sun-Fire machine running Solaris 10. It has java version
"1.5.0_07". When I run dacapo, most of the benchmarks fail validation. They
seem to run till the end, but fail validation. Some of them pass as well.
Below is the run log for the benchmarks. The dacapo OOPSLA paper mention
that these benchmarks were run using a 'modified' Simics using Sun's HotSpot
JVM, v 1.5.0_07, running on a simulated Sun Ultra-5_10 with Solaris 9. Did
you see issue with validation?
Best,
Umar
===== DaCapo bloat starting =====
Optimized with: EDU.purdue.cs.bloat.optimize.Main -only
EDU.purdue.cs.bloat.tran
s -pre -dce -diva -prop -stack-alloc -peel-loops all -f
EDU.purdue.cs.bloat.tran
s.CompactArrayInitializer ./scratch/optimizedcode
Digest validation failed for stdout.log, expecting
0xfb2a1a7b07ee13b1bd0756c6fc7
c4d23b536c3e7 found 0x62381b3a5c996bf96e1bba0d8aec90b252df99ff
===== DaCapo bloat FAILED =====
Validation FAILED for bloat default
bash-3.00# java -jar dacapo-2006-10-MR2.jar chart
===== DaCapo chart starting =====
Java Accessibility Bridge for GNOME loaded.
Done plotting: ./scratch/javac-tgt-ptr-prf-time.pdf
Done plotting: ./scratch/javac-src-ptr-prf-time.pdf
Done plotting: ./scratch/javac-dst-ptr-prf-time.pdf
Done plotting: ./scratch/javac-tgt-mut-prf-time.pdf
Done plotting: ./scratch/javac-src-mut-prf-time.pdf
Done plotting: ./scratch/javac-dst-mut-prf-time.pdf
Done plotting: ./scratch/javac-heap-comp-b.pdf
Done plotting: ./scratch/javac-heap-comp-a.pdf
Done plotting: ./scratch/javac-tgt-ptr-inf-time.pdf
Done plotting: ./scratch/javac-src-ptr-inf-time.pdf
Done plotting: ./scratch/javac-dst-ptr-inf-time.pdf
Done plotting: ./scratch/javac-tgt-mut-inf-time.pdf
Done plotting: ./scratch/javac-src-mut-inf-time.pdf
Done plotting: ./scratch/javac-dst-mut-inf-time.pdf
Digest validation failed for stdout.log, expecting
0xb13dc34c376563cb0ba0f9ef598
9e9b128f5fbae found 0xc0826239beb23a00c7e0be3a0214e938e679c6d0
Digest validation failed for stderr.log, expecting
0xda39a3ee5e6b4b0d3255bfef956
01890afd80709 found 0x4bf6ae8cded86f4350fe4cf6e2b6cfb0f958a056
===== DaCapo chart FAILED =====
Validation FAILED for chart default
bash-3.00# java -jar dacapo-2006-10-MR2.jar fop
===== DaCapo fop starting =====
===== DaCapo fop PASSED in 42587 msec =====
bash-3.00# java -jar dacapo-2006-10-MR2.jar jython
===== DaCapo jython starting =====
-------------------------------------------------------------------------------
PYBENCH 2.0
-------------------------------------------------------------------------------
* using Python 2.2a1
* Python version doesn't support garbage collection
* system check interval set to maximum: 2147483647
* using timer: time.timeRunning 1 round(s) of the suite at warp factor 20:
* Round 1 done in 253.170 seconds.
-------------------------------------------------------------------------------
Benchmark: 2002-06-03 19:49:54
-------------------------------------------------------------------------------
Rounds: 1
Warp: 20
Timer: time.time
Test minimum average operation overhead
-------------------------------------------------------------------------------
BuiltinFunctionCalls: 2449ms 2449ms 9.60us 0.000ms
BuiltinMethodLookup: 7954ms 7954ms 15.15us 0.000ms
CompareFloats: 3624ms 3624ms 6.04us 0.000ms
CompareFloatsIntegers: 2752ms 2752ms 6.12us 0.000ms
CompareIntegers: 5075ms 5075ms 5.64us 0.000ms
CompareInternedStrings: 8148ms 8148ms 10.86us 0.000ms
CompareLongs: 3173ms 3173ms 6.04us 0.000ms
CompareStrings: 3868ms 3868ms 7.74us 0.000ms
CompareUnicode: 2983ms 2983ms 7.95us 0.000ms
ConcatStrings: 7859ms 7859ms 31.44us 0.000ms
ConcatUnicode: 4772ms 4772ms 31.81us 0.000ms
CreateInstances: 3756ms 3756ms 67.07us 0.000ms
CreateNewInstances: 7836ms 7836ms 186.57us 0.000ms
CreateStringsWithConcat: 6883ms 6883ms 13.77us 0.000ms
CreateUnicodeWithConcat: 2867ms 2867ms 14.33us 0.000ms
DictCreation: 3410ms 3410ms 17.05us 0.000ms
DictWithFloatKeys: 6480ms 6480ms 14.40us 0.000ms
DictWithIntegerKeys: 5454ms 5454ms 9.09us 0.000ms
DictWithStringKeys: 3401ms 3401ms 5.67us 0.000ms
ForLoops: 3840ms 3840ms 307.20us 0.000ms
IfThenElse: 5061ms 5061ms 7.50us 0.000ms
ListSlicing: 1692ms 1692ms 241.71us 0.000ms
NestedForLoops: 2873ms 2873ms 3.83us 0.000ms
NormalClassAttribute: 6515ms 6515ms 10.86us 0.000ms
NormalInstanceAttribute: 6368ms 6368ms 10.61us 0.000ms
PythonFunctionCalls: 3991ms 3991ms 24.19us 0.000ms
PythonMethodCalls: 6059ms 6059ms 53.86us 0.000ms
Recursion: 5129ms 5129ms 205.16us
0.000ms SecondImport: 3770ms 3770ms 75.40us
0.000ms
SecondPackageImport: 3731ms 3731ms 74.62us 0.000ms
SecondSubmoduleImport: 5255ms 5255ms 105.10us 0.000ms
SimpleComplexArithmetic: 3616ms 3616ms 8.22us 0.000ms
SimpleDictManipulation: 4698ms 4698ms 7.83us 0.000ms
SimpleFloatArithmetic: 4559ms 4559ms 6.91us 0.000ms
SimpleIntFloatArithmetic: 4580ms 4580ms 6.94us 0.000ms
SimpleIntegerArithmetic: 4504ms 4504ms 6.82us 0.000ms
SimpleListManipulation: 3677ms 3677ms 6.29us 0.000ms
SimpleLongArithmetic: 4591ms 4591ms 13.91us 0.000ms
SmallLists: 4807ms 4807ms 14.14us 0.000ms
SmallTuples: 6863ms 6863ms 25.42us 0.000ms
SpecialClassAttribute: 6403ms 6403ms 10.67us 0.000ms
SpecialInstanceAttribute: 6332ms 6332ms 10.55us 0.000ms
StringMappings: 13373ms 13373ms 106.13us 0.000ms
StringPredicates: 6588ms 6588ms 18.82us 0.000ms
StringSlicing: 2847ms 2847ms 10.17us 0.000ms
TryExcept: 1344ms 1344ms 1.19us 0.000ms
TryRaiseExcept: 9155ms 9155ms 286.09us 0.000ms
TupleSlicing: 2965ms 2965ms 22.59us 0.000ms
UnicodeMappings: 7295ms 7295ms 405.28us 0.000ms
UnicodePredicates: 5461ms 5461ms 20.23us 0.000ms
UnicodeSlicing: 2484ms 2484ms 10.14us 0.000ms
-------------------------------------------------------------------------------
Totals: 253170ms 253170ms
===== DaCapo jython PASSED in 275254 msec =====
bash-3.00# java -jar dacapo-2006-10-MR2.jar -s small xalan
===== DaCapo xalan starting =====
Normal completion.
Digest validation failed for stdout.log, expecting
0xd31deba48b76595f822b43217af
efd6fec3aefb9 found 0x02271e9a1b30be8841d0e56f9c293c7736f0cf66
===== DaCapo xalan FAILED =====
Validation FAILED for xalan small
bash-3.00# java -jar dacapo-2006-10-MR2.jar -s small luindex
===== DaCapo luindex starting =====
adding luindex/william/poetry/loverscomplaint
adding luindex/william/poetry/rapeoflucrece24ec773301388 found
0x18bd5ddde3affec5aaa6bf303950091794c43858
===== DaCapo luindex FAILED =====
Validation FAILED for luindex small
bash-3.00# java -jar dacapo-2006-10-MR2.jar -s small lusearch
===== DaCapo lusearch starting =====
4 query batches completed
Digest validation failed for stdout.log, expecting
0x7f2910f4b0f73a6bcbf677e77b3
d99e48f6932ae found 0xd78a814061ddc2919bc45ca959f54dc0ba96b518
===== DaCapo lusearch FAILED =====
Validation FAILED for lusearch small
|