[Refchecker-devel] Re: Benchmark suite (and some benchmarking framework).

[Thomas M. <ma...@ma...>]

OK, I just wrote a version of Russian Philosophers, and *man* do we need
optimizations! Admittedly Russian Philosophers isn't the smallest or
simplest system, but it still is more or less a toy example and the
minimum requirement of a checker such as RefChecker. And right now,
RefChecker is failing miserably.

I killed the version with three Russian philosophers thinking of three
dining philosophers after ~90 min. The version with 2 RP thinking of 2
DP is more  manageable, completing in ~10 secs. I don't have time to run
the 2RP/3DP right now, but I imagine quite a long running time for that
one. The performance degenerates *quickly*.

Maybe a hash function that doesn't map *every* state to the same value
would be a good place to start...

Anyway, I'll add the new models to the benchmark module, and stop making
benchmarks for now and concentrate on writing some documentation
instead.

	/mailund

-- 
When people say "I'm gonna kick your ass!", they never kick your ass,
they punch you in the face.