expected release date

prepping for cbench 1.2.1 release

add a status line at the end of generation

new job in the LAMMPS testset, rhodolong.scaled, which is a
work in progress

install lammps testset 'bench' directory, which all the
input decks and data files are referenced from, from
the explicitly version tracked openapps/lammps/bench
directory instead of the dynamic lammps tarball

when --customparse mode is enabled, keep a hash summarizing
the various matches (some of which will likely be repeated) and
print out a section with the summary information. For example:

Customparse Matches Summary:

'FORRTL: error 78, process killed via SIGTERM' => 4 matches
'OMPI says orterun killing job' => 15 matches
'SLURM JOB 975 NODE FAILURE' => 1 matches
'SLURM JOB WALLTIME EXCEEDED' => 16 matches

Simple utility script to remove output files from jobs
that had ERROR states so they no longer show up in output
parsing. The --force parameter must be given to actualy
delete anything:

Usage looks like:

bandwidth_output_parse.pl --ident ompi13-intel11 --diag --report | cbench_rm_failed_jobs.pl

For example:
[n280 cbench-test]$ cbench_output_parse.pl --meta --nodata --diag --report --custom | cbench_rm_failed_jobs.pl
Would remove: lammps/ompi13-intel11/lj.scaled-1ppn-1/slurm.o856
Would remove: lammps/ompi13-intel11/eam.scaled-1ppn-1/slurm.o854
Would remove: lammps/ompi13-intel11/eam.scaled-1ppn-2/slurm.o867
Would remove: lammps/ompi13-intel11/eam.scaled-1ppn-8/slurm.o888
Would remove: lammps/ompi13-intel11/lj.scaled-1ppn-9/slurm.o911
.
.
.

Otherwise the output looks like:
[n280 cbench-test]$ cbench_output_parse.pl --meta --nodata --diag --report --custom
..........**DIAG**(lammps/ompi13-intel11/lj.scaled-1ppn-1/slurm.o856) had a ERROR with status STARTED

**DIAG**(lammps/ompi13-intel11/eam.scaled-1ppn-1/slurm.o854) had a ERROR with status STARTED

**DIAG**(lammps/ompi13-intel11/eam.scaled-1ppn-2/slurm.o867) had a ERROR with status STARTED

.**DIAG**(lammps/ompi13-intel11/eam.scaled-1ppn-8/slurm.o888) had a ERROR with status STARTED

**DIAG**(lammps/ompi13-intel11/lj.scaled-1ppn-9/slurm.o911) had a ERROR with status STARTED

**DIAG**(lammps/ompi13-intel11/eam.scaled-1ppn-9/slurm.o912) had a ERROR with status STARTED
.
.
.

Since Slurm spools job stdout/stderr output continually into the
slurm.oNNNN files, the Cbench output parsing structure appears to have
phantom jobs that are in an ERROR state that later disappear. This
is because the output parser is looking at output from a live job.
Torque/PBS does not behave this way because the .oNNNN file does not
show up until the job has completed.

To deal with this intelligently, if cbench_output_parse.pl finds itself
parsing output files from Slurm batch jobs, it will call the slurm_query()
subroutine once to cache the state of Slurm jobs. Then if the parse
module for a job returns an ERROR status of some sort, the job is cross-
referenced against jobs known to be running in Slurm. If the job is
running according to the cached Slurm data, the job is flagged as RUNNING
and not as an error. For example, here is a snippet from an output parse
run with running jobs:

**DIAG**(lammps/ompi13-intel11/eam.scaled-4ppn-100/slurm.o1012) had ERROR with status STARTED

.**DIAG**(qcd/ompi13-intel11/qcd-4ppn-4/slurm.o1137) is still RUNNING

**DIAG**(cth/ompi13-intel11/amr3doblique-1ppn-1/slurm.o1037) had ERROR with status FATALERROR

**DIAG**(cth/ompi13-intel11/rsrl-1ppn-1/slurm.o1038) had ERROR with status STARTED
**PARSEMATCH**(cth/ompi13-intel11/rsrl-1ppn-1/slurm.o1038) => SLURM JOB WALLTIME EXCEEDED
**PARSEMATCH**(cth/ompi13-intel11/rsrl-1ppn-1/slurm.o1038) => OMPI says orterun killing job

**DIAG**(cth/ompi13-intel11/amr3doblique-4ppn-8/slurm.o1064) is still RUNNING

slurm_query() was updated a bit to cache Jobid data as well as job name.

look for 'Elapsed time' as the end of a sweep job.
the fortran stop looks to be compiler dependent as i
don't see it with intel 11.0

add --maxnodes, --minnodes, --nodes options

Change bonnie++ so the Makefile dynamically downloads and builds the program, similar to other Cbench tests

Get rid of "make[1]: *** No rule to make target `distclean'. Stop." errors by making distclean targets where none existed. All of the distclean targets just point to their clean target for now.

alias_spec() must return undef and not empty string
if it does not want to provide any aliases

added support for LLNL Sequoia message rate benchmark
named SQMR from the Phloem benchmarks

added a sqmr job to the BANDWIDTH testset

make the interactive mode JOBID generation more
resistant to collisions

bugfixes

adding Phloem MPI Benchmarks v1.0.0 from ASCI Sequoia
benchmarks. has mpiBench and mpiGraph and Presta among others

more tweaking on the stressful IOR job templates

catch the iostress and iosanity jobs as well

add distclean target

adding a job in the Shakedown testset to put IOR
stress on a filesystem

rename job templates to be more clear on what io load
they are creating

distclean target

IO testset:

• remove the Nto1 test case as a default job
• update NtoN test case params to mirror SWL setup which randy likes

IOSANITY testset:

• update params to mirror changes from IO NtoN case except for data scale

First pass at SWEEP3D output parsing

add iotest target to just make IO testing binaries

make the makefile smarter about configure

have stress print out how many procs it ran on

tokensmash rises again...

silence silly compiler warning about printf specifiers

change the msgrate reporting to be per rank

cruft

some bugfixes to handle mpi_request accounting better

add message rate stats

Add sweep3d installation and job generation trickery.

handle the case where open_and_slurp() attempts to
slurp a file that is too big to sanely parse more
gracefully

prototype code for the --usecache cache feature talked
about in ticket #13

this is not perfect yet and i think will always behave
a bit differently than the non-cached mode