File	Date	Author	Commit
.gitignore	2010-10-29	Ian Hinder	[8ea0cd] Add .gitignore file
Llama.CTGamma.ET.CarpetHG.th	2011-06-06	Ian Hinder	[fd54a9] Fix thornlists
Llama.CTGamma.ET.th	2011-06-06	Ian Hinder	[fd54a9] Fix thornlists
README	2010-10-29	Ian Hinder	[fb4401] Add README file
WaveToy.th	2011-09-26	Ian Hinder	[53e187] Update thornlists for Python simfactory
aei-testsuites	2012-01-27	Ian Hinder	[1121d6] aei-testsuites: Get thornlist from the web don'...
einsteintoolkit.CarpetGit.th	2011-09-27	Ian Hinder	[4c9561] Rename thornlist files
notes.txt	2011-06-15	Ian Hinder	[2436b2] Add to notes
report-tests	2011-08-26	Ian Hinder	[f2724d] report-tests: Use delta instead of hand symbol ...
style.css	2010-11-03	Ian Hinder	[29c502] More work on 1 and 2 proc tests
testsuites	2011-11-09	Ian Hinder	[8c4ad4] testsuites: Use default thornlist

Read Me

testsuites
==========

This is a collection of scripts to perform automated build-and-test
for Cactus, providing an HTML view of the history of test passes and
fails.  As much information as possible about the reason for test
failures is presented in the HTML view, and the layout is designed to
make it easy to see when a particular test stopped working.

Usage
=====

1. Check out the testsuites package to a location in your home directory

2. Copy whatever thornlists you want to test into the directory

3. Copy and modify the aei-testsuites file as appropriate

4. Edit your crontab file and run your new file nightly

5. Monitor the testsuite results from the web

Components
==========

testsuites [-t <testoutputdir> -w <weboutputdir>] <thornlist1> <thornlist2> ...

        This script is the core of the system. Each thornlist given on
        the command line will be checked out, build and tested, and
        the results summarised in an HTML file.

        A directory named after each thornlist is created in
        testoutputdir, and inside that another directory named after
        the current date and time is created.  In this directory, the
        source will be checked out using GetComponents and built using
        SimFactory.  The tests will then be run using the normal
        Cactus "make" mechanism.  Once the tests have finished
        running, the report-results script (described below) scans the
        test output and generates an HTML summary in weboutputdir.

        testoutputdir and weboutputdir default to the current
        directory, which is almost certainly not what you want.
        
        Examples:

                testsuites einsteintoolkit.th
                
                testsuites -t /local/user/tests -w /home/user/public_html/tests \
		  einsteintoolkit.th

		testsuites einsteintoolkit.th ComputationalToolkit.th

	The thornlists must be local files; http locations are not currently
	supported.

report-tests <testdir> <webdir>

        This script generates the HTML summary of the tests.  It scans
	all the configurations in testdir and all the test directories
	under it and writes the HTML summary ito webdir.  Each element
	of the page is a hyperlink wherever possible to some useful
	information about the test.