Re: [Ocaml-lib-devel] test harness generator

[skaller <sk...@us...>]

On Thu, 2004-12-23 at 00:03, Janne Hellsten wrote:
> Hi John,

> 1. Create and build tests in some tmp build directory. 

Yeah, that makes sense.

> 2. Are you sure we need the .tst extension? 

Nope :)

The transformation tst -> ml is just the identity .. at the moment.

The idea was simply to distinguish the tests from other
support code eg util.ml.

>  I'd like to put all the 
> tests into a separate directory and just use .ml extension?  .ml is nice 
> so that Emacs automatically selects tuareg-mode

Ah, ok... I'm a Vim user :)

> 3. More thorough error checking and logging. 

That partly depends on also upgrading the util module.

> I understand there's not 
> much error checking since this is the first version.  Could you print 
> out the command line for each ocamlc call?

If enough people like the idea, I can just commit it,
then we can all change it as needed.

Clearly, to add extra management: statistics, options to
stop on error or not, or whatever, will require changes.
It doesn't generate native code either.

> 4. Filtering of test cases.  Could you make a command line option for 
> specifying what tests are included in the test? 

As an argument to the build of the mainline,
or an argument to the mainline? Or both?

> 5. Add some options for generating ocamlprofs out of the testing suite 
> and ExtLib?  Code coverage reports are really helpful when trying to 
> make the test suite more extensive.

Indeed.

> As for the near future.. Once 1&2 are done/agreed, I'd like to integrate 
> this into the suite.

The code I posted was mainly intended to be a demo of
the idea. 

-- 
John Skaller, mailto:sk...@us...
voice: 061-2-9660-0850, 
snail: PO BOX 401 Glebe NSW 2037 Australia
Checkout the Felix programming language http://felix.sf.net