[Tcl-bugs] [ tcl-Feature Requests-623787 ] programmatic access to summary data

[SourceForge.net <no...@so...>]

Feature Requests item #623787, was opened at 2002-10-16 00:05
Message generated for change (Comment added) made by davidw
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=360894&aid=623787&group_id=10894

Category: 34. tcltest Package
Group: None
Status: Open
Resolution: None
Priority: 5
Submitted By: David N. Welton (davidw)
Assigned to: Don Porter (dgp)
Summary: programmatic access to summary data

Initial Comment:
If one is running *lots* of tests, it might be nice to
have an option to display the results in a different
way, like:

foo: pass
bar: fail
baz: pass
fcopy: pass

and so forth.

Maybe it would be better to give some sort of
programmatic interface to the summary information, such
as test name, result, desired result, test text, etc...
that way it would be possible to write ones own ways of
collecting the information.

----------------------------------------------------------------------

>Comment By: David N. Welton (davidw)
Date: 2003-11-10 16:57

Message:
Logged In: YES 
user_id=240

It wasn't ok with the previous upload. Let's try again and
compress it this time.

----------------------------------------------------------------------

Comment By: David N. Welton (davidw)
Date: 2003-11-10 16:53

Message:
Logged In: YES 
user_id=240

I have an initial cut at some changes.  They are pretty far
reaching, so before going any further, I would like to
submit them for people to have a look at.

Known failures:

1) One of the rename tests renames 'incr', which is used by
the new version of the test suite.

2) A few of the tests access the 'testConstraints' variable
directly.

There are probably other things, but I'd rather find out
sooner or later that some aspect of the direction I'm taking
needs reworking or abbandoning.

----------------------------------------------------------------------

Comment By: David N. Welton (davidw)
Date: 2003-08-30 16:12

Message:
Logged In: YES 
user_id=240

Upon looking through the code, it seems as if tcltest really
was designed as an application rather than a library. 
'puts', 'exit' and the like are used throughout.

----------------------------------------------------------------------

Comment By: Don Porter (dgp)
Date: 2003-06-27 19:17

Message:
Logged In: YES 
user_id=80530


Tcl Bugs 761334 and 761344
suggest other needs along these
lines.  Currently summary information
about the test suite is printed by
[cleanupTests], but the data that
makes up that report is not available.

Additional interfaces to access the
internal values like $numTests(Failed)
would allow for combining results
from multiple interps (the issue in
those bug reports) and would allow
for reporting the same data in
alternate formats, as requested here.

----------------------------------------------------------------------

Comment By: Don Porter (dgp)
Date: 2002-10-16 07:18

Message:
Logged In: YES 
user_id=80530

seems like the core of a good idea.
If you can flesh it out a bit (what
interface are you looking for, etc.)
we can get a TIP going on it.

----------------------------------------------------------------------

Comment By: David N. Welton (davidw)
Date: 2002-10-16 00:19

Message:
Logged In: YES 
user_id=240

I guess some of this is available, maybe another option to
verbose is enough to keep it from giving you more
information than just a plain 'fail'?

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=360894&aid=623787&group_id=10894