[Module::Build] [RFC] author tests

[Chris D. <ch...@cl...>]

I propose a new author test action for Module::Build.

There is a class of tests that module authors perform that end users  
are not expected to run.  For example code coverage tests, spelling  
tests, coding style tests, etc.  These tests are either prohibitively  
expensive or complicated or unpredictable for end users to run.  I  
call these "private tests" or author tests.  I discussed this concept  
on the Perl QA email list and on my blog:
   http://www.chrisdolan.net/talk/index.php/2005/11/14/private- 
regression-tests/

My personal practice has been to simply add these private tests to  
MANIFEST.SKIP.  However, it was pointed out to me on perl-qa that it  
would be better for accountability and reproducability if these were  
in the distro, but would not run by default under "make test" or  
"Build test"

Roughly, I propose that we adopt a standard file extension for author  
tests, like "t/*.ta", and add an ACTION_authortest to M::B that runs  
both t/*.t and t/*.ta (which ones first??)

For example, I would then rename my pod.t and pod-coverage.t to  
pod.ta and pod-coverage.ta and end users would not need to bothered  
running these non-essential tests.  Detailed end users, like CPANTS,  
could choose to run these or could simply acknowledge their existence  
(for Kwalitee).

I am not wed to the t/*.ta convention or the name of the ACTION.   
What do others think of the concept in general?

Chris
-- 
Chris Dolan, Software Developer, Clotho Advanced Media Inc.
608-294-7900, fax 294-7025, 1435 E Main St, Madison WI 53703
vCard: http://www.chrisdolan.net/ChrisDolan.vcf

Clotho Advanced Media, Inc. - Creators of MediaLandscape Software  
(http://www.media-landscape.com/) and partners in the revolutionary  
Croquet project (http://www.opencroquet.org/)