Menu

#7 Zero tests run shows as failure

open
nobody
html report (2)
5
2012-03-08
2012-03-08
mwb
No

The codebase I work in has some Test Modules that have ignored tests. The percentage graphs for these Test Modules show all red and indicate a failure. I don't think these should be marked red or green because tests didn't fail or pass. Perhaps the bar could be yellow, orange, or blue to show no tests were run.

Discussion

  • Andreas Nyberg

    Andreas Nyberg - 2012-03-09

    Agreed, sounds like a good idea and probably not to much work to get in place. Thanks for the tip...

    R,
    Andreas

     
  • Andreas Nyberg

    Andreas Nyberg - 2012-03-20

    Ignored test case
    @Ignore
    @Test
    public ...

    <testcase time="0.095" classname="junittest.package1.subpackage1.TestClass4MultipleTestCasesIgnored" name="test_003">
    <skipped/>
    </testcase>

     
  • Andreas Nyberg

    Andreas Nyberg - 2012-03-20

    Entire class ignored, trickier. The class is identified as a single test case and hence is flagged as skipped. There is no way that all test case names can be fetched here.

    @Ignore
    public class TestClass2ClassIgnored {

    <testcase time="0.001" classname="junittest.package2.subpackage1.TestClass2ClassIgnored" name="junittest.package2.subpackage1.TestClass2ClassIgnored">
    <skipped/>
    </testcase>

     
  • Andreas Nyberg

    Andreas Nyberg - 2012-03-20

    TODO
    * Implement skipped as yellow everywhere in the reports
    * Updates statisstic calcualations
    ** Count percentages only based on passed / (passed+failed) ignoring any skipped test cases
    * All test case counts shall not include ignored test cases
    ** Ignored test cases shall be reported separatedly
    * Ignored tests shall not be included in any generated graphs

     
  • Andreas Nyberg

    Andreas Nyberg - 2012-03-20

    In class with one or more skipped test cases.

    <testsuite failures="1" time="0.383" errors="0" skipped="2" tests="4" name="junittest.package1.subpackage1.TestClass4MultipleTestCasesIgnored">

     

Log in to post a comment.

Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.