Re: [Firebird-test] Fb250

[Mark O'D. <mar...@gm...>]

Hi Philippe

On 16/12/08 02:20, Philippe Makowski wrote:
> Hi all,
>
> I committed today new version of tests to avoid false fail related to the change from
> SQLCODE to SQLSTATE.
>
> Results are more clean now for 2.5, there is still some cleaning to do, but for I now I
> prefer to let them, at least to not hide changes that occurred with new ods, new functions ...
>
> with the new version there is still 41 FAIL on 625 tests under Windows, but that's really
> better than before the cleaning ;)
> At least results can be exploited now without too much noise with false fail.
>


Just for comparison, I have updated my copy to the latest svn copy and
running on linux, and running the two sets separately I get:

functional:
--- STATISTICS ----------------------------------------

      490        tests total
        1 (  0%) tests ERROR
       51 ( 10%) tests FAIL
      438 ( 89%) tests PASS



For the bugs subset :
--- STATISTICS ----------------------------------------

      139        tests total
       12 (  9%) tests ERROR
       21 ( 15%) tests FAIL
      106 ( 76%) tests PASS


I am yet to look into the fails, but two I did seemed cases where the 
result comparison set needed to be updated.

I will also try and run the older TCS suite.

Cheers - Mark