Re: [Oorexx-users] Another bounce ...

[Mark M. <mie...@gm...>]

On Sun, Feb 16, 2014 at 2:09 AM, Bertram Moshier
<ber...@gm...>wrote:


> BTW, what am I doing wrong?  I'm not seeing completely consistent results
> between runs.  Sometime they are 100% consistent and other times they're
> not.
>

Bert,

The true intent here is to find* real bugs *in the interpreter.

Inconsistent results, that can be explained, can be ignored.  Out of over
five hundred thousand assertions, there are a few that are known to not be
100% consistent.

In most cases, in my opinion, it is better to keep the test then to drop it.

For example, the special folders tests will fail if you are running on a
non-Eglish language version of Windows.  Some event log tests fail if you
are on Vista or later and not running with Administrator privileges.  Some
sysCursor tests will fail if you redirect the output of the test to a file.

So when Walter from Austria writes me 3 times that 20 tests failed, and
every test was special folders test, it is not a real bug in the
interpreter.  So, it doesn't bother me.

It is better to keep the tests, because they some of the only tests that
test the OLEObject class, then to worry about them.  And, the tests work
fine for me.


>
> P.S. Is there a better way to pass the run results to you?
>

Don't write such long e-mails.  ;-)  Don't use the -s flag.  The only use
for that flag is if things are not running to completion.  If the entire
test suite finishes, there is no need for it.  Just report the results.

--
Mark Miesfeld