Re: [Firebird-test] FBT - firebird tests

[Tord H. <th...@ha...>]

Hi,

> I guess I'm a bit confused by the resistance of a database
> development project to using database technology.

The TCS needs a central database server which holds the global
test database. The local database file is (according to the
docs) only needed if the QA person needs to create a new test
and want do try something without screwing the main global
database.

Second I assume the majority of test runs in the borland QA
are tested against a test database server (remote). I dont
think the QA members installed an unstable version on there
workstations, when the TCS needs a database server to access
the test files.

Third maintaining the global test database is now impossible
with the current firebird structure. And no, I dont think
fetch from cvs, restore gdb, change test, backup gdb,
store to cvs is a reasonable way to create and maintain
tests.

Most people who want to help testing dont have multiple
computers or a client-server-setup like the QA office at
borland.

I have monitored the firebird progress since the first days
and in seven months only one (the generator test from FSG) 
test where added to the original TCS.

So there are NO scripts to test the new features of firebird.
NOBODY can test if the latest changes (e.g. metadata issues
from Pattrick Griffin, missing services entry fallback, 64 bit
io, 16k pages) workes, they can only test that the changes
dont break the old behavior.

And there are NO scripts to test the error fixes. The firebird
team (mainly Ann and Skywalker) have fixed a bunch of typing
error (like a == b insteed of a = b, or missing parentheses),
but there are no test scripts which failed before the fix
and pass now. So you just dont know if you fix it correctly
or screw up a side-effect of this typing error.

Last but not least, there are no test scripts which shows the
bug reports at Sourceforge. A metaseries SF_BUGS which
fails at current build but passes with firebird 1.0 would
be a very satisfied moment, wouldn't it.

For me this shows, that either nobody is willing to create
tests or nobody is able to create tests. I hope it's the
second one ;-)

Just thoughts,
Tord

Remark:
English is not my native language (hint: look at TLD), so
if some words sound insulting, it's only because these
words were the first ones in my dictionary <g>