firebird-test — Firebird engine testing, test flight/suite discussion/information

Re: [Firebird-test] Please try this new test

[<Sch...@t-...>]

"Patrick J. P. Griffin" schrieb:
> 
> Hello!
> 
> I've been contemplating a potential bug in jrd/cmp.c
> 
> If you can, would you please enter the test shown below and see if you get
> the correct results.
> ...pat

Passed :-)

On a firebird Superserver build on Linux from yesterday.

Frank


-- 
"Fascinating creature, phoenixes, They can carry immensely heavy loads,
 their tears have healing powers and they make highly faithful pets."  
         - J.K. Rowling

[Firebird-test] Please try this new test

[Patrick J. P. G. <Pat...@wo...>]

Hello!

I've been contemplating a potential bug in jrd/cmp.c

If you can, would you please enter the test shown below and see if you get
the correct results.
...pat

/*
**  Name:		genid_arguments_01
**  Series:		cf_isql
**  Meta-Series:
**  Dependencies:	None
**  Description:	This test is a test for the proper handling of gen_id
arguments
**
**			This test calls gen_id with a computed field as an argument.
**
**  Expected result:	see comments in isql coding below
**
**  Author:		Patrick J. P. Griffin based on cf_isql_10 by Ravil A. Desai
**  Bugs:
**  Change history:
**
*/

$ CREATE cf_test.sql
create database "WHERE_GDB:cf.gdb";

create generator gen1;
set generator gen1 to 999;
show generator gen1;

create generator gen2;
set generator gen2 to 199;
show generator gen2;

create generator gen3;
set generator gen3 to 29;
show generator gen3;

create table t0 (
	a integer,
	genid_field1 computed by (gen_id(gen1, 1)),
	genid_field2 computed by (gen_id(gen2, genid_field1)),
	genid_field3 computed by (gen_id(gen3, genid_field2))
);

show table t0;
insert into t0(a) values(4);
insert into t0(a) values(1);

/* first row:
   a:  4
   genid_field3:=genid3+(genid2+(genid1+1))
               :=29+(199+(999+1)
               :=29+(199+1000)
               :=29+1199
               :=1228
   second row:
   a: 1
   genid_field3:=genid3+(genid2+(genid1+1))
               :=1228+(1199+(1000+1)
               :=1228+(1199+1001)
               :=1228+(2200)
               :=3428
*/
select a,genid_field3 from t0;

/* first row:
   a:  4
   genid_field3:=genid3+(genid2+(genid1+1))
               :=3428+(2200+(1001+1)
               :=3428+(2200+1002)
               :=3429+3202
               :=6630
   genid_field2:=genid2+(genid1+1)
               :=3202+(1002+1)
               :=3202+1003
               :=4205
   genid_field1:=genid1+1
               :=1003+1
               :=1004

   second row:
   a:  1
   genid_field3:=genid3+(genid2+(genid1+1))
               :=6630+(4205+(1004+1))
               :=6630+(4205+1005)
               :=6630+5210
               :=11840
   genid_field2:=genid2+(genid1+1)
               :=5210+(1005+1)
               :=5210+1006
               :=6216
   genid_field1:=genid1+1
               :=1006+1
               :=1007
*/

select * from t0;

exit;

$ ISQL -e -m -input cf_test.sql
$ DELETE cf_test.sql
$ RUN drop_gdb WHERE_GDB:cf.gdb

[Firebird-test] TCS

[<Sch...@t-...>]

Hi all,

it seems that I have finally got a usable TCS.
The Firebird build from today finished the VECTOR_12HOUR test
without failures.
I would like to upload the updated gtcs.gdb and some comments
on how to use the TCS on the firebird ftp-space.
I would appreciate it if someone would want to try it
before it goes public.
Any volunteers, comments? 

Frank 

-- 
"Fascinating creature, phoenixes, They can carry immensely heavy loads,
 their tears have healing powers and they make highly faithful pets."  
         - J.K. Rowling

Re: [Firebird-test] New ib-tests

[Mark O'D. <mar...@lu...>]

Re: Tests et al.

> Slightly more complicated than you might expect I don't have a working
> copy of InterBase on my machine.  I'll fix that this afternoon and
> have a good look.
>

Thanks..

Hmm its about 3.30am I should probably be emailing Helen about now, since
we seem to have most of our conversations at this time ;-).

Bye

Mark

Re: [Firebird-test] New ib-tests

[Ann H. <har...@ne...>]

>
>As someone with previous exposure to IB test scripts.  I was wondering
>if you have any idea how complete the test suite that Inprise have
>released is in  ib-tests?

Slightly more complicated than you might expect I don't have a working
copy of InterBase on my machine.  I'll fix that this afternoon and
have a good look.

Ann

[Firebird-test] New ib-tests

[Mark O'D. <mar...@lu...>]

Hi Ann

As someone with previous exposure to IB test scripts.  I was wondering
if you have any idea how complete the test suite that Inprise have
released is in  ib-tests?


For a quick look you can visually walk through the tree with your
browser
from:

http://cvs.sourceforge.net/cgi-bin/cvsweb.cgi/?cvsroot=ib-tests


Cheers

Mark

Re: [Firebird-test] I feel like an idiot (BTW, you don't need to agree with me <g>)

[Mark O'D. <mar...@lu...>]

Hi Sean

"Leyne, Sean" wrote:

> I went up to the Borland Test suite project and noted that some items
> have been added to the project, so of course I wanted to have a look but
> I don't have a copy of CVS and have never used same.
>

For a quick look you can visually walk through the tree with your browser
from:

http://cvs.sourceforge.net/cgi-bin/cvsweb.cgi/?cvsroot=ib-tests

To get your own local copy, see (our quick doco) at:

http://sourceforge.net/docman/?group_id=9028

On cvs usage, it also has some pointers to the sourceforge documentation
at:

http://sourceforge.net/docman/?group_id=1

Where they have their own cvs howto, which explains were to get it etc.

Let me know how you get on (I've just finished downloading MY copy ;-).


Cheers

Mark

[Firebird-test] I feel like an idiot (BTW, you don't need to agree with me <g>)

[Leyne, S. <sl...@at...>]

I went up to the Borland Test suite project and noted that some items
have been added to the project, so of course I wanted to have a look but
I don't have a copy of CVS and have never used same.

Can someone direct me to a location where I can download a version of
CVS (preferably one with a Windows GUI interface).

Sean

Re: [Firebird-test] Some important news/reading regarding test suites

[Mark O'D. <mar...@lu...>]

"Leyne, Sean" wrote:

> Mark,
>
> Not that I want to dull your enthusiasm, but can I suggest that we wait
> and see the test suites to be released by Dale and crew (or should that
> be Rob Schieck and crew...)
>
> Or are you suggesting that the current test model is a load of horse
> s**t and deserves the boot?
>
> I'd personally like to see what's will be available before getting hot
> and heavy about writing new stuff.
>

I agree, I'd like to see whats on offer, and there was also a line about
releasing some documentation as well.

Im not going to travel too hard on the test suite, and will probably tie up
a linux build this weekend.

I expect that they'll release something way before I get finished, but
I feel it will be incomplete and the NIST thing will give us a fresh
perspective from an SQL compliance point of view, find some new bugs and
give some insight on running automated test suites in a variety of
environments.  So Im not going to completely stop either.

I presume we will at least run what they give us.

Cheers

Mark

RE: [Firebird-test] Some important news/reading regarding test su ites

[Leyne, S. <sl...@at...>]

Mark,

Not that I want to dull your enthusiasm, but can I suggest that we wait
and see the test suites to be released by Dale and crew (or should that
be Rob Schieck and crew...)

Or are you suggesting that the current test model is a load of horse
s**t and deserves the boot?

I'd personally like to see what's will be available before getting hot
and heavy about writing new stuff.  

I expect there will be community acceptance issues if we arbitrarily
create a new test suite without being able to justify the change. The
existing test suite (even if poorly implemented) will be the "gold
standard" for a while.  It would take some time before the new suite
could garner any credibility.

(At some point I'd like someone to explain how a "certification" test
can take over a month to run? -- As alluded to in other
postings/lists/messages)


Sean

-----Original Message-----
From: Mark O'Donohue [mailto:mar...@lu...]
Sent: Thursday, September 14, 2000 9:32 AM
To: fir...@li...
Subject: Re: [Firebird-test] Some important news/reading regarding test
suites



Hi Guys (and Girl)

I think I will finally be able to get my linux boxes back on the
internet, either by the end of this week or early next week.  THEN I can
resume doing the NIST test suite thing.

Sorry about the delay,

Cheers

Mark



_______________________________________________
Firebird-test mailing list
Fir...@li...
http://lists.sourceforge.net/mailman/listinfo/firebird-test

Re: [Firebird-test] Some important news/reading regarding test suites

[Mark O'D. <mar...@lu...>]

Hi Guys (and Girl)

I think I will finally be able to get my linux boxes back on the
internet, either by the end of this week or early next week.  THEN I can
resume doing the NIST test suite thing.

Sorry about the delay,

Cheers

Mark

RE: [Firebird-test] Some important news/reading regarding test su ites

[Leyne, S. <sl...@at...>]

I heard through the grapevine that Rob was, at the very least, running
training courses for the new IB support staff.


Sean

-----Original Message-----
From: Mark O'Donohue [mailto:mar...@lu...]
Sent: Sunday, September 10, 2000 10:11 AM
To: fir...@li...;
fir...@li...
Subject: Re: [Firebird-test] Some important news/reading regarding test
suites



Hi

Thanks Sean

"Leyne, Sean" wrote:

> http://www.borland.com/interbase/letter.html

Well it seems we get something to test with.

>We will also make a series of test suites available to the
>community for developers to check code against before submitting it to
>the tree for review. Please look for the IBTests project to be active
in the
>next few days on http://sourceforge.net/projects/ib-tests.


But not the whole QA suite:

>Due to the nature of the open source license, other entities are
empowered
>to certify their own versions of InterBase. In support of this,
>Inprise/Borland is evaluating how to license a meaningful assortment of

>QA test suites to members of the community. We will also be evaluating
>the use of copyrights and registered trademarks owned by
Inprise/Borland
>relative to the InterBase name. We are working to make all important
>decisions as quickly as possible and will post information as it
becomes
>available.

So it seems like they still want to retain the complete QA suite and
licence it.

I'd be interested to hear Ann's perspective on what ibphoenix intend to
do with regards to licencing the test suite ( I know your busy Ann :-) ,
as we all are at the moment.

At least they are talking.

In the back of my mind I have this wild theory that Rob (Mers Rob) is
working on the test suites :-)  It's a wild idea/guess on my part,  with
no substance, but I have wondered what all the "you don't know what he's
doing" "under an NDA" and "regularly in contact with Rebecca" stuff that
has followed him recently has been about.

Anyway, I suppose this is part of the "clarification" phase.  Where
Inprise lay out their grand vision and tell us where they are heading.
Once that is done then I suppose we start having some contact with them
technical and otherwise, and see if we can work together.

When I get back I'll keep on the test suites from NIST., it's nice that
they have come out of their cellar, but I don't see any reason yet to
stop me working on the test suite.

Cheers

Mark



_______________________________________________
Firebird-test mailing list
Fir...@li...
http://lists.sourceforge.net/mailman/listinfo/firebird-test

Re: [Firebird-test] Some important news/reading regarding test suites

[Mark O'D. <mar...@lu...>]

Hi

Thanks Sean

"Leyne, Sean" wrote:

> http://www.borland.com/interbase/letter.html

Well it seems we get something to test with.

>We will also make a series of test suites available to the
>community for developers to check code against before submitting it to
>the tree for review. Please look for the IBTests project to be active
in the
>next few days on http://sourceforge.net/projects/ib-tests.


But not the whole QA suite:

>Due to the nature of the open source license, other entities are
empowered
>to certify their own versions of InterBase. In support of this,
>Inprise/Borland is evaluating how to license a meaningful assortment of

>QA test suites to members of the community. We will also be evaluating
>the use of copyrights and registered trademarks owned by
Inprise/Borland
>relative to the InterBase name. We are working to make all important
>decisions as quickly as possible and will post information as it
becomes
>available.

So it seems like they still want to retain the complete QA suite and
licence it.

I'd be interested to hear Ann's perspective on what ibphoenix intend to
do with regards to licencing the test suite ( I know your busy Ann :-) ,
as we all are at the moment.

At least they are talking.

In the back of my mind I have this wild theory that Rob (Mers Rob) is
working on the test suites :-)  It's a wild idea/guess on my part,  with
no substance, but I have wondered what all the "you don't know what he's
doing" "under an NDA" and "regularly in contact with Rebecca" stuff that
has followed him recently has been about.

Anyway, I suppose this is part of the "clarification" phase.  Where
Inprise lay out their grand vision and tell us where they are heading.
Once that is done then I suppose we start having some contact with them
technical and otherwise, and see if we can work together.

When I get back I'll keep on the test suites from NIST., it's nice that
they have come out of their cellar, but I don't see any reason yet to
stop me working on the test suite.

Cheers

Mark

[Firebird-test] Some important news/reading regarding test suites

[Leyne, S. <sl...@at...>]

http://www.borland.com/interbase/letter.html

[Firebird-test] RE: ISC/TCS

[Leyne, S. <sl...@at...>]

Ann,

I found your posting interesting...

I was wondering, though, if you had any suggestions as to were do we go
from here?

I don't know if you've heard anything regarding Inprise's plans
regarding TCS.  However, failing them seeing "the error of their ways"
(If that's something that is possible for them to do -- would require a
degree of customer awareness that they haven't shown so far) it would
seem that a strong testing system would need to be in place before any
substantial source changes are undertaken.

Accordingly, I feel that we need to have a 10,000 foot overview of the
scope and breath of the "old" testing system.  Can you suggest who could
provide this information?

I'm afraid that we will (me included) get lost in the details and miss
most of the big picture.


Sean

> -----Original Message-----
> From: Ann Harrison [mailto:har...@ne...]
> Sent: Tuesday, September 05, 2000 4:37 PM
> To: int...@me...
> Subject: RE: ISC/TCS
> 
> 
> Here's my understanding of what ISC planned to do with
> the test system.
> 
>  From the beginning, we planned to release the code that
> runs the test system as part of the sources.   This is
> the test control program, not the scripts, templates, etc.
> That's what was in my list.
> 
>  From the beginning, we expected to produce "certified"
> kits - kits that had been through our testing process.
> That supposes that we have some testing process that is
> of some value.
> 
>  From early on (after a discussion with Dave Schnepper) we
> intended to release at least some of the test scripts as
> part of the open source project.
> 
>  From before the beginning, we were aware that the overall
> state of the test system was appalling. Certification took
> months, mostly documenting the failure of broken tests.
> The set of tests called "vectors" that engineering ran
> nightly are reliable.
> 
> Here it gets hard to be absolutely accurate.  I think we
> would have heard the feedback from the open source community
> and released all of the vector tests.  We didn't get to that
> point, so I don't know for a certainty what we would have
> done.
> 
> Regards,
> 
> Ann
> 
> 
> 
> 
> 
> _______________________________________________
> Interbase mailing list
> Int...@me...
> http://mers.com/mailman/listinfo/interbase
> 

[Firebird-test] Hi test team

[Mark O'D. <mar...@lu...>]

Hi Test Team

I've managed to script the first couple of schema creates from the
NIST test suite.  Im just using basic shell scripts which you can also
run on a PC using cygwin32 to walk through them at the moment.

The first couple were slow, since I needed to work out some things (like
piping the SQL through a small filter to get rid of lines starting with
"--".

Nothing dramatic to report, the things we fail on are features we dont
have in Firebird/Interbase so far.

I'll be out of action for the next two days, believe it or not Im going
to sydney to start setting up some performance testing.  This is
entirely fortuitious, I have rarely got into testing this heavily.
Anyway this is a loadrunner thing against the web logon page for
Australias biggest teleco company.

You can see how slow their existing one is currently (www.telstra.com)
if your really keen.  All I need is a ticket to the Olympics.


Cheers

Mark