firebird-test — Firebird engine testing, test flight/suite discussion/information

Re: [Firebird-test] [FB-Tracker] Commented: (CORE-3077) /etc/init.d/firebird script stops firebird with fbmgr and password

[Gili's H. <gil...@ho...>]

Hi
Thanks for your response.
The default is a SIGTERM(15) signal and firebird exists fine.
The problem with current method is:
a) fbmgr -shut runs with sysdba masterkey hard coded. This causes an error after you change sysdba's password.
b) Our service that comes at startup(reboot) stops and starts firebird to make sure all old connections are removed.
This caused fbserver to crash and not come up until I've replaced security2.fdb with a default one.
Thanks
-gili

-----Original Message-----
From: Alexander Peshkov (JIRA) [mailto:tr...@fi...] 
Sent: Wednesday, July 21, 2010 10:27 AM
To: gil...@ho...
Subject: [FB-Tracker] Commented: (CORE-3077) /etc/init.d/firebird script stops firebird with fbmgr and password


    [ http://tracker.firebirdsql.org/browse/CORE-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=21380#action_21380 ] 

Alexander Peshkov commented on CORE-3077:
-----------------------------------------

If you do not need multiple instances - our method is OK. Moreover - you need not kill guardian explicitly. Firebird 2.1 is processing signal 15 (I suppose it's send by pkill by default ?) and exits nornally, after which guardian also exits. Please check this to make sure signal is processed correctly. If not - you are in danger of corrupting databases when server is killed by unprocessed signal.

> /etc/init.d/firebird script stops firebird with fbmgr and password
> ------------------------------------------------------------------
>
>                 Key: CORE-3077
>                 URL: http://tracker.firebirdsql.org/browse/CORE-3077
>             Project: Firebird Core
>          Issue Type: Bug
>    Affects Versions: 2.1.1
>         Environment: solaris x86
>            Reporter: Gili Buzaglo
>         Attachments: firebird
>
>
> Scenario is as follows:
> 1) change password for sysdba using gsec
> 2) perform /etc/init.d/firebird stop
> It does not stop the firebird correctly since it uses hard coded(in script) masterkey password.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://tracker.firebirdsql.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Re: [Firebird-test] [FB-Tracker] Commented: (CORE-3053) Firebird stops responding, required restart to get going again. Related to process shutdown code

[Neil P. <nei...@cs...>]

I'll try snapshot build v2.1.4.18314 at the four sites where I have the
debug build of v2.1.3 installed and let you no how I get on. It could be
a while before I get a result as sometimes it doesn't fall over for a
few days or so.

Thanks,

Neil Pickles - ne...@cs...
Technical Director
CSY Retail Systems Limited
 
http://www.csy.co.uk
 
This email may contain privileged information which is for the intended
recipient only. If you should receive this email in error you must not
divulge or use any of the information it may contain but destroy it
immediately and notify the sender of the error.
Internet communications are not secure and therefore the CSY Group does
not accept legal responsibility for the contents of this message.
Although the CSY Group operates anti-virus programs, it does not accept
responsibility for any damage whatsoever that is caused by viruses being
passed.
Agreements binding CSY Group companies may not be concluded by means of
e-mail communication. 
Any opinions expressed are those of the author and are not necessarily
those of the company. 
 
Registered in England No. 2391386, Vat No 520 7385 59 Registered
Address: CSY House, Daleside Road, Nottingham, NG2 4DH
 

 

-----Original Message-----
From: Alexander Peshkov (JIRA) [mailto:tr...@fi...] 
Sent: 17 June 2010 09:18
To: Neil Pickles
Subject: [FB-Tracker] Commented: (CORE-3053) Firebird stops responding,
required restart to get going again. Related to process shutdown code


    [
http://tracker.firebirdsql.org/browse/CORE-3053?page=com.atlassian.jira.
plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=21240#act
ion_21240 ] 

Alexander Peshkov commented on CORE-3053:
-----------------------------------------

Neil, can you try latest snapshot of 2.1 branch?

> Firebird stops responding, required restart to get going again. 
> Related to process shutdown code
> ----------------------------------------------------------------------
> --------------------------
>
>                 Key: CORE-3053
>                 URL: http://tracker.firebirdsql.org/browse/CORE-3053
>             Project: Firebird Core
>          Issue Type: Bug
>          Components: Engine
>    Affects Versions: 2.1.3
>         Environment: Windows XP/SP3, x86 hardware
>            Reporter: Neil Pickles
>            Assignee: Vlad Khorsun
>         Attachments: leedscrashdump.7z
>
>
> Firebird just stops responding and requires a restart to get it going
again. Initially thought to relate to CORE-2900 but subsequently told it
is a seperate issue.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://tracker.firebirdsql.org/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira

        

Re: [Firebird-test] TPC benchmark suite

[Calin P. <cal...@co...>]

Thanks, Philippe.

Calin 

-----Original Message-----
From: Philippe Makowski [mailto:mak...@fi...] 
Sent: Thursday, 3 June 2010 2:28 PM
To: fir...@li...
Subject: Re: [Firebird-test] TPC benchmark suite

Calin Pirtea  [2010-06-03 05.47] :
> Hi all,
> 
> I would like to run some benchmark tests on Firebird using the TPC-C, TPC-E and TPC-H suites. Does anyone have these running on Windows?
> 
for TPC-H you can try this :
http://blog.upscene.com/thomas/index.php?category=19
http://www.iblogmanager.com/download/misc/tpch/tpch_firebird.zip

for TPC-B : https://sourceforge.net/projects/dbbench/

If you have any C skill, contact me if you have some time to port sysbench to Firebird

Re: [Firebird-test] TPC benchmark suite

[Philippe M. <mak...@fi...>]

Calin Pirtea  [2010-06-03 05.47] :
> Hi all,
> 
> I would like to run some benchmark tests on Firebird using the TPC-C, TPC-E and TPC-H suites. Does anyone have these running on Windows?
> 
for TPC-H you can try this :
http://blog.upscene.com/thomas/index.php?category=19
http://www.iblogmanager.com/download/misc/tpch/tpch_firebird.zip

for TPC-B : https://sourceforge.net/projects/dbbench/

If you have any C skill, contact me if you have some time to port sysbench to Firebird

[Firebird-test] TPC benchmark suite

[Calin P. <cal...@co...>]

Hi all,

I would like to run some benchmark tests on Firebird using the TPC-C, TPC-E and TPC-H suites. Does anyone have these running on Windows?

Cheers,

Calin Pirtea
Communicare Development Team
Communicare Systems Pty Ltd

Re: [Firebird-test] [FB-Tracker] Commented: (CORE-3023) IO Read and Writes Bytes/Sec Exploded out of proportion. Degrade System Performance

[Andrew D. <ad...@gf...>]

Andrew Dimech - Software Developer
GFI Software - www.gfi.com

-----Original Message-----
From: Vlad Khorsun (JIRA) [mailto:tr...@fi...] 
Sent: 02 June 2010 15:21
To: Andrew Dimech
Subject: [FB-Tracker] Commented: (CORE-3023) IO Read and Writes
Bytes/Sec Exploded out of proportion. Degrade System Performance


    [
http://tracker.firebirdsql.org/browse/CORE-3023?page=com.atlassian.jira.
plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=21109#act
ion_21109 ] 

Vlad Khorsun commented on CORE-3023:
------------------------------------

What queries should i run to see the issue ?

> IO Read and Writes Bytes/Sec Exploded out of proportion. Degrade
System Performance
>
------------------------------------------------------------------------
-----------
>
>                 Key: CORE-3023
>                 URL: http://tracker.firebirdsql.org/browse/CORE-3023
>             Project: Firebird Core
>          Issue Type: Bug
>      Security Level: Developers(Visible only to project developers
(and administrators)) 
>          Components: Engine
>    Affects Versions: 2.5 RC2
>         Environment: Win XP 32bit, Core 2 DUO 2.4GHz, 2GB RAM
>            Reporter: Andrew Dimech
>         Attachments: FB Schema.sql
>
>
> We are considering moving to Engine 2.5 and carried out a test to
compare Engine 2.1.1 with Engine 2.5 RC2.
> The test consists of a executing 7 Stored Procedures from a .NET
application. These procedures consists of just select statements and
they return a total of  6700 records. The test called these stored
procedures a number of times (with different parameter values) for a
period of 4minutes.
> From Performance Counter we added the following counters for the (.NET
application) process we were monitoring:
> The results were shocking. These are the average Bytes/sec values over
4minutes.
> Engine 2.1.1
> IO Read Bytes/Sec	 164,250 
> IO Write Bytes/Sec	 201,172 
> Engine 2.5 RC2
> IO Read Bytes/Sec	 3,879,708 
> IO Write Bytes/Sec	 3,939,374 
> The IO in Engine 2.5 is around 23 times higher. This would result in
degrading system performance. Is this a known issue? are you planning to
handle it? 
> Attached is the database schema used. For simplicity I only kept the
stored procedures used during the test. The stored procedures are called
in this order:
> GETMESSAGEUPDATESHDRFA
> GETMESSAGEUPDATESADDRFA
> GETMESSAGEUPDATESATTACHFA
> GETMESSAGEUPDATESOWNERSFA
> GETMESSAGEUPDATESTAGSFA
> GETDELETEDMESSAGEUPDATESFA
> GETTAGUPDATESFA
> Thanks,
> Andrew

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://tracker.firebirdsql.org/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira

        



DISCLAIMER
The information contained in this electronic mail may be confidential or
legally privileged. It is for the intended recipient(s) only. Should you
receive this message in error, please notify the sender by replying to
this mail. Unless expressly stated, opinions in this message are those
of the individual sender and not of GFI. Unauthorized use of the
contents is strictly prohibited. While all care has been taken, GFI is
not responsible for the integrity of the contents of this electronic
mail and any attachments included within.  

This mail was checked for viruses by GFI MailSecurity. 
GFI also develops anti-spam software (GFI MailEssentials), a fax server (GFI FAXmaker), and network security and management software (GFI LANguard) - www.gfi.com 

Re: [Firebird-test] [FB-Tracker] Commented: (CORE-2666) Make it possible to use API to do remote backups/restores

[Poul D. <pd...@ta...>]

Hi Alex,

I know that the official release of FB2.5 is not yet due - but as we are 
starting hosting service as pilot project now I would very much appreciate 
any input you could give me on this:

- Do you have an estimate of the FB2.5 release date or just release month?
- How soon after the release will you estimate that it will be possible to 
implement the remote backup feature (if possible at all)?

Right now our pilots will have to live with very slow backup/restore (10MB 
database ~ 5 minutes for backup or restore operation) but once out of pilot 
status it needs to go much faster than that. If not possible through FB then 
we must think of some other kind of solution. But a fast GBAK will be much 
preferred - and it will be of benefit to us in other cases as well where we 
want to do remote backups.


Best regards
and thanks

Poul Dige
Tabulex


----- Original Message ----- 
From: "Alexander Peshkov (JIRA)" <tr...@fi...>
To: <pd...@ta...>
Sent: Monday, October 05, 2009 10:14 PM
Subject: [FB-Tracker] Commented: (CORE-2666) Make it possible to use API to 
do remote backups/restores


>
>    [ 
> http://tracker.firebirdsql.org/browse/CORE-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_19963 ]
>
> Alexander Peshkov commented on CORE-2666:
> -----------------------------------------
>
> Poul, I've marked it as planned for 3.0, but this does not mean that 
> private build of 2.5 for you is not possible. Let's return to it after 2.5 
> official release.
>
>> Make it possible to use API to do remote backups/restores
>> ---------------------------------------------------------
>>
>>                 Key: CORE-2666
>>                 URL: http://tracker.firebirdsql.org/browse/CORE-2666
>>             Project: Firebird Core
>>          Issue Type: Improvement
>>          Components: API / Client Library, GBAK
>>         Environment: All
>>            Reporter: Poul Dige
>>            Assignee: Alexander Peshkov
>>
>> Today you can use the API remotely to create a serverside backup. You can 
>> use GBAK to create a remote backup (e.g. via Internet). But you can't use 
>> API to create remote backup, i.e. create a backup serverside and flush it 
>> to the client.
>> As using GBAK is very very slow over internet (testcase 10MB database 
>> backup takes less than 2 seconds when done locally, and more than 5 
>> minutes through a 20MBit internet connection) ) it is a must to improve 
>> this function to make it possible to offer remote hosting for customers.
>
> -- 
> This message is automatically generated by JIRA.
> -
> If you think it was sent incorrectly contact one of the administrators: 
> http://tracker.firebirdsql.org/secure/Administrators.jspa
> -
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>
>
> 

Re: [Firebird-test] [FB-Tracker] Commented: (CORE-2941) Get more actions with context variables

[p519446 <p5...@ya...>]

Hi, Paulo!

> Question:
> What are the advantages of using rdb$xxx_context over self-made UDF-based replacements?

I think the`re is only one advantage: in case of moving .fdb file to other server we must not be aware about presence of .dll that contains such UDF as we have on source server. But may be I'm wrong :-)

Regards, Pavel.

Re: [Firebird-test] [FB-Tracker] Resolved: (CORE-2886) Query with "NOT IN <subselect from view>" fails

[Poul D. <pd...@ta...>]

Wow... that was fast!

Thank you :)

Regards
Poul




----- Original Message ----- 
From: "Adriano dos Santos Fernandes (JIRA)" <tr...@fi...>
To: <pd...@ta...>
Sent: Saturday, February 27, 2010 7:29 PM
Subject: [FB-Tracker] Resolved: (CORE-2886) Query with "NOT IN <subselect 
from view>" fails


>
>     [ 
> http://tracker.firebirdsql.org/browse/CORE-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
>
> Adriano dos Santos Fernandes resolved CORE-2886.
> ------------------------------------------------
>
>         Assignee: Adriano dos Santos Fernandes
>    Fix Version/s:  2.5 RC3
>                   3.0 Alpha 1
>       Resolution: Fixed
>
>> Query with "NOT IN <subselect from view>" fails
>> -----------------------------------------------
>>
>>                 Key: CORE-2886
>>                 URL: http://tracker.firebirdsql.org/browse/CORE-2886
>>             Project: Firebird Core
>>          Issue Type: Bug
>>          Components: Engine
>>    Affects Versions: 2.5 RC2
>>         Environment: Checked for 32 bit embedded mode, FB2.5 RC2, 
>> 2.5.0.25920 on  Win2003 server
>>            Reporter: Poul Dige
>>            Assignee: Adriano dos Santos Fernandes
>>             Fix For:  2.5 RC3, 3.0 Alpha 1
>>
>>
>> I try to run following case on FB2.5 RC2, 2.5.0.25920 Embedded. I havent 
>> tried to verify the problem for a server install yet.
>>
>>
>> ********************************************
>> SET SQL DIALECT 3;
>> SET NAMES ISO8859_1;
>> SET CLIENTLIB 'fbclient.dll';
>>
>> CREATE DATABASE 'crash.FDB'
>> USER 'SYSDBA' PASSWORD 'MASTERKEY'
>> PAGE_SIZE 4096
>> DEFAULT CHARACTER SET ISO8859_1;
>>
>> CREATE TABLE T (ID  INTEGER NOT NULL);
>> CREATE VIEW V( ID) AS select ID from T;
>>
>> INSERT INTO T (ID) VALUES (1);
>> INSERT INTO T (ID) VALUES (2);
>> INSERT INTO T (ID) VALUES (3);
>>
>> COMMIT WORK;
>>
>> SELECT ID FROM T
>> WHERE ID NOT IN
>>   (SELECT ID FROM V WHERE ID = 1)
>>
>> --The cursor identified in the UPDATE or DELETE statement is not 
>> positioned on a row.
>> --no current record for fetch operation.
>> ********************************************
>
> -- 
> This message is automatically generated by JIRA.
> -
> If you think it was sent incorrectly contact one of the administrators: 
> http://tracker.firebirdsql.org/secure/Administrators.jspa
> -
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>
>
>
> 

Re: [Firebird-test] [FB-Tracker] Updated: (CORE-2808) XNET classic server client connection process timeout failure blocks subsequent connect attempts.

[Mark R. <Ava...@gm...>]

> Any idea why I can't get to tracker.firebirdsql.org?  All I get is an
> empty page when I try.  Figured it was down or something, however you and
> Dmitry both updated this issue.

I had the same problem about one or two weeks ago, and it resolved itself. Maybe your DNS is pointing to the wrong server, or there is a proxy messing with the headers.

On my side the tracker is located on 64.26.182.170. It works if accessed by the full URL, but it does not work when accessed through the IP-address (then I do get a blank page).

Mark
-- 
NEU: Mit GMX DSL über 1000,- ¿ sparen!
http://portal.gmx.net/de/go/dsl02

Re: [Firebird-test] [FB-Tracker] Updated: (CORE-2808) XNET classic server client connection process timeout failure blocks subsequent connect attempts.

[Brain D. <bra...@ya...>]

Any idea why I can't get to tracker.firebirdsql.org?  All I get is an empty page when I try.  Figured it was down or something, however you and Dmitry both updated this issue.




--- On Thu, 1/14/10, Pavel Cisar (JIRA) <tr...@fi...> wrote:

> From: Pavel Cisar (JIRA) <tr...@fi...>
> Subject: [FB-Tracker] Updated: (CORE-2808) XNET classic server client connection process timeout failure blocks subsequent connect attempts.
> To: bra...@ya...
> Date: Thursday, January 14, 2010, 4:10 AM
> 
>      [ http://tracker.firebirdsql.org/browse/CORE-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
> ]
> 
> Pavel Cisar updated CORE-2808:
> ------------------------------
> 
>     Security:     (was:
> Managers)
>     Reporter: Brenden Walker  (was: Pavel
> Cisar)
> 
> > XNET classic server client connection process timeout
> failure blocks subsequent connect attempts.
> >
> -------------------------------------------------------------------------------------------------
> >
> >             
>    Key: CORE-2808
> >             
>    URL: http://tracker.firebirdsql.org/browse/CORE-2808
> >         
>    Project: Firebird Core
> >          Issue Type: Bug
> >          Components: Engine
> >    Affects Versions: 2.0.5
> >         Environment:
> Windows XP, for me problem only happens on slower machines,
> Pentium 4, 512mb ram, NON hyperthreader/multicore.
> >            Reporter:
> Brenden Walker
> >
> > When the client times out waiting for
> xnet_response_event, the client exits clean.  The
> server however continues on and sets the
> xnet_response_event.  
> > This event sits out there for the next client who
> happily 'grabs' onto it and thinks a connection has been
> established.  The response.map_num is
> XNET_INVALID_MAP_NUM and the client errors out.  Once a
> timeout happens no further XNET connections can be made
> until the server is restarted as each client will grab the
> previous clients event.
> > I've seen similar symptoms on 2.1.3, however the cause
> in the cases I've been able to adequately review has not
> been due to exceeding xnet_connect_timeout.  When I get
> more information on that I'll post a new issue.
> > Workaround for this particular problem is to increase
> the timeout via new config file parameter created in http://tracker.firebirdsql.org/browse/CORE-2769
> 
> -- 
> This message is automatically generated by JIRA.
> -
> If you think it was sent incorrectly contact one of the
> administrators: http://tracker.firebirdsql.org/secure/Administrators.jspa
> -
> For more information on JIRA, see: http://www.atlassian.com/software/jira
> 
>         
> 


      

Re: [Firebird-test] Firebird against SQLite

[Mark R. <Ava...@gm...>]

Firebird-Test is not the appropriate list for this question. Either repost on Firebird-Support or on a list specific for your language. See http://www.firebirdsql.org/index.php?op=lists for an overview of mailinglists.

Regards,
Mark

> 
> Hi List,
>          I am newbie to Fire bird. Off recently, I worked on Integrating
> SQLite as a Database Engine for my Application. Now, I am trying to find
> if
> Fire Bird can fit in it's place.
> Also, I have integrated the IBPP wrappers into my application, but, I was
> not able to get a simple example that i could use as a reference for me.
> Any help in these regards will be highly appreciated,
> Regards,
> Atul
-- 
Jetzt kostenlos herunterladen: Internet Explorer 8 und Mozilla Firefox 3.5 -
sicherer, schneller und einfacher! http://portal.gmx.net/de/go/chbrowser

[Firebird-test] Firebird against SQLite

[Atul_Vaidya <atu...@pr...>]

Hi List,
         I am newbie to Fire bird. Off recently, I worked on Integrating
SQLite as a Database Engine for my Application. Now, I am trying to find if
Fire Bird can fit in it's place.
Also, I have integrated the IBPP wrappers into my application, but, I was
not able to get a simple example that i could use as a reference for me.
Any help in these regards will be highly appreciated,
Regards,
Atul

-- 
View this message in context: http://www.nabble.com/Firebird-against-SQLite-tp26008142p26008142.html
Sent from the firebird-test mailing list archive at Nabble.com.

Re: [Firebird-test] results of qmtest run on linux fb2.0.4

[Philippe M. <mak...@fi...>]

Roman Simakov  [08-12-20 11.20] :
> A small correction ;) I just committed the tests since i have necessary 
> rights but Vyacheslav Ozherelyev (vya...@re...) is 
> a real developer of them :)
yes sorry

> He can answer you about they. Red Soft has many changes of source code 
> and will provide a set of patches for firebird v3.0. Some of them 
> already discussed and probably will be merged into cvs tree after 
> branching 2.5. As well as core patches Red Soft provides a set of 
> qm-tests for new functionality. Vyacheslav is responsible for it and he 
> is ready to tell you about exists tests.
> 
Are they all for 3.0 ? or is there some for 2.5 ?

We will have two French students that will help us for Q/A, so we have to tell them what
kind of tests we need.

Re: [Firebird-test] results of qmtest run on linux fb2.0.4

[Vyacheslav O. <vya...@re...>]

Philippe Makowski wrote:
> Roman Simakov  [08-12-20 11.20] :
>   
>> A small correction ;) I just committed the tests since i have necessary 
>> rights but Vyacheslav Ozherelyev (vya...@re...) is 
>> a real developer of them :)
>>     
> yes sorry
>
>   
>> He can answer you about they. Red Soft has many changes of source code 
>> and will provide a set of patches for firebird v3.0. Some of them 
>> already discussed and probably will be merged into cvs tree after 
>> branching 2.5. As well as core patches Red Soft provides a set of 
>> qm-tests for new functionality. Vyacheslav is responsible for it and he 
>> is ready to tell you about exists tests.
>>
>>     
> Are they all for 3.0 ? or is there some for 2.5 ?
>   
Yes, all for 3.0
> We will have two French students that will help us for Q/A, so we have to tell them what
> kind of tests we need.
>
>   

Regards
Vyacheslav Ozherelyev

Re: [Firebird-test] Fb250

[Mark O'D. <mar...@gm...>]

Hi Philippe

On 20/12/08 20:36, Philippe Makowski wrote:
>>
> SuperServer 32 ?
>

That was Classic Server 32 bit.

>
> You should not have ERROR, there is something wrong on your setup
>

Yes, I will look at these.

> Yes, all of that have to be carefully check , there are still fals FAIL (ODS change for
> example) but as I said, Alpha stage is not a good one for that.
>

Yes I understand, my usually experience is running these all the time, 
and with bug fixes, having the developers closely involved in writing 
the test scripts.

> And now, I have some work to do with 2.1.2 (58  bugs fixed to check)
>

Ok, I will post what I find as I look through the fails, and presumably 
that will help update the test results when needed.

Thanks for the help!

Cheers - Mark

Re: [Firebird-test] results of qmtest run on linux fb2.0.4

[Roman S. <rom...@re...>]

Philippe Makowski wrote:
> dev resolve bug, Q/A team test if it is really solved, close the bug and if possible
> create the qmtest test.
> So, Pavel and I, with sometime help from french students (and recently Roman Simakov from
> Red Soft committed tests for FK) are the one that do the job.
>
>   
Hi Philippe, All!

A small correction ;) I just committed the tests since i have necessary 
rights but Vyacheslav Ozherelyev (vya...@re...) is 
a real developer of them :)
He can answer you about they. Red Soft has many changes of source code 
and will provide a set of patches for firebird v3.0. Some of them 
already discussed and probably will be merged into cvs tree after 
branching 2.5. As well as core patches Red Soft provides a set of 
qm-tests for new functionality. Vyacheslav is responsible for it and he 
is ready to tell you about exists tests.

Roman Simakov

Re: [Firebird-test] Fb250

[Philippe M. <mak...@fi...>]

Mark O'Donohue  [08-12-20 01.53] :
> Just for comparison, I have updated my copy to the latest svn copy and
> running on linux, and running the two sets separately I get:
> 
SuperServer 32 ?

> functional:
> --- STATISTICS ----------------------------------------
> 
>       490        tests total
>         1 (  0%) tests ERROR
>        51 ( 10%) tests FAIL
>       438 ( 89%) tests PASS
> 
> 
I get this :
--- STATISTICS ---------------------------------------------------------------

     490        tests total
      47 ( 10%) tests FAIL
     443 ( 90%) tests PASS

> 
> For the bugs subset :
> --- STATISTICS ----------------------------------------
> 
>       139        tests total
>        12 (  9%) tests ERROR
>        21 ( 15%) tests FAIL
>       106 ( 76%) tests PASS
> 
> 
I get this
--- STATISTICS ---------------------------------------------------------------

     139        tests total
      15 ( 11%) tests FAIL
     124 ( 89%) tests PASS

You should not have ERROR, there is something wrong on your setup

> I am yet to look into the fails, but two I did seemed cases where the 
> result comparison set needed to be updated.
> 
Yes, all of that have to be carefully check , there are still fals FAIL (ODS change for
example) but as I said, Alpha stage is not a good one for that.

And now, I have some work to do with 2.1.2 (58  bugs fixed to check)

Re: [Firebird-test] Fb250

[Mark O'D. <mar...@gm...>]

Hi Philippe

On 16/12/08 02:20, Philippe Makowski wrote:
> Hi all,
>
> I committed today new version of tests to avoid false fail related to the change from
> SQLCODE to SQLSTATE.
>
> Results are more clean now for 2.5, there is still some cleaning to do, but for I now I
> prefer to let them, at least to not hide changes that occurred with new ods, new functions ...
>
> with the new version there is still 41 FAIL on 625 tests under Windows, but that's really
> better than before the cleaning ;)
> At least results can be exploited now without too much noise with false fail.
>


Just for comparison, I have updated my copy to the latest svn copy and
running on linux, and running the two sets separately I get:

functional:
--- STATISTICS ----------------------------------------

      490        tests total
        1 (  0%) tests ERROR
       51 ( 10%) tests FAIL
      438 ( 89%) tests PASS



For the bugs subset :
--- STATISTICS ----------------------------------------

      139        tests total
       12 (  9%) tests ERROR
       21 ( 15%) tests FAIL
      106 ( 76%) tests PASS


I am yet to look into the fails, but two I did seemed cases where the 
result comparison set needed to be updated.

I will also try and run the older TCS suite.

Cheers - Mark

[Firebird-test] Fb250

[Philippe M. <mak...@fi...>]

Hi all,

I committed today new version of tests to avoid false fail related to the change from
SQLCODE to SQLSTATE.

Results are more clean now for 2.5, there is still some cleaning to do, but for I now I
prefer to let them, at least to not hide changes that occurred with new ods, new functions ...

with the new version there is still 41 FAIL on 625 tests under Windows, but that's really
better than before the cleaning ;)
At least results can be exploited now without too much noise with false fail.

-- 
Philippe Makowski
http://www.ibphoenix.com
Supporting users of Firebird
Tel +33 (0) 561058813

Re: [Firebird-test] results of qmtest run on linux fb2.0.4

[Philippe M. <mak...@fi...>]

Mark,
> I reran functional.intfunc.cast.cast_01  and it worked, the ERROR was 
> that the database already existed, but knowing I am in the ballpark I've 
> moved on to trying to run against my 2.5 build.
you will have a lot of fail tests, since 2.5 change error codes

> Once the report is created, is it posted somewhere, or put on the website?
> 
no
Pavel have all, and send them to dev if need.

> But I am curious as to who is responsible for building the test case for 
> each bug (the usual process is to dob in either the reporter or the 
> developer as the bunny)?
> 
dev resolve bug, Q/A team test if it is really solved, close the bug and if possible
create the qmtest test.
So, Pavel and I, with sometime help from french students (and recently Roman Simakov from
Red Soft committed tests for FK) are the one that do the job.

Re: [Firebird-test] results of qmtest run on linux fb2.0.4

[Mark O'D. <mar...@gm...>]

Hi Phillippe

On 14/12/08 02:46, Philippe Makowski wrote:
> Mark O'Donohue  [08-12-13 15.10] :
>> So it seems for fb 2.0.4 (linux) we have 402 (358 + 44 ) test cases, is
>> that correct or are there more somewhere else?
>>
> Classic or SuperServer ?
>

That was super.

Thanks for those, its nice to be getting similar answers :-)

I reran functional.intfunc.cast.cast_01  and it worked, the ERROR was 
that the database already existed, but knowing I am in the ballpark I've 
moved on to trying to run against my 2.5 build.

>
> there is no public place where you could find results, Pavel and I run tests, and after
> that we create a report with all results files using the
> qmreport python script you can find in the svn

Once the report is created, is it posted somewhere, or put on the website?


Also with the bugs test suite, we seem to have a variety of tests from 
core_86.qmt ... core_1885.qmt,  but tracker seems to be up to bug 
core-2238.   There seems to be a mix of information available in 
tracker, most of it helpful for building the test case.

But I am curious as to who is responsible for building the test case for 
each bug (the usual process is to dob in either the reporter or the 
developer as the bunny)?


Cheers - Mark

Re: [Firebird-test] results of qmtest run on linux fb2.0.4

[Philippe M. <mak...@fi...>]

Mark O'Donohue  [08-12-13 15.10] :
> So it seems for fb 2.0.4 (linux) we have 402 (358 + 44 ) test cases, is 
> that correct or are there more somewhere else?
> 
Classic or SuperServer ?

> 
>    functional.arno.optimizer.opt_multi_index_selection_06: FAIL
>      Expected standard output from ISQL does not match actual output.
> 
>    functional.arno.optimizer.opt_single_index_selection_11: FAIL
>      Expected standard output from ISQL does not match actual output.
> 
These two are true bugs, so it is normal that they fail

>    functional.intfunc.cast.cast_01               : ERROR
>      Exception raised while creating database.
this one should pass
before running test, check that you don't have databases in your "database_location" directory

> 
>    bugs.core_1006                                : ERROR
>      Backup file core1006.fbk does not exist.
> 
>    bugs.core_1063                                : ERROR
>      Backup file core1063.fbk does not exist.
> 
these two should pass
check your "backup_location" directory and check also that firebird user can read files

>    bugs.core_1331                                : FAIL
>      Expected STDERR stream received from ISQL.
> 
this one "officialy" fail, it is a charset problem with qmtest

>    bugs.core_959                                 : FAIL
>      Expected standard output from python does not match actual output.
> 
This one I allways have trouble to run it with Superserver, but not with Classic
but it is a qmtest problem

so not far from the "official" results

there is no public place where you could find results, Pavel and I run tests, and after
that we create a report with all results files using the
qmreport python script you can find in the svn

[Firebird-test] results of qmtest run on linux fb2.0.4

[Mark O'D. <mar...@gm...>]

So it seems for fb 2.0.4 (linux) we have 402 (358 + 44 ) test cases, is 
that correct or are there more somewhere else?

$qmtest -C context.txt run functional

--- STATISTICS 
---------------------------------------------------------------

      358        tests total
        1 (  0%) tests ERROR
        2 (  1%) tests FAIL
      355 ( 99%) tests PASS



$qmtest -C context.txt run bugs


--- STATISTICS 
---------------------------------------------------------------

       44        tests total
        2 (  5%) tests ERROR
        2 (  5%) tests FAIL
       40 ( 91%) tests PASS


I re-ran one of the FAILS and it worked the second time (database 
already existed was the cause).  Is there an official list of results I 
can check to see how these compare?


Cheers - Mark


Below are the ones that failed.



--- TESTS THAT DID NOT PASS 
--------------------------------------------------

   functional.arno.optimizer.opt_multi_index_selection_06: FAIL
     Expected standard output from ISQL does not match actual output.

   functional.arno.optimizer.opt_single_index_selection_11: FAIL
     Expected standard output from ISQL does not match actual output.

   functional.intfunc.cast.cast_01               : ERROR
     Exception raised while creating database.



--- TESTS THAT DID NOT PASS 
--------------------------------------------------

   bugs.core_1006                                : ERROR
     Backup file core1006.fbk does not exist.

   bugs.core_1063                                : ERROR
     Backup file core1063.fbk does not exist.

   bugs.core_1331                                : FAIL
     Expected STDERR stream received from ISQL.

   bugs.core_959                                 : FAIL
     Expected standard output from python does not match actual output.

Re: [Firebird-test] Attempting to run qmtests

[Mark O'D. <mar...@gm...>]

Hi Pavel

On Sat, Dec 13, 2008 at 9:39 PM, Pavel Cisar <pc...@ib...> wrote:
>
> Now I realized that you may use wrong (outdated) version of qmtest, if
> you downloaded qmtest from original site. It doesn't contain recent
> patches and might have trouble with Python 2.5.
>
> Please download this version and try again
> http://www.firebirdsql.org/download/prerelease/python/qmtest-2.4.1070.tar.gz
>


Thanks, I will use that, I am on qmtest 2.4, but probably that is a
later build.   But for this problem I am 100% sure it was editline,
starting with :

http://packages.qa.debian.org/e/editline.html

and linking their own test program with Ubuntu provided libraries, and
then building the ones in the package, I got the same error, entirely
without firebird or qmtest.

Now, to download a version from our website, and will start Today over
again  ....

Cheers - Mark