Re: [Firebird-test] Attempting to run qmtests

[Mark O'D. <mar...@gm...>]

Hi Pavel

Thanks for the tip, I have got further, but now I am getting groups of 
failed tests.

I am running against the standard ubuntu fb2.0.3 package install,

   $qmtest run -C context.txt functional

gives:
    --- STATISTICS --------------------------------

      358        tests total
       88 ( 25%) tests FAIL
      270 ( 75%) tests PASS


88 failures seems a little high.  Looking at the first failure, which is 


      test case: functional.arno.derived_tables.derived_tables_06

That test is:

    SELECT
       dt.*
     FROM
       Table_10 t10
       JOIN (SELECT * FROM Table_10 t2 WHERE t2.ID = t10.ID)
               dt ON (1 = 1);

When I ran that test using isql it gives the "Column Unknown: T10.ID" as 
expected.


The QMTest result complained it found an extra "=":

      -Token unknown - line 5, column 2
      -=

So QMTest has an extra "=" inserted somewhere.

So any idea of what is going wrong (I have included more details below) ?

Cheers - Mark



Setup is :

./qadbm.py
QADBM>platform Linux
QADBM>target 2.0.3
QADBM>create fbtest2.0.3
QADBM>copy fbtest2.0.3
QADBM>exit

I create a context.txt file for ubuntu/2.0.3 as :

temp_directory=/var/tmp/
server_location=localhost:
database_location=/var/firebird/test/
 
suite_database_location=/home/odonohue/work/firebird/testing/qa/qa/trunk/testsuite/fdb/
backup_location=/home/odonohue/work/firebird/testing/qa/qa/trunk/testsuite/fdk/
files_location=/home/odonohue/work/firebird/testing/qa/qa/trunk/testsuite/files/
isc4_path=/var/lib/firebird/2.0/system/security2.fdb
user_name=SYSDBA
user_password=<a secret noone will ever guess>
isql_path=/usr/bin/isql-fb
gsec_path=/usr/bin/gsec
gstat_path=/usr/bin/gstat
gbak_path=/usr/bin/gbak
nbackup_path=/usr/bin/nbackup
gfix_path=/usr/bin/gfix
gpre_path=/usr/bin/gpre


Then I run :

   cd fbtest2.0.3
   qmtest run -C context.txt functional

It produced the results file:

   $ ls -lh results.qmr
   -rw-r--r-- 1 odonohue odonohue 165K 2008-12-13 12:03 results.qmr

I was hoping for a basic report and tried most of the options for:

    $qmtest report -f results.qmr

    but it just kept replying with :
        usage: qmtest report [ OPTIONS ] [ result [-e expected] ]+
    and although -e is optional, I wasnt sure where the was.

So I did the gui thing.

    $qmtest gui

And fired up the browser.   I then chose File/Load Results, selected the 
results.qmr file, and that seemed to work.

navagating to the first failue:
        functional.arno.derived_tables.derived_tables_06

The difference is:

Actual result:
      Statement failed, SQLCODE = -104
      Dynamic SQL Error
      -SQL error code = -104
      -Token unknown - line 5, column 2
      -=

Expected result:
      Statement failed, SQLCODE = -206
      Dynamic SQL Error
      -SQL error code = -206
      -Column unknown
      -T10.ID
      -At line 5, column 53

> 
> The report command is not so important. The run command should produce
> the results.qmr file that you can rename (to have platform, fb arch. a
> run number, for example wcs1.qmr fro Windows Classic run 1) and send to
> me for further processing.
> 

What further processing do you do?