[Firebird-test] Re: [Firebird-devel] TPC-R load / run test

[Mark O'D. <mar...@lu...>]

Hi Tord

That sounds bloody terrific, a thrashing program one of the key testing 
bits we were missing.  And it helps to have it based on the standards stuff.

I've cc'ed this to firebird-test and will definately have a good look at 
it in the next couple of days.

Personally Im more interested in the testing perspective, in that it 
allows us to check for problems, but I assume the figures also allow us 
to compare to other systems.  Any idea how we fare?

Cheers

Mark




Tord Hammer wrote:

>Hi,
>
>I have tried to get the TPC-R benchmark running with FireBird.
>
>
>The homepage is at http://www.tpc.org/tpcr/
>
>I have changed the dbgen utility to work with interbase and fixed
>some bugs in the progress indicator. 
>
>I have also changed all the queries.
>
>I have removed the parameters and inserted the values given in
>tpcr_current.pdf.
>I have changed the inner-select syntax to using a view.
>I have changed the case syntax to a stored procedure.
>I have also changed some queries which confused the optimizer.
>I have tried to find suitable indexes.
>
>Since I dont have included the important parts of the benchmark
>(refreshing test, throughput test, power test) and I have changed
>the queries too much, so you cant use it to get a correct benchmark
>result.
>
>But I think its good enough to stress test the engine.
>
>You can download the linux-version from:
>http://www.hammer-software.de/fb/tpcr-firebird.tar.gz
>
>The original sourcecode can be found at 
>http://www.tpc.org/tpcr/default.asp#spec
>
>If you want only the original queries than look at
>http://www.hammer-software.de/fb/tpcr-queries.tar.gz
>
>
>After extracting of tpcr-firebird.tar.gz, you can generate
>the tpcr.gdb with the command:
>    ./maketpc.sh
>
>Useful parameters are -h for help, -p for path-prefix (if you
>dont have enough room at /tmp) and -s for scale factor.
>
>The queries can be executed with
>    ./runtpc.sh
>
>Now my results:
>
>with scale 0.1 (results in a 150 MB database), the queries need
>about 5-10 seconds each, with 100-200 seconds for query 20 and 21.
>
>for scale 1.0 and the parameter-values from tpcr_current.pdf
>I could check the returned rows as well:
>
>maketpc run about two hours.
>
>query  | execution time (seconds) | correct result
>-------+--------------------------+---------------
>   1   |          700             |       yes
>   2   |          250             |       yes
>   3   |          700             |        no
>   4   |          300             |       yes
>   5   |          300             |       yes
>   6   |          300             |       yes
>   7   |          700             |       yes
>   8   |          500             |       yes
>   9   |         6500             |       yes
>  10   |          400             |        no
>-------+--------------------------+---------------
>  11   |          150             |       yes
>  12   |          350             |        no
>  13   |         1800             |        no
>  14   |          200             |       yes
>  15   |          570             |       yes
>  16   |           70             |       yes
>  17   |          150             |        no
>  18   |          350             |       yes
>  19   |          700             |       yes
>  20   |       still running      |       n/a
>-------+--------------------------+---------------
>  21   |       still running      |       n/a
>  22   |       still running      |       n/a
>
>
>The system is linux 2.2.16 (from SuSE 7.0)
>AthlonB 1200, 256 GB RAM
>one big 20 GB ext2-partition at the second half of a
>40 GB hard disk.
>FireBird Classic Build 347
>Buffers = 10000
>
>
>Comments, better queries or better indexes welcome.
>
>
>Tord
>
>
>
>
>_______________________________________________
>Firebird-devel mailing list
>Fir...@li...
>http://lists.sourceforge.net/lists/listinfo/firebird-devel
>


-- 
Your database needs YOU!
http://firebird.sourceforge.net
GPL: free software today - and still free tomorrow