Re: [Lbs-tech] free spec benchmark?

[Bill B. <bra...@us...>]

SPECcpu is not a good benchmark for the Linux kernel since during the
benchmark, one is system state less than 5% of the time.
The SPECcpu benchmarks are most effected by the compiler and the CPU
organization and speed.

I agree that the Linux community needs their benchmarks to be freely
available to allow anyone to replicate the results.

I am still not sure what your goal is? Please elaborate.
Bill

William C. Brantley, Ph.D.
Linux Technology Center, Performance,
512-838-8505, t/l 678, fax  -5573




                                                                                                                          
                      Hiro Yoshioka                                                                                       
                      <hyoshiok@miracle        To:       Bill Brantley/Austin/IBM@IBMUS                                   
                      linux.com>               cc:       lbs...@li..., hyo...@mi...        
                                               Subject:  Re: [Lbs-tech] free spec benchmark?                              
                      05/20/2002 09:02                                                                                    
                      PM                                                                                                  
                                                                                                                          
                                                                                                                          



Bill,

Thanks for your help.

SPEC benchmarks are not free.
http://www.spec.org/cgi-bin/osgorder

They are inexpensive.

I'd like to run SPEC CPU95 (It is an obsolete benchmark.)
Because there are a lot of detailed results published, for example,
research papers. What I'd like to do is, 1) to compare the
published results with running on the linux kernel. 2) to measure
the detail behavior of the kernel, e.g., CPI, cache miss,
memory traffics, TLB miss, and so on. 3) to exchange benchmark
results with the linux community.

My concern is the linux community may not have
the SPEC benchmarks. If so, exchanging the benchmark
results might be difficult.

I think the motivation of development of OSDL-DBT is
very similar.

http://www.osdl.org/projects/performance/osdldbt.html

Doesn't it make sence to have open source CPU benchmark suits?

Regards,
  Hiro