You can subscribe to this list here.
2004 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
(6) |
Sep
(2) |
Oct
(1) |
Nov
(1) |
Dec
(1) |
---|
From: Bryce H. <br...@os...> - 2004-12-03 01:06:08
|
http://osdl.org/newsroom/press_releases/2004/2004_12_2_beaverton.html Bryce |
From: Bryce H. <br...@os...> - 2004-11-02 00:16:18
|
= Test Performance Summary Report - 2004 November = ~~~~~~~~~~ Compilation Status ~~~~~~~~~~ ~~~ LTP ~~~ ~Hackbench~ ia32 ia64 ppc32 ppc40x sparc spc64 alpha PASS F W B #Proc Time linux 2.4.27 ok FAIL FAIL FAIL ok ok ok 7235 3 3 6 100 18 sec linux 2.6.7 ok FAIL FAIL ok ok ok FAIL 7225 6 3 6 100 10 sec linux 2.6.8.1 ok FAIL FAIL ok ok ok FAIL 7229 5 3 6 100 10 sec linux 2.6.9 ok FAIL FAIL ok ok ok ok 2199 8 2 7 100 9.6 s === Contents: === * Introduction * Linux Test Project (LTP) Results * Reaim Performance Results * Open POSIX Test Suite * STP 3.0.10 released * About This Report == Introduction == The 2.6.9 kernel was released last month, and the first release candidate for 2.6.10 is out. LWN summarizes the major changes from 2.6.8 to 2.6.9: 2.6.9 includes a lot of NTFS updates, block I/O barrier support, a patch allowing unprivileged process to lock small amounts of memory in RAM, a new USB storage driver, cluster-wide file locking infrastructure, completely out-of-line spinlocks, AMD dual-core support, support for the POSIX waitid() system call, KProbes, USB "on the go" support, the "flex mmap" user-space memory layout, m32r architecture support, a bunch of latency-reduction work, and lots of fixes. ACPI and ALSA also appear to have received significant updates in this release. == Linux Test Project (LTP) Results == Patch Name TestReq# LTP Ver CPU PASS FAIL WARN BROK RunTime ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ linux-2.4.27 295880 20040707 2-way 7234 3 3 6 68.9 patch-2.4.28-pre4 298113 20041007 2-way 2210 3 2 3 46.8 patch-2.4.28-rc1 298374 20041007 2-way 2210 3 2 3 46.8 linux-2.6.8 296252 20040707 2-way 7229 3 3 3 125.1 linux-2.6.8.1 296304 20040707 2-way 7229 5 3 6 50.2 patch-2.6.9-rc2 297565 20040908 2-way 7245 11 3 7 54.1 patch-2.6.9-rc3 297771 20040908 2-way 7246 8 3 6 53.7 patch-2.6.9-rc4 298159 20041007 2-way 2200 5 2 6 50.0 2.6.9-rc2-mm1 297827 20040908 2-way 7246 8 3 6 51.1 2.6.9-rc2-mm2 297828 20040908 2-way 6999 8 3 3 125.1 2.6.9-rc3-mm3 298016 20040908 2-way 7246 8 3 6 52.3 2.6.9-rc4-mm1 298158 20041007 2-way 2200 5 2 6 50.9 linux-2.6.9 298319 20041007 2-way 2199 8 2 7 45.6 patch-2.6.10-rc1 298400 20041007 2-way 2198 6 2 6 50.1 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ * Note: When RunTime > 120 min, this usually indicates a test hung. * For details on any particular test, please access it via http://khack.osdl.org/stp/$TestReq * More info and search tools available at http://www.osdl.org/stp/ The October release of LTP reorganizes the way the suite runs, as can be seen by the change in number of tests run, however the test failure results still appear to be comparable to past results. -- Bryce Harrington == Reaim Performance Results == Reaim is a rework of the AIM-7 multi-user benchmark. The version of the test run at OSDL runs two workloads. The new_dbase workload simulates the type of system activity typical of a database. The workload is a mix of IO intensive and CPU intensive tasks. The compute workload is very CPU-intensive. The new_fserver workload does a great deal of file IO Version 0.10 of the kit was released on to Sourceforge. Added are some scripts to create and query a MySQL database. We've created a database at OSDL that holds all the run information from all successful STP runs. The tools create comparison graphs, and will average multiple runs. There are some new graphs on the Web, showing 2.6.9 test results. Further data: http://developer.osdl.org/cliffw/reaim/compares/index.html http://developer.osdl.org/cliffw/reaim/index.html -- Cliff White == Open POSIX Testsuite Results == ~~~~ Failed ~~~~ ~~~~ Failed ~~~~ Kernel Pass Build Link Test Untstd Unrslv Unsptd Killd Hung ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ patch-2.4.28-rc1 1129 183 12 64 47 90 29 33 8 2.6.9-rc2-mm2 1176 183 12 61 46 85 29 3 1 2.6.9-rc2-mm3 1177 183 12 61 46 84 29 3 1 2.6.9-rc3 1176 183 12 61 46 85 29 3 0 patch-2.6.9-ac2 1177 183 12 62 46 84 29 3 0 patch-2.6.9-ac3 1177 183 12 62 46 84 29 3 0 patch-2.6.9-ac4 1176 183 12 62 46 85 29 3 0 patch-2.6.10-rc1 1177 183 12 62 46 84 29 3 0 -- Bryce Harrington == STP 3.0.10 == We are into the 'release early and often' phase now, so keep those complaints coming in. Fixes this month were minor, we've improved the reliability of the 8-CPU systems somewhat. Console hangs continue to be an issue. Several fixes to the web interface have been deployed. We've started work on Gentoo and Debian images. NEXT STEPS: * More distros! * New commandline reporting tools - see WebService::TestSystem on CPAN -- Cliff White == About This Report == This report is provided by the OSDL Testing and Performance Department to help share the results of our testing efforts to a wider audience. The material in this report is Copyright (C) 2004 OSDL, and is provided for use under terms of the GPL. |
From: Bryce H. <br...@os...> - 2004-10-05 00:56:29
|
An update to the web interface has been deployed into production at http://www.osdl.org/stp/. This is primarily a bug fix release and documentation update. The 3.0.7 release, deployed Thursday, focused on the final step for the test parameter refactoring; the objective of this change was to simplify the way parameters were stored. A bug was introduced into the interface in the process that caused certain test parameters to fail to be stored in the database; this bug was fixed in the 3.0.8 release. Other changes in the include: 3.0.7: + Added GROUP BY to prevent multiple rows per test request from appearing due to multiple software patches + Revised the test documentation to combine script params and test description into a single page. Updated links to those pages accordingly. + Added named anchors to the test details page 3.0.8: + Fix 1037818 test cancel confirmation repeats itself 3 time + Fix 1038590 stp ignoring test parameters + Fix 1035767 link to test description page in test options section + Fix 1036753 consolidate lines for test summaries + Fix 1013038 anchors incorrectly defined in script_param.html Bryce |
From: Bryce H. <br...@os...> - 2004-09-10 23:47:42
|
Oh, one other change * Fixed bug reported by Con where paging through search results causes the selection to be lost. (I.e., search for 'Canceled' tests, click page 2, and *all* results are shown). Bryce On Fri, 10 Sep 2004, Bryce Harrington wrote: > The web interface on www.osdl.org/stp has been updated. Changes > include: > > * Added support for writing into new test parameter db table. > * Added description of open_posix testsuite > > Bryce > > > > ------------------------------------------------------- > This SF.Net email is sponsored by: YOU BE THE JUDGE. Be one of 170 > Project Admins to receive an Apple iPod Mini FREE for your judgement on > who ports your project to Linux PPC the best. Sponsored by IBM. > Deadline: Sept. 13. Go here: http://sf.net/ppc_contest.php > _______________________________________________ > Stp-announce mailing list > Stp...@li... > https://lists.sourceforge.net/lists/listinfo/stp-announce > |
From: Bryce H. <br...@os...> - 2004-09-10 23:38:32
|
The web interface on www.osdl.org/stp has been updated. Changes include: * Added support for writing into new test parameter db table. * Added description of open_posix testsuite Bryce |
From: Bryce H. <br...@br...> - 2004-08-24 20:21:51
|
STP 3.0.2 is released and available for download on SourceForge. Changes * Added fix so test will clean up properly after compile failures * Changed order of output in stp_client.pl * Removed dependency on Template * Removed templates install cmd from Makefile.PL * Fix for failure to log app install * Added more failed test output |
From: Bryce H. <br...@os...> - 2004-08-19 00:34:41
|
We've just posted a tarball of the STP 3.0.1 code. This is the first time we've published a tarball of the code in quite a while (since pre-3.0), so there's likely to be some packaging issues, that we'll be fixing and updating as we go. If you want to try installing STP, please report any problems you encounter to the STP bug tracker. Thanks, Bryce |
From: Bryce H. <br...@os...> - 2004-08-17 23:06:51
|
An updated STP release has been deployed to the OSDL website at www.osdl.org. Changes by the STP team are primarily bug fixes (see below for details). * FIX 1002756 - sysctl options not handled right * FIX 1002244 - The disk mount function failing but not returning error * FIX 1000189 - state_timer table not in sync with host table * FIX 1008784 - Cannot search for machines * FIX 1000430 - sysctl options cause db error * FIX 1004043 - parameter submission for aio-stress, params in wrong columns * FIX 906097 - Misspelling * Improved logging during client exits * exit_clean() fixes * Improved output from stp_include.sh * Fix - Do not unset values from away (else they won't get into the where clause). * Default the host type selection to first one in the list * Add some docs to the search page regarding Hosts, etc. * Add examples for the Lilo, Environment, and Sysctl boxes. * Sync up the param & test pages from osdl_extranet to zope * Consider alternative to 'Command' as header for results column * Move the ":" inside the <a></a> so it doesn't line break for sysstat link * test parameter documentation & links * plm link for linux kernel fixed Bryce |
From: Bryce H. <br...@os...> - 2004-08-10 01:01:20
|
On Friday we deployed fixes for the issues related to test parameters, and today verified they work. You should now be able to submit test requests with test parameters without issue. Submit a bug report to http://sf.net/projects/stp/ if you notice problems. Thanks, Bryce |
From: Bryce H. <br...@os...> - 2004-08-07 15:53:55
|
We've brought STP up to date with the latest version of LTP, and verified it runs correctly on our UMP and SMP systems. http://www.osdl.org/stp/ Btw, we've also deployed the new 3.0 version of STP as of a couple weeks ago. This release includes a capability to vary software in addition to the kernel, such as sysstat, PostgreSQL, etc. It now supports test options as well. Thanks, Bryce |
From: Bryce H. <br...@os...> - 2004-08-06 23:09:04
|
We've just deployed some fixes to the STP web interface to correct issues regarding queueing tests with test parameters. There had been a bad miscommunication about how test parameters were to be implemented, but I think we've straightened it out. Also, earlier this week we deployed some fixes for the search page for searching on username, host, etc.; those had been failing due to the way Zope was (not) handling undef'd strings. For the backend, we've deployed fixes for sysctl (which was not being taken into account properly in the backend) and re-added the clean-reboot capability that allows bypassing re-imaging for certain well-behaved tests. This will assist in reducing turn-around time. We expect to be doing another revision of the test parameter implementation, because we've found the current design is very hard to maintain. We've identified a simpler approach that is more consistent with standard database normalization methods, that we'll be switching to. We are also working on an installation package for the backend portion of STP, in case others wish to run the framework. This will include a commandline script for queueing up tests, suitable for you to crontab. Bryce |