You can subscribe to this list here.
| 2002 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
(1) |
Oct
(122) |
Nov
(152) |
Dec
(69) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2003 |
Jan
(6) |
Feb
(25) |
Mar
(73) |
Apr
(82) |
May
(24) |
Jun
(25) |
Jul
(10) |
Aug
(11) |
Sep
(10) |
Oct
(54) |
Nov
(203) |
Dec
(182) |
| 2004 |
Jan
(307) |
Feb
(305) |
Mar
(430) |
Apr
(312) |
May
(187) |
Jun
(342) |
Jul
(487) |
Aug
(637) |
Sep
(336) |
Oct
(373) |
Nov
(441) |
Dec
(210) |
| 2005 |
Jan
(385) |
Feb
(480) |
Mar
(636) |
Apr
(544) |
May
(679) |
Jun
(625) |
Jul
(810) |
Aug
(838) |
Sep
(634) |
Oct
(521) |
Nov
(965) |
Dec
(543) |
| 2006 |
Jan
(494) |
Feb
(431) |
Mar
(546) |
Apr
(411) |
May
(406) |
Jun
(322) |
Jul
(256) |
Aug
(401) |
Sep
(345) |
Oct
(542) |
Nov
(308) |
Dec
(481) |
| 2007 |
Jan
(427) |
Feb
(326) |
Mar
(367) |
Apr
(255) |
May
(244) |
Jun
(204) |
Jul
(223) |
Aug
(231) |
Sep
(354) |
Oct
(374) |
Nov
(497) |
Dec
(362) |
| 2008 |
Jan
(322) |
Feb
(482) |
Mar
(658) |
Apr
(422) |
May
(476) |
Jun
(396) |
Jul
(455) |
Aug
(267) |
Sep
(280) |
Oct
(253) |
Nov
(232) |
Dec
(304) |
| 2009 |
Jan
(486) |
Feb
(470) |
Mar
(458) |
Apr
(423) |
May
(696) |
Jun
(461) |
Jul
(551) |
Aug
(575) |
Sep
(134) |
Oct
(110) |
Nov
(157) |
Dec
(102) |
| 2010 |
Jan
(226) |
Feb
(86) |
Mar
(147) |
Apr
(117) |
May
(107) |
Jun
(203) |
Jul
(193) |
Aug
(238) |
Sep
(300) |
Oct
(246) |
Nov
(23) |
Dec
(75) |
| 2011 |
Jan
(133) |
Feb
(195) |
Mar
(315) |
Apr
(200) |
May
(267) |
Jun
(293) |
Jul
(353) |
Aug
(237) |
Sep
(278) |
Oct
(611) |
Nov
(274) |
Dec
(260) |
| 2012 |
Jan
(303) |
Feb
(391) |
Mar
(417) |
Apr
(441) |
May
(488) |
Jun
(655) |
Jul
(590) |
Aug
(610) |
Sep
(526) |
Oct
(478) |
Nov
(359) |
Dec
(372) |
| 2013 |
Jan
(467) |
Feb
(226) |
Mar
(391) |
Apr
(281) |
May
(299) |
Jun
(252) |
Jul
(311) |
Aug
(352) |
Sep
(481) |
Oct
(571) |
Nov
(222) |
Dec
(231) |
| 2014 |
Jan
(185) |
Feb
(329) |
Mar
(245) |
Apr
(238) |
May
(281) |
Jun
(399) |
Jul
(382) |
Aug
(500) |
Sep
(579) |
Oct
(435) |
Nov
(487) |
Dec
(256) |
| 2015 |
Jan
(338) |
Feb
(357) |
Mar
(330) |
Apr
(294) |
May
(191) |
Jun
(108) |
Jul
(142) |
Aug
(261) |
Sep
(190) |
Oct
(54) |
Nov
(83) |
Dec
(22) |
| 2016 |
Jan
(49) |
Feb
(89) |
Mar
(33) |
Apr
(50) |
May
(27) |
Jun
(34) |
Jul
(53) |
Aug
(53) |
Sep
(98) |
Oct
(206) |
Nov
(93) |
Dec
(53) |
| 2017 |
Jan
(65) |
Feb
(82) |
Mar
(102) |
Apr
(86) |
May
(187) |
Jun
(67) |
Jul
(23) |
Aug
(93) |
Sep
(65) |
Oct
(45) |
Nov
(35) |
Dec
(17) |
| 2018 |
Jan
(26) |
Feb
(35) |
Mar
(38) |
Apr
(32) |
May
(8) |
Jun
(43) |
Jul
(27) |
Aug
(30) |
Sep
(43) |
Oct
(42) |
Nov
(38) |
Dec
(67) |
| 2019 |
Jan
(32) |
Feb
(37) |
Mar
(53) |
Apr
(64) |
May
(49) |
Jun
(18) |
Jul
(14) |
Aug
(53) |
Sep
(25) |
Oct
(30) |
Nov
(49) |
Dec
(31) |
| 2020 |
Jan
(87) |
Feb
(45) |
Mar
(37) |
Apr
(51) |
May
(99) |
Jun
(36) |
Jul
(11) |
Aug
(14) |
Sep
(20) |
Oct
(24) |
Nov
(40) |
Dec
(23) |
| 2021 |
Jan
(14) |
Feb
(53) |
Mar
(85) |
Apr
(15) |
May
(19) |
Jun
(3) |
Jul
(14) |
Aug
(1) |
Sep
(57) |
Oct
(73) |
Nov
(56) |
Dec
(22) |
| 2022 |
Jan
(3) |
Feb
(22) |
Mar
(6) |
Apr
(55) |
May
(46) |
Jun
(39) |
Jul
(15) |
Aug
(9) |
Sep
(11) |
Oct
(34) |
Nov
(20) |
Dec
(36) |
| 2023 |
Jan
(79) |
Feb
(41) |
Mar
(99) |
Apr
(169) |
May
(48) |
Jun
(16) |
Jul
(16) |
Aug
(57) |
Sep
(19) |
Oct
|
Nov
|
Dec
|
| S | M | T | W | T | F | S |
|---|---|---|---|---|---|---|
|
1
(16) |
2
(22) |
3
(23) |
4
(12) |
5
(24) |
6
(28) |
7
(16) |
|
8
(3) |
9
(2) |
10
(9) |
11
(22) |
12
(19) |
13
(19) |
14
(15) |
|
15
(10) |
16
(23) |
17
(27) |
18
(31) |
19
(26) |
20
(19) |
21
(17) |
|
22
(6) |
23
(4) |
24
(3) |
25
(14) |
26
(1) |
27
(20) |
28
(14) |
|
29
(10) |
30
(26) |
|
|
|
|
|
|
From: Florian K. <fl...@ei...> - 2013-09-08 21:35:06
|
On 09/08/2013 09:09 PM, Philippe Waroquiers wrote: > Every night, Valgrind is compiled and regression tested on a bunch of > platform. However, there is no continuous tracking of the performance. > => it has been suggested to add in the nightly script a run of > the performance tests. > This mail discusses how we could set that up (in particular to decide > how much additional cpu these perf tests can take). > > On a slow computer (pentium 4): > time perl perf/vg_perf --tools=none,memcheck,cachegrind,callgrind,helgrind,drd,exp-sgcheck,exp-dhat perf > takes 32 minutes. > On a faster computers such as gcc20, and on gcc110 (but without exp-sgcheck, crashing), > it takes about 10 minutes. > See details below. > > If we want more reproducable nrs, we have to give a --reps=... arg. > Then to have a comparison with previous day, it further doubles the nr of run. > So if we use e.g. --reps=3, this would mean about 3 hours of cpu > on a slow computer, and 1 hour on faster computers. The problem with this approach is that you don't notice performance degradation that creeps in on you. Say 1% a day for several days in a row. 1% degradation would not get any attention but when it accumulates over time, it should. What if we run perf every day and send the results to e.g pe...@va...? Whenever mail is received at that address a little script runs that reads the perf results and collects them in some light weight "data base" that we could look at at valgrind.org/perf. It could be as simple as a HTML table (per platform) with one row per day that shows, for each tool, the difference to the previous run and the difference to some base line run. Yes, this is more work to set up than just sending the results to the developers list. But the results might get more attention that way. > So, a few questions: > 1. how much --reps ? Is 3 ok ? I typically use --reps=5 but if I had a better handle on variations or a better tool to measure runtime than "time" less repetition mught be possible. > 2. do we run perf for all tools ? > or only for non-experiment tools ? > or for even less tools (only none and memcheck ?) Non-experimental tools should be enough. Florian |
|
From: Philippe W. <phi...@sk...> - 2013-09-08 19:09:51
|
Every night, Valgrind is compiled and regression tested on a bunch of platform. However, there is no continuous tracking of the performance. => it has been suggested to add in the nightly script a run of the performance tests. This mail discusses how we could set that up (in particular to decide how much additional cpu these perf tests can take). On a slow computer (pentium 4): time perl perf/vg_perf --tools=none,memcheck,cachegrind,callgrind,helgrind,drd,exp-sgcheck,exp-dhat perf takes 32 minutes. On a faster computers such as gcc20, and on gcc110 (but without exp-sgcheck, crashing), it takes about 10 minutes. See details below. If we want more reproducable nrs, we have to give a --reps=... arg. Then to have a comparison with previous day, it further doubles the nr of run. So if we use e.g. --reps=3, this would mean about 3 hours of cpu on a slow computer, and 1 hour on faster computers. So, a few questions: 1. how much --reps ? Is 3 ok ? 2. do we run perf for all tools ? or only for non-experiment tools ? or for even less tools (only none and memcheck ?) 3. I think we should we output the perf nrs in the short log (sent by mail) (after the reg tests results). Unclear how to make a shorter summary of these nrs. 4. How to decrease the variations ? Idea is to use taskset to force all these tests to run on a single cpu, to avoid cpu frequency scaling and process migration to badly interact. 5. Any other idea/suggestion/... ? Philippe Slow computer (pentium 4) -- Running tests in perf ---------------------------------------------- bigcode1 trunk_untouched:0.19s no: 3.9s (20.3x, -----) me: 7.0s (36.8x, -----) ca:22.1s (116.2x, -----) ca:37.5s (197.4x, -----) he: 4.8s (25.2x, -----) dr: 4.7s (24.7x, -----) ex:13.2s (69.6x, -----) ex: 6.3s (33.3x, -----) bigcode2 trunk_untouched:0.20s no: 9.2s (46.1x, -----) me:18.7s (93.5x, -----) ca:31.6s (158.2x, -----) ca:62.8s (313.9x, -----) he:12.7s (63.7x, -----) dr:11.8s (58.9x, -----) ex:21.8s (108.8x, -----) ex:13.7s (68.5x, -----) bz2 trunk_untouched:1.25s no: 5.1s ( 4.1x, -----) me:17.8s (14.2x, -----) ca:77.9s (62.3x, -----) ca:51.5s (41.2x, -----) he:38.1s (30.5x, -----) dr:34.7s (27.8x, -----) ex:110.2s (88.1x, -----) ex:23.0s (18.4x, -----) fbench trunk_untouched:0.66s no: 6.0s ( 9.0x, -----) me:13.2s (19.9x, -----) ca:27.6s (41.8x, -----) ca:21.0s (31.8x, -----) he:14.9s (22.6x, -----) dr:11.2s (17.0x, -----) ex:48.0s (72.7x, -----) ex:10.3s (15.7x, -----) ffbench trunk_untouched:2.00s no: 5.6s ( 2.8x, -----) me: 9.8s ( 4.9x, -----) ca:27.3s (13.7x, -----) ca: 8.6s ( 4.3x, -----) he:33.7s (16.9x, -----) dr:13.8s ( 6.9x, -----) ex:38.4s (19.2x, -----) ex: 9.6s ( 4.8x, -----) heap trunk_untouched:0.23s no: 2.3s (10.0x, -----) me:12.8s (55.8x, -----) ca:25.2s (109.7x, -----) ca:24.7s (107.3x, -----) he:31.3s (136.1x, -----) dr:12.7s (55.1x, -----) ex:54.9s (238.5x, -----) ex:31.6s (137.3x, -----) heap_pdb4 trunk_untouched:0.27s no: 2.5s ( 9.2x, -----) me:23.9s (88.6x, -----) ca:27.4s (101.5x, -----) ca:26.6s (98.5x, -----) he:34.9s (129.4x, -----) dr:14.0s (51.9x, -----) ex:55.8s (206.7x, -----) ex:36.4s (134.9x, -----) many-loss-records trunk_untouched:0.03s no: 0.8s (25.0x, -----) me: 3.2s (106.0x, -----) ca: 4.3s (142.7x, -----) ca: 3.5s (116.3x, -----) he: 4.6s (153.0x, -----) dr: 2.5s (83.0x, -----) ex:13.7s (456.3x, -----) ex: 5.2s (171.7x, -----) many-xpts trunk_untouched:0.09s no: 1.1s (11.7x, -----) me: 4.9s (54.3x, -----) ca:11.1s (122.9x, -----) ca: 9.6s (106.7x, -----) he:11.2s (124.7x, -----) dr: 4.5s (50.6x, -----) ex:23.9s (265.6x, -----) ex: 4.8s (52.9x, -----) sarp trunk_untouched:0.06s no: 0.9s (14.8x, -----) me: 6.2s (103.8x, -----) ca: 5.8s (96.8x, -----) ca: 6.0s (100.7x, -----) he:30.0s (500.2x, -----) dr: 2.9s (48.8x, -----) ex:24.0s (400.2x, -----) ex: 1.3s (21.0x, -----) tinycc trunk_untouched:0.43s no: 3.7s ( 8.6x, -----) me:26.5s (61.6x, -----) ca:56.8s (132.2x, -----) ca:35.8s (83.1x, -----) he:43.7s (101.7x, -----) dr:28.0s (65.1x, -----) ex:101.6s (236.2x, -----) ex:31.2s (72.5x, -----) -- Finished tests in perf gcc110 - Running tests in perf ---------------------------------------------- bigcode1 trunk_untouched:0.23s no: 1.9s ( 8.3x, -----) me: 3.1s (13.6x, -----) ca: 6.3s (27.5x, -----) ca:19.1s (83.0x, -----) he: 1.9s ( 8.3x, -----) dr: 1.8s ( 7.6x, -----) ex: 2.4s (10.2x, -----) bigcode2 trunk_untouched:0.23s no: 1.6s ( 7.2x, -----) me: 3.0s (13.1x, -----) ca: 5.7s (24.8x, -----) ca:18.5s (80.3x, -----) he: 2.1s ( 9.0x, -----) dr: 1.7s ( 7.3x, -----) ex: 2.3s ( 9.9x, -----) bz2 trunk_untouched:0.73s no: 4.5s ( 6.2x, -----) me:12.0s (16.5x, -----) ca:26.4s (36.1x, -----) ca:26.8s (36.6x, -----) he:14.8s (20.2x, -----) dr:20.5s (28.1x, -----) ex:13.1s (17.9x, -----) fbench trunk_untouched:0.34s no: 2.2s ( 6.5x, -----) me: 5.3s (15.7x, -----) ca: 8.2s (24.0x, -----) ca: 8.8s (25.7x, -----) he: 5.4s (16.0x, -----) dr: 5.1s (14.9x, -----) ex: 4.8s (14.0x, -----) ffbench trunk_untouched:0.45s no: 1.1s ( 2.4x, -----) me: 2.8s ( 6.2x, -----) ca: 7.7s (17.0x, -----) ca: 2.6s ( 5.8x, -----) he: 7.2s (16.0x, -----) dr: 5.1s (11.4x, -----) ex: 3.4s ( 7.6x, -----) heap trunk_untouched:0.41s no: 2.4s ( 5.8x, -----) me: 9.9s (24.1x, -----) ca:12.9s (31.5x, -----) ca:13.8s (33.8x, -----) he:13.3s (32.6x, -----) dr: 8.1s (19.7x, -----) ex:17.1s (41.8x, -----) heap_pdb4 trunk_untouched:0.42s no: 2.8s ( 6.6x, -----) me:14.3s (34.0x, -----) ca:13.4s (32.0x, -----) ca:14.7s (34.9x, -----) he:14.6s (34.9x, -----) dr: 9.0s (21.5x, -----) ex:20.4s (48.5x, -----) many-loss-records trunk_untouched:0.03s no: 0.6s (18.3x, -----) me: 2.2s (74.3x, -----) ca: 1.9s (65.0x, -----) ca: 1.9s (64.7x, -----) he: 2.1s (70.0x, -----) dr: 1.5s (49.7x, -----) ex: 3.3s (109.7x, -----) many-xpts trunk_untouched:0.07s no: 0.8s (11.1x, -----) me: 3.5s (49.3x, -----) ca: 3.0s (43.4x, -----) ca: 4.9s (69.6x, -----) he: 5.2s (74.7x, -----) dr: 2.3s (32.3x, -----) ex: 2.8s (39.9x, -----) sarp trunk_untouched:0.02s no: 0.4s (21.0x, -----) me: 3.9s (192.5x, -----) ca: 2.0s (101.0x, -----) ca: 3.0s (151.0x, -----) he:11.3s (565.5x, -----) dr: 1.0s (52.0x, -----) ex: 0.6s (31.5x, -----) tinycc trunk_untouched:0.28s no: 3.1s (11.0x, -----) me:15.9s (56.7x, -----) ca:16.5s (59.0x, -----) ca:17.3s (61.7x, -----) he:18.9s (67.6x, -----) dr:12.1s (43.0x, -----) ex:18.6s (66.4x, -----) -- Finished tests in perf ---------------------------------------------- == 11 programs, 77 timings ================= gcc20 -- Running tests in perf ---------------------------------------------- bigcode1 trunk_untouched:0.12s no: 1.9s (16.2x, -----) me: 3.7s (30.7x, -----) ca: 4.8s (39.8x, -----) ca:16.5s (137.8x, -----) he: 2.2s (18.4x, -----) dr: 2.1s (17.4x, -----) ex: 4.9s (40.9x, -----) ex: 2.4s (19.8x, -----) bigcode2 trunk_untouched:0.12s no: 4.6s (38.5x, -----) me: 9.5s (79.5x, -----) ca: 8.8s (73.3x, -----) ca:34.3s (285.6x, -----) he: 5.6s (46.8x, -----) dr: 5.4s (44.7x, -----) ex: 8.5s (70.8x, -----) ex: 6.0s (49.9x, -----) bz2 trunk_untouched:0.70s no: 2.2s ( 3.2x, -----) me: 7.0s (10.0x, -----) ca:13.0s (18.6x, -----) ca:21.1s (30.1x, -----) he: 9.2s (13.2x, -----) dr:14.0s (20.0x, -----) ex:24.9s (35.5x, -----) ex: 7.3s (10.5x, -----) fbench trunk_untouched:0.28s no: 1.3s ( 4.6x, -----) me: 4.0s (14.3x, -----) ca: 3.9s (13.9x, -----) ca: 6.3s (22.4x, -----) he: 3.4s (12.1x, -----) dr: 2.9s (10.2x, -----) ex:15.1s (53.9x, -----) ex: 2.8s ( 9.9x, -----) ffbench trunk_untouched:0.25s no: 1.2s ( 4.6x, -----) me: 3.3s (13.3x, -----) ca: 5.1s (20.3x, -----) ca: 2.4s ( 9.4x, -----) he: 5.4s (21.5x, -----) dr: 3.8s (15.3x, -----) ex: 9.7s (38.8x, -----) ex: 2.6s (10.4x, -----) heap trunk_untouched:0.10s no: 0.7s ( 7.4x, -----) me: 5.8s (58.1x, -----) ca: 4.3s (42.6x, -----) ca: 7.3s (73.4x, -----) he: 8.4s (83.6x, -----) dr: 5.0s (49.5x, -----) ex:17.5s (174.6x, -----) ex:10.6s (105.8x, -----) heap_pdb4 trunk_untouched:0.12s no: 0.8s ( 6.8x, -----) me: 9.8s (81.9x, -----) ca: 4.4s (36.3x, -----) ca: 7.8s (65.2x, -----) he:10.5s (87.3x, -----) dr: 5.4s (44.8x, -----) ex:16.1s (133.8x, -----) ex:10.9s (91.2x, -----) many-loss-records trunk_untouched:0.02s no: 0.3s (14.0x, -----) me: 1.4s (71.0x, -----) ca: 0.8s (39.0x, -----) ca: 1.1s (57.0x, -----) he: 1.3s (63.5x, -----) dr: 1.0s (50.0x, -----) ex: 4.7s (237.0x, -----) ex: 1.9s (93.0x, -----) many-xpts trunk_untouched:0.04s no: 0.3s ( 8.0x, -----) me: 2.0s (49.5x, -----) ca: 1.1s (27.8x, -----) ca: 3.0s (76.0x, -----) he: 2.5s (61.5x, -----) dr: 1.4s (35.2x, -----) ex: 7.6s (190.0x, -----) ex: 1.6s (40.5x, -----) sarp trunk_untouched:0.03s no: 0.3s ( 9.3x, -----) me: 2.4s (81.0x, -----) ca: 1.0s (34.0x, -----) ca: 2.0s (66.0x, -----) he: 7.4s (247.3x, -----) dr: 0.9s (29.0x, -----) ex: 6.7s (222.7x, -----) ex: 0.4s (14.7x, -----) tinycc trunk_untouched:0.26s no: 1.6s ( 6.0x, -----) me:10.2s (39.3x, -----) ca: 9.2s (35.3x, -----) ca:12.6s (48.3x, -----) he:11.1s (42.8x, -----) dr: 8.9s (34.3x, -----) ex:38.5s (147.9x, -----) ex:12.1s (46.4x, -----) -- Finished tests in perf ---------------------------------------------- == 11 programs, 88 timings ================= |
|
From: Petar J. <mip...@gm...> - 2013-09-08 02:06:45
|
Here are the numbers for MIPS32. $ perl perf/vg_perf --vg=../3.8.1 --vg=../trunk --reps=5 perf 2>&1 | tee perf_mips.txt -- Running tests in perf ---------------------------------------------- -- bigcode1 -- bigcode1 3.8.1 :0.47s no: 9.3s (19.9x, -----) me:16.5s (35.1x, -----) bigcode1 trunk :0.47s no: 9.8s (20.8x, -4.8%) me:14.2s (30.3x, 13.9%) -- bigcode2 -- bigcode2 3.8.1 :0.49s no:16.4s (33.4x, -----) me:30.8s (62.8x, -----) bigcode2 trunk :0.49s no:16.8s (34.2x, -2.6%) me:28.8s (58.7x, 6.5%) -- bz2 -- bz2 3.8.1 :2.40s no:13.6s ( 5.7x, -----) me:47.3s (19.7x, -----) bz2 trunk :2.40s no:13.9s ( 5.8x, -2.4%) me:39.7s (16.5x, 16.0%) -- fbench -- fbench 3.8.1 :1.79s no:40.0s (22.4x, -----) me:54.9s (30.7x, -----) fbench trunk :1.79s no:32.4s (18.1x, 19.0%) me:41.6s (23.3x, 24.1%) -- ffbench -- ffbench 3.8.1 :0.84s no:23.3s (27.7x, -----) me:37.4s (44.5x, -----) ffbench trunk :0.84s no:22.8s (27.1x, 2.2%) me:32.1s (38.2x, 14.0%) -- heap -- heap 3.8.1 :1.45s no: 5.9s ( 4.1x, -----) me:34.7s (23.9x, -----) heap trunk :1.45s no: 6.5s ( 4.5x,-10.3%) me:34.4s (23.7x, 0.7%) -- heap_pdb4 -- heap_pdb4 3.8.1 :1.52s no: 6.4s ( 4.2x, -----) me:52.7s (34.7x, -----) heap_pdb4 trunk :1.52s no: 7.3s ( 4.8x,-13.7%) me:55.3s (36.4x, -4.9%) -- many-loss-records -- many-loss-records 3.8.1 :0.16s no: 1.3s ( 7.9x, -----) me: 6.7s (41.9x, -----) many-loss-records trunk :0.16s no: 1.7s (10.6x,-33.9%) me: 7.2s (44.9x, -7.2%) -- many-xpts -- many-xpts 3.8.1 :0.30s no: 2.3s ( 7.6x, -----) me: 7.2s (24.1x, -----) many-xpts trunk :0.30s no: 2.7s ( 9.1x,-20.3%) me: 7.7s (25.8x, -6.9%) -- sarp -- sarp 3.8.1 :0.06s no: 1.4s (24.0x, -----) me: 8.8s (147.2x, -----) sarp trunk :0.06s no: 1.9s (32.2x,-34.0%) me:10.0s (167.2x,-13.6%) -- tinycc -- tinycc 3.8.1 :1.00s no: 9.9s ( 9.9x, -----) me:39.7s (39.7x, -----) tinycc trunk :1.00s no:10.3s (10.3x, -3.7%) me:37.8s (37.8x, 4.7%) -- Finished tests in perf ---------------------------------------------- == 11 programs, 44 timings ================= Regards, Petar On Sat, Sep 7, 2013 at 8:35 PM, Philippe Waroquiers < phi...@sk...> wrote: > On Fri, 2013-09-06 at 15:52 +0200, Julian Seward wrote: > > Also, r13278 has effect for 64 bit targets but not for 32 bit targets > > since 32 bit targets deal with all 4GB "fast" anyway. So: > > > > - it can't account for any slowdowns we see on x86-linux > > - it should also give visible slowdowns on other 64 bit targets, > > not just s390 > > > > We need more numbers :) > Below, you will find numbers for ppc64 and ppc32 (gcc110). > > Basically, > ppc32 trunk is (slightly) faster than 3.8.1 > ppc64 trunk is similar to 3.8.1, sometimes slightly faster > sometimes slightly slower. sarp trunk is however significantly > slower than 3.8.1 > (for the record, the below also contains numbers for 3.7.1 which > is significantly slower for all tests). > > So, nothing to worry on ppc except maybe for sarp in 64 bits. > > Philippe > > ppc32: > > -- Running tests in perf ---------------------------------------------- > -- bigcode1 -- > bigcode1 32bits_trunk_untouched:0.15s no: 2.1s (13.9x, -----) me: 4.4s > (29.3x, -----) > bigcode1 valgrind-3.8.1:0.15s no: 2.1s (14.2x, -1.9%) me: 4.6s (30.7x, > -4.8%) > bigcode1 valgrind-3.7.0:0.15s no: 2.8s (18.8x,-34.9%) me: 5.5s > (36.6x,-25.1%) > -- bigcode2 -- > bigcode2 32bits_trunk_untouched:0.19s no: 4.9s (26.0x, -----) me:11.3s > (59.6x, -----) > bigcode2 valgrind-3.8.1:0.19s no: 5.0s (26.4x, -1.4%) me:11.5s (60.4x, > -1.4%) > bigcode2 valgrind-3.7.0:0.19s no: 5.7s (29.9x,-15.2%) me:12.4s (65.1x, > -9.2%) > -- bz2 -- > bz2 32bits_trunk_untouched:0.70s no: 3.9s ( 5.6x, -----) me:10.9s > (15.6x, -----) > bz2 valgrind-3.8.1:0.70s no: 3.9s ( 5.6x, 0.3%) me:11.2s (16.1x, > -2.9%) > bz2 valgrind-3.7.0:0.70s no: 4.6s ( 6.6x,-16.8%) me:12.0s (17.1x, > -9.7%) > -- fbench -- > fbench 32bits_trunk_untouched:0.33s no: 2.1s ( 6.2x, -----) me: 4.8s > (14.6x, -----) > fbench valgrind-3.8.1:0.33s no: 2.0s ( 6.1x, 2.9%) me: 4.9s (14.8x, > -1.4%) > fbench valgrind-3.7.0:0.33s no: 2.2s ( 6.6x, -5.3%) me: 5.1s (15.4x, > -5.4%) > -- ffbench -- > ffbench 32bits_trunk_untouched:0.36s no: 0.9s ( 2.6x, -----) me: 2.2s ( > 6.2x, -----) > ffbench valgrind-3.8.1:0.36s no: 0.9s ( 2.6x, 0.0%) me: 2.4s ( 6.8x, > -8.0%) > ffbench valgrind-3.7.0:0.36s no: 1.0s ( 2.9x, -9.6%) me: 2.4s ( 6.6x, > -5.3%) > -- heap -- > heap 32bits_trunk_untouched:0.44s no: 2.0s ( 4.6x, -----) me: 8.2s > (18.6x, -----) > heap valgrind-3.8.1:0.44s no: 1.9s ( 4.4x, 4.0%) me: 8.7s (19.8x, > -6.6%) > heap valgrind-3.7.0:0.44s no: 2.3s ( 5.3x,-14.9%) me: 8.7s (19.7x, > -5.9%) > -- heap_pdb4 -- > heap_pdb4 32bits_trunk_untouched:0.45s no: 2.2s ( 4.9x, -----) me:11.9s > (26.5x, -----) > heap_pdb4 valgrind-3.8.1:0.45s no: 2.1s ( 4.6x, 5.9%) me:12.5s (27.9x, > -5.1%) > heap_pdb4 valgrind-3.7.0:0.45s no: 2.5s ( 5.5x,-11.3%) me:15.6s > (34.8x,-31.1%) > -- many-loss-records -- > many-loss-records 32bits_trunk_untouched:0.04s no: 0.4s (10.5x, -----) > me: 1.7s (42.8x, -----) > many-loss-records valgrind-3.8.1:0.04s no: 0.4s ( 9.5x, 9.5%) me: 1.8s > (45.0x, -5.3%) > many-loss-records valgrind-3.7.0:0.04s no: 0.4s ( 9.5x, 9.5%) me: 1.9s > (47.8x,-11.7%) > -- many-xpts -- > many-xpts 32bits_trunk_untouched:0.08s no: 0.8s ( 9.9x, -----) me: 2.1s > (26.5x, -----) > many-xpts valgrind-3.8.1:0.08s no: 0.8s ( 9.4x, 5.1%) me: 2.1s (26.4x, > 0.5%) > many-xpts valgrind-3.7.0:0.08s no: 0.7s ( 9.0x, 8.9%) me: 2.1s (26.6x, > -0.5%) > -- sarp -- > sarp 32bits_trunk_untouched:0.02s no: 0.3s (15.5x, -----) me: 2.5s > (126.5x, -----) > sarp valgrind-3.8.1:0.02s no: 0.3s (14.5x, 6.5%) me: 2.5s (125.5x, > 0.8%) > sarp valgrind-3.7.0:0.02s no: 0.3s (13.5x, 12.9%) me: 2.7s (133.5x, > -5.5%) > -- tinycc -- > tinycc 32bits_trunk_untouched:0.32s no: 2.9s ( 9.2x, -----) me:10.5s > (32.9x, -----) > tinycc valgrind-3.8.1:0.32s no: 2.9s ( 9.2x, 0.0%) me:10.9s (34.0x, > -3.2%) > tinycc valgrind-3.7.0:0.32s no: 3.0s ( 9.5x, -3.4%) me:11.1s (34.5x, > -4.8%) > -- Finished tests in perf ---------------------------------------------- > > == 11 programs, 66 timings ================= > > > > > ppc64: > > perl perf/vg_perf --vg=../trunk_untouched --vg=../valgrind-3.8.1 > --vg=../valgrind-3.7.0 --reps=5 perf 2>&1 | tee perf.out > -- Running tests in perf ---------------------------------------------- > -- bigcode1 -- > bigcode1 trunk_untouched:0.21s no: 1.6s ( 7.5x, -----) me: 3.0s (14.1x, > -----) > bigcode1 valgrind-3.8.1:0.21s no: 1.7s ( 8.0x, -5.7%) me: 2.8s (13.3x, > 5.4%) > bigcode1 valgrind-3.7.0:0.21s no: 2.3s (10.8x,-43.7%) me: 3.6s > (17.3x,-23.0%) > -- bigcode2 -- > bigcode2 trunk_untouched:0.21s no: 1.5s ( 7.3x, -----) me: 2.9s (14.0x, > -----) > bigcode2 valgrind-3.8.1:0.21s no: 1.5s ( 7.2x, 0.7%) me: 2.9s (13.8x, > 1.0%) > bigcode2 valgrind-3.7.0:0.21s no: 2.3s (11.0x,-50.3%) me: 3.7s > (17.7x,-27.0%) > -- bz2 -- > bz2 trunk_untouched:0.72s no: 4.6s ( 6.3x, -----) me:11.8s (16.4x, > -----) > bz2 valgrind-3.8.1:0.72s no: 4.5s ( 6.3x, 1.1%) me:12.3s (17.1x, > -4.0%) > bz2 valgrind-3.7.0:0.72s no: 5.4s ( 7.6x,-19.0%) me:13.2s > (18.3x,-11.4%) > -- fbench -- > fbench trunk_untouched:0.34s no: 2.1s ( 6.3x, -----) me: 5.2s (15.4x, > -----) > fbench valgrind-3.8.1:0.34s no: 2.1s ( 6.2x, 2.3%) me: 5.3s (15.5x, > -0.6%) > fbench valgrind-3.7.0:0.34s no: 2.3s ( 6.8x, -7.9%) me: 5.5s (16.1x, > -4.0%) > -- ffbench -- > ffbench trunk_untouched:0.44s no: 1.0s ( 2.3x, -----) me: 2.5s ( 5.7x, > -----) > ffbench valgrind-3.8.1:0.44s no: 1.0s ( 2.2x, 4.9%) me: 2.6s ( 5.8x, > -2.4%) > ffbench valgrind-3.7.0:0.44s no: 1.2s ( 2.6x,-13.7%) me: 2.5s ( 5.7x, > 0.8%) > -- heap -- > heap trunk_untouched:0.41s no: 2.4s ( 5.9x, -----) me: 9.9s (24.1x, > -----) > heap valgrind-3.8.1:0.41s no: 2.4s ( 5.8x, 2.1%) me: 9.9s (24.1x, > -0.3%) > heap valgrind-3.7.0:0.41s no: 3.1s ( 7.6x,-28.6%) me: 9.7s (23.7x, > 1.6%) > -- heap_pdb4 -- > heap_pdb4 trunk_untouched:0.41s no: 2.6s ( 6.3x, -----) me:13.9s (34.0x, > -----) > heap_pdb4 valgrind-3.8.1:0.41s no: 2.5s ( 6.2x, 1.6%) me:13.8s (33.6x, > 1.2%) > heap_pdb4 valgrind-3.7.0:0.41s no: 3.4s ( 8.2x,-30.6%) me:17.4s > (42.4x,-24.9%) > -- many-loss-records -- > many-loss-records trunk_untouched:0.03s no: 0.6s (18.3x, -----) me: 2.2s > (74.0x, -----) > many-loss-records valgrind-3.8.1:0.03s no: 0.5s (17.3x, 5.5%) me: 2.2s > (74.3x, -0.5%) > many-loss-records valgrind-3.7.0:0.03s no: 0.6s (18.3x, 0.0%) me: 2.3s > (77.0x, -4.1%) > -- many-xpts -- > many-xpts trunk_untouched:0.07s no: 0.7s (10.6x, -----) me: 3.4s (48.1x, > -----) > many-xpts valgrind-3.8.1:0.07s no: 0.7s ( 9.9x, 6.8%) me: 3.4s (47.9x, > 0.6%) > many-xpts valgrind-3.7.0:0.07s no: 0.7s (10.4x, 1.4%) me: 3.3s (47.6x, > 1.2%) > -- sarp -- > sarp trunk_untouched:0.02s no: 0.4s (21.0x, -----) me: 3.9s (195.5x, > -----) > sarp valgrind-3.8.1:0.02s no: 0.4s (18.5x, 11.9%) me: 3.2s (160.5x, > 17.9%) > sarp valgrind-3.7.0:0.02s no: 0.3s (16.5x, 21.4%) me: 3.1s (155.5x, > 20.5%) > -- tinycc -- > tinycc trunk_untouched:0.26s no: 3.0s (11.5x, -----) me:14.3s (54.8x, > -----) > tinycc valgrind-3.8.1:0.26s no: 2.9s (11.3x, 1.3%) me:14.3s (54.9x, > -0.1%) > tinycc valgrind-3.7.0:0.26s no: 3.1s (12.0x, -4.7%) me:14.2s (54.7x, > 0.2%) > -- Finished tests in perf ---------------------------------------------- > > == 11 programs, 66 timings ================= > > > > > ------------------------------------------------------------------------------ > Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more! > Discover the easy way to master current and previous Microsoft technologies > and advance your career. Get an incredible 1,500+ hours of step-by-step > tutorial videos with LearnDevNow. Subscribe today and save! > http://pubads.g.doubleclick.net/gampad/clk?id=58041391&iu=/4140/ostg.clktrk > _______________________________________________ > Valgrind-developers mailing list > Val...@li... > https://lists.sourceforge.net/lists/listinfo/valgrind-developers > |