Re: [Valgrind-developers] performances of trunk compared to 3.8.1 ?

[Petar J. <mip...@gm...>]

Here are the numbers for MIPS32.

$ perl perf/vg_perf --vg=../3.8.1 --vg=../trunk --reps=5 perf 2>&1 | tee
perf_mips.txt
-- Running  tests in perf ----------------------------------------------
-- bigcode1 --
bigcode1 3.8.1     :0.47s  no: 9.3s (19.9x, -----)  me:16.5s (35.1x, -----)
bigcode1 trunk     :0.47s  no: 9.8s (20.8x, -4.8%)  me:14.2s (30.3x, 13.9%)
-- bigcode2 --
bigcode2 3.8.1     :0.49s  no:16.4s (33.4x, -----)  me:30.8s (62.8x, -----)
bigcode2 trunk     :0.49s  no:16.8s (34.2x, -2.6%)  me:28.8s (58.7x,  6.5%)
-- bz2 --
bz2      3.8.1     :2.40s  no:13.6s ( 5.7x, -----)  me:47.3s (19.7x, -----)
bz2      trunk     :2.40s  no:13.9s ( 5.8x, -2.4%)  me:39.7s (16.5x, 16.0%)
-- fbench --
fbench   3.8.1     :1.79s  no:40.0s (22.4x, -----)  me:54.9s (30.7x, -----)
fbench   trunk     :1.79s  no:32.4s (18.1x, 19.0%)  me:41.6s (23.3x, 24.1%)
-- ffbench --
ffbench  3.8.1     :0.84s  no:23.3s (27.7x, -----)  me:37.4s (44.5x, -----)
ffbench  trunk     :0.84s  no:22.8s (27.1x,  2.2%)  me:32.1s (38.2x, 14.0%)
-- heap --
heap     3.8.1     :1.45s  no: 5.9s ( 4.1x, -----)  me:34.7s (23.9x, -----)
heap     trunk     :1.45s  no: 6.5s ( 4.5x,-10.3%)  me:34.4s (23.7x,  0.7%)
-- heap_pdb4 --
heap_pdb4 3.8.1     :1.52s  no: 6.4s ( 4.2x, -----)  me:52.7s (34.7x, -----)
heap_pdb4 trunk     :1.52s  no: 7.3s ( 4.8x,-13.7%)  me:55.3s (36.4x, -4.9%)
-- many-loss-records --
many-loss-records 3.8.1     :0.16s  no: 1.3s ( 7.9x, -----)  me: 6.7s
(41.9x, -----)
many-loss-records trunk     :0.16s  no: 1.7s (10.6x,-33.9%)  me: 7.2s
(44.9x, -7.2%)
-- many-xpts --
many-xpts 3.8.1     :0.30s  no: 2.3s ( 7.6x, -----)  me: 7.2s (24.1x, -----)
many-xpts trunk     :0.30s  no: 2.7s ( 9.1x,-20.3%)  me: 7.7s (25.8x, -6.9%)
-- sarp --
sarp     3.8.1     :0.06s  no: 1.4s (24.0x, -----)  me: 8.8s (147.2x, -----)
sarp     trunk     :0.06s  no: 1.9s (32.2x,-34.0%)  me:10.0s (167.2x,-13.6%)
-- tinycc --
tinycc   3.8.1     :1.00s  no: 9.9s ( 9.9x, -----)  me:39.7s (39.7x, -----)
tinycc   trunk     :1.00s  no:10.3s (10.3x, -3.7%)  me:37.8s (37.8x,  4.7%)
-- Finished tests in perf ----------------------------------------------

== 11 programs, 44 timings =================

Regards,
Petar


On Sat, Sep 7, 2013 at 8:35 PM, Philippe Waroquiers <
phi...@sk...> wrote:

> On Fri, 2013-09-06 at 15:52 +0200, Julian Seward wrote:
> > Also, r13278 has effect for 64 bit targets but not for 32 bit targets
> > since 32 bit targets deal with all 4GB "fast" anyway.  So:
> >
> > - it can't account for any slowdowns we see on x86-linux
> > - it should also give visible slowdowns on other 64 bit targets,
> >   not just s390
> >
> > We need more numbers :)
> Below, you will find numbers for ppc64 and ppc32 (gcc110).
>
> Basically,
> ppc32 trunk is (slightly) faster than 3.8.1
> ppc64 trunk is similar to 3.8.1, sometimes slightly faster
> sometimes slightly slower. sarp trunk is however significantly
> slower than 3.8.1
> (for the record, the below also contains numbers for 3.7.1 which
> is significantly slower for all tests).
>
> So, nothing to worry on ppc except maybe for sarp in 64 bits.
>
> Philippe
>
> ppc32:
>
> -- Running  tests in perf ----------------------------------------------
> -- bigcode1 --
> bigcode1 32bits_trunk_untouched:0.15s  no: 2.1s (13.9x, -----)  me: 4.4s
> (29.3x, -----)
> bigcode1 valgrind-3.8.1:0.15s  no: 2.1s (14.2x, -1.9%)  me: 4.6s (30.7x,
> -4.8%)
> bigcode1 valgrind-3.7.0:0.15s  no: 2.8s (18.8x,-34.9%)  me: 5.5s
> (36.6x,-25.1%)
> -- bigcode2 --
> bigcode2 32bits_trunk_untouched:0.19s  no: 4.9s (26.0x, -----)  me:11.3s
> (59.6x, -----)
> bigcode2 valgrind-3.8.1:0.19s  no: 5.0s (26.4x, -1.4%)  me:11.5s (60.4x,
> -1.4%)
> bigcode2 valgrind-3.7.0:0.19s  no: 5.7s (29.9x,-15.2%)  me:12.4s (65.1x,
> -9.2%)
> -- bz2 --
> bz2      32bits_trunk_untouched:0.70s  no: 3.9s ( 5.6x, -----)  me:10.9s
> (15.6x, -----)
> bz2      valgrind-3.8.1:0.70s  no: 3.9s ( 5.6x,  0.3%)  me:11.2s (16.1x,
> -2.9%)
> bz2      valgrind-3.7.0:0.70s  no: 4.6s ( 6.6x,-16.8%)  me:12.0s (17.1x,
> -9.7%)
> -- fbench --
> fbench   32bits_trunk_untouched:0.33s  no: 2.1s ( 6.2x, -----)  me: 4.8s
> (14.6x, -----)
> fbench   valgrind-3.8.1:0.33s  no: 2.0s ( 6.1x,  2.9%)  me: 4.9s (14.8x,
> -1.4%)
> fbench   valgrind-3.7.0:0.33s  no: 2.2s ( 6.6x, -5.3%)  me: 5.1s (15.4x,
> -5.4%)
> -- ffbench --
> ffbench  32bits_trunk_untouched:0.36s  no: 0.9s ( 2.6x, -----)  me: 2.2s (
> 6.2x, -----)
> ffbench  valgrind-3.8.1:0.36s  no: 0.9s ( 2.6x,  0.0%)  me: 2.4s ( 6.8x,
> -8.0%)
> ffbench  valgrind-3.7.0:0.36s  no: 1.0s ( 2.9x, -9.6%)  me: 2.4s ( 6.6x,
> -5.3%)
> -- heap --
> heap     32bits_trunk_untouched:0.44s  no: 2.0s ( 4.6x, -----)  me: 8.2s
> (18.6x, -----)
> heap     valgrind-3.8.1:0.44s  no: 1.9s ( 4.4x,  4.0%)  me: 8.7s (19.8x,
> -6.6%)
> heap     valgrind-3.7.0:0.44s  no: 2.3s ( 5.3x,-14.9%)  me: 8.7s (19.7x,
> -5.9%)
> -- heap_pdb4 --
> heap_pdb4 32bits_trunk_untouched:0.45s  no: 2.2s ( 4.9x, -----)  me:11.9s
> (26.5x, -----)
> heap_pdb4 valgrind-3.8.1:0.45s  no: 2.1s ( 4.6x,  5.9%)  me:12.5s (27.9x,
> -5.1%)
> heap_pdb4 valgrind-3.7.0:0.45s  no: 2.5s ( 5.5x,-11.3%)  me:15.6s
> (34.8x,-31.1%)
> -- many-loss-records --
> many-loss-records 32bits_trunk_untouched:0.04s  no: 0.4s (10.5x, -----)
>  me: 1.7s (42.8x, -----)
> many-loss-records valgrind-3.8.1:0.04s  no: 0.4s ( 9.5x,  9.5%)  me: 1.8s
> (45.0x, -5.3%)
> many-loss-records valgrind-3.7.0:0.04s  no: 0.4s ( 9.5x,  9.5%)  me: 1.9s
> (47.8x,-11.7%)
> -- many-xpts --
> many-xpts 32bits_trunk_untouched:0.08s  no: 0.8s ( 9.9x, -----)  me: 2.1s
> (26.5x, -----)
> many-xpts valgrind-3.8.1:0.08s  no: 0.8s ( 9.4x,  5.1%)  me: 2.1s (26.4x,
>  0.5%)
> many-xpts valgrind-3.7.0:0.08s  no: 0.7s ( 9.0x,  8.9%)  me: 2.1s (26.6x,
> -0.5%)
> -- sarp --
> sarp     32bits_trunk_untouched:0.02s  no: 0.3s (15.5x, -----)  me: 2.5s
> (126.5x, -----)
> sarp     valgrind-3.8.1:0.02s  no: 0.3s (14.5x,  6.5%)  me: 2.5s (125.5x,
>  0.8%)
> sarp     valgrind-3.7.0:0.02s  no: 0.3s (13.5x, 12.9%)  me: 2.7s (133.5x,
> -5.5%)
> -- tinycc --
> tinycc   32bits_trunk_untouched:0.32s  no: 2.9s ( 9.2x, -----)  me:10.5s
> (32.9x, -----)
> tinycc   valgrind-3.8.1:0.32s  no: 2.9s ( 9.2x,  0.0%)  me:10.9s (34.0x,
> -3.2%)
> tinycc   valgrind-3.7.0:0.32s  no: 3.0s ( 9.5x, -3.4%)  me:11.1s (34.5x,
> -4.8%)
> -- Finished tests in perf ----------------------------------------------
>
> == 11 programs, 66 timings =================
>
>
>
>
> ppc64:
>
> perl perf/vg_perf --vg=../trunk_untouched --vg=../valgrind-3.8.1
> --vg=../valgrind-3.7.0 --reps=5 perf 2>&1 | tee perf.out
> -- Running  tests in perf ----------------------------------------------
> -- bigcode1 --
> bigcode1 trunk_untouched:0.21s  no: 1.6s ( 7.5x, -----)  me: 3.0s (14.1x,
> -----)
> bigcode1 valgrind-3.8.1:0.21s  no: 1.7s ( 8.0x, -5.7%)  me: 2.8s (13.3x,
>  5.4%)
> bigcode1 valgrind-3.7.0:0.21s  no: 2.3s (10.8x,-43.7%)  me: 3.6s
> (17.3x,-23.0%)
> -- bigcode2 --
> bigcode2 trunk_untouched:0.21s  no: 1.5s ( 7.3x, -----)  me: 2.9s (14.0x,
> -----)
> bigcode2 valgrind-3.8.1:0.21s  no: 1.5s ( 7.2x,  0.7%)  me: 2.9s (13.8x,
>  1.0%)
> bigcode2 valgrind-3.7.0:0.21s  no: 2.3s (11.0x,-50.3%)  me: 3.7s
> (17.7x,-27.0%)
> -- bz2 --
> bz2      trunk_untouched:0.72s  no: 4.6s ( 6.3x, -----)  me:11.8s (16.4x,
> -----)
> bz2      valgrind-3.8.1:0.72s  no: 4.5s ( 6.3x,  1.1%)  me:12.3s (17.1x,
> -4.0%)
> bz2      valgrind-3.7.0:0.72s  no: 5.4s ( 7.6x,-19.0%)  me:13.2s
> (18.3x,-11.4%)
> -- fbench --
> fbench   trunk_untouched:0.34s  no: 2.1s ( 6.3x, -----)  me: 5.2s (15.4x,
> -----)
> fbench   valgrind-3.8.1:0.34s  no: 2.1s ( 6.2x,  2.3%)  me: 5.3s (15.5x,
> -0.6%)
> fbench   valgrind-3.7.0:0.34s  no: 2.3s ( 6.8x, -7.9%)  me: 5.5s (16.1x,
> -4.0%)
> -- ffbench --
> ffbench  trunk_untouched:0.44s  no: 1.0s ( 2.3x, -----)  me: 2.5s ( 5.7x,
> -----)
> ffbench  valgrind-3.8.1:0.44s  no: 1.0s ( 2.2x,  4.9%)  me: 2.6s ( 5.8x,
> -2.4%)
> ffbench  valgrind-3.7.0:0.44s  no: 1.2s ( 2.6x,-13.7%)  me: 2.5s ( 5.7x,
>  0.8%)
> -- heap --
> heap     trunk_untouched:0.41s  no: 2.4s ( 5.9x, -----)  me: 9.9s (24.1x,
> -----)
> heap     valgrind-3.8.1:0.41s  no: 2.4s ( 5.8x,  2.1%)  me: 9.9s (24.1x,
> -0.3%)
> heap     valgrind-3.7.0:0.41s  no: 3.1s ( 7.6x,-28.6%)  me: 9.7s (23.7x,
>  1.6%)
> -- heap_pdb4 --
> heap_pdb4 trunk_untouched:0.41s  no: 2.6s ( 6.3x, -----)  me:13.9s (34.0x,
> -----)
> heap_pdb4 valgrind-3.8.1:0.41s  no: 2.5s ( 6.2x,  1.6%)  me:13.8s (33.6x,
>  1.2%)
> heap_pdb4 valgrind-3.7.0:0.41s  no: 3.4s ( 8.2x,-30.6%)  me:17.4s
> (42.4x,-24.9%)
> -- many-loss-records --
> many-loss-records trunk_untouched:0.03s  no: 0.6s (18.3x, -----)  me: 2.2s
> (74.0x, -----)
> many-loss-records valgrind-3.8.1:0.03s  no: 0.5s (17.3x,  5.5%)  me: 2.2s
> (74.3x, -0.5%)
> many-loss-records valgrind-3.7.0:0.03s  no: 0.6s (18.3x,  0.0%)  me: 2.3s
> (77.0x, -4.1%)
> -- many-xpts --
> many-xpts trunk_untouched:0.07s  no: 0.7s (10.6x, -----)  me: 3.4s (48.1x,
> -----)
> many-xpts valgrind-3.8.1:0.07s  no: 0.7s ( 9.9x,  6.8%)  me: 3.4s (47.9x,
>  0.6%)
> many-xpts valgrind-3.7.0:0.07s  no: 0.7s (10.4x,  1.4%)  me: 3.3s (47.6x,
>  1.2%)
> -- sarp --
> sarp     trunk_untouched:0.02s  no: 0.4s (21.0x, -----)  me: 3.9s (195.5x,
> -----)
> sarp     valgrind-3.8.1:0.02s  no: 0.4s (18.5x, 11.9%)  me: 3.2s (160.5x,
> 17.9%)
> sarp     valgrind-3.7.0:0.02s  no: 0.3s (16.5x, 21.4%)  me: 3.1s (155.5x,
> 20.5%)
> -- tinycc --
> tinycc   trunk_untouched:0.26s  no: 3.0s (11.5x, -----)  me:14.3s (54.8x,
> -----)
> tinycc   valgrind-3.8.1:0.26s  no: 2.9s (11.3x,  1.3%)  me:14.3s (54.9x,
> -0.1%)
> tinycc   valgrind-3.7.0:0.26s  no: 3.1s (12.0x, -4.7%)  me:14.2s (54.7x,
>  0.2%)
> -- Finished tests in perf ----------------------------------------------
>
> == 11 programs, 66 timings =================
>
>
>
>
> ------------------------------------------------------------------------------
> Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
> Discover the easy way to master current and previous Microsoft technologies
> and advance your career. Get an incredible 1,500+ hours of step-by-step
> tutorial videos with LearnDevNow. Subscribe today and save!
> http://pubads.g.doubleclick.net/gampad/clk?id=58041391&iu=/4140/ostg.clktrk
> _______________________________________________
> Valgrind-developers mailing list
> Val...@li...
> https://lists.sourceforge.net/lists/listinfo/valgrind-developers
>