Re: [htdig-dev] to-do list for 3.1.6

[Gilles D. <gr...@sc...>]

According to Joe R. Jah:
> Here is some statistics that may address your questions;)
> 
> ___________________ 112501 + parsedate.0 + ssl.6 ___________________
> Without any change.
> htdig: Start digging:   Thu Nov 29 23:27:58 PST 2001
> htmerge: Start merging: Thu Nov 29 23:33:35 PST 2001    337 seconds
...
> ___________________ 112501 + parsedate.0 + ssl.6 ___________________
> remove reference to regex.o in htlib/Makefile
> 
> htdig: Start digging:   Thu Nov 29 23:42:15 PST 2001
> htmerge: Start merging: Thu Nov 29 23:44:38 PST 2001    143 seconds
...

OK, obviously removing the bundled regex and making sure it doesn't
get into htlib.a has a big impact.

> ___________________ 112501 + parsedate.0 + ssl.6 ___________________
> rm htlib/regex.*
> remove reference to regex.o in htlib/Makefile
> #undef HAVE_BROKEN_REGEX in include/htconfig.h
> 
> htdig: Start digging:   Thu Nov 29 22:22:32 PST 2001
> htmerge: Start merging: Thu Nov 29 22:24:14 PST 2001	104 seconds
...
> ___________________ 112501 + parsedate.0 + ssl.6 ___________________
> rm htlib/regex.*
> remove reference to regex.o in htlib/Makefile
> #define HAVE_BROKEN_REGEX in include/htconfig.h
> 
> htdig: Start digging:   Thu Nov 29 22:25:33 PST 2001
> htmerge: Start merging: Thu Nov 29 22:27:12 PST 2001	 99 seconds
...

I don't think the difference between 99 and 104 seconds is significant.
This confirms my suspicion that the HAVE_BROKEN_REGEX doesn't do a
whole lot.  To be sure, though, I think we'd need timings for 112501 +
parsedate.0 + ssl.6, remove reference to regex.o in htlib/Makefile, #undef
AND #define HAVE_BROKEN_REGEX (i.e. two tests) in include/htconfig.h
(but don't remove htlib/regex.h).  I suspect the timings for both will
be like the 2nd test above, around 143 sec.

I suspect the difference between the 143 and the 99-104 sec is due
to the inclusion of the bundled regex.h even though you're using
the C library regex.o code.  It's a wonder this works at all, but
there does seem to be some impact on performance.

> ____________________ 092301 + Armstrong + ssl.4 ____________________
> htdig: Start digging:   Fri Nov 30 00:18:06 PST 2001
> htmerge: Start merging: Fri Nov 30 00:18:44 PST 2001     38 seconds
...

This is the part I find a bit troubling, but I don't know what we
can do about it.  I don't know why Armstrong's patch, which uses rx
instead of regex, causes htdig to run 2-3 times faster, unless there
are other changes between 092301 and 112501 that account for much of
this, but it could well be just implementation efficiencies in one
library and not in the other.

In your tests above, do you make use of url_rewrite_rules?  If so,
how do the timings change if you don't use it?

Thanks for the feedback.

-- 
Gilles R. Detillieux              E-mail: <gr...@sc...>
Spinal Cord Research Centre       WWW:    http://www.scrc.umanitoba.ca/~grdetil
Dept. Physiology, U. of Manitoba  Phone:  (204)789-3766
Winnipeg, MB  R3E 3J7  (Canada)   Fax:    (204)789-3930