Re: [htdig-dev] PATCH: Performance issue with exclude_urls

[Joe R. J. <jj...@cl...>]

On Sun, 25 Apr 2004, Lachlan Andrew wrote:

> Date: Sun, 25 Apr 2004 22:01:46 +1000
> From: Lachlan Andrew <lh...@us...>
> To: Joe R. Jah <jj...@cl...>
> Cc: "ht://Dig developers list" <htd...@li...>
> Subject: Re: [htdig-dev] PATCH: Performance issue with exclude_urls
> 
> Greetings Joe,
> 
> Thanks for doing that testing.  I took a look at 
> <ftp://ftp.ccsf.org/htdig-patches/3.2.0b5/0Profile/htdig.gmon.exclude_perform.1.gz> 
> but it seemed to take about the same time as previously, dominated by  
> regexec.  Could you please check that this is the correct profile?

It is the correct profile; however, for accuracy I ran a second profile:

ftp://ftp.ccsf.org/htdig-patches/3.2.0b5/0Profile/htdig.gmon.exclude_perform.1-rerun.gz

Also, I backed out exclude_perform.1, compiled, ran htdig, and profile:

ftp://ftp.ccsf.org/htdig-patches/3.2.0b5/0Profile/htdig.gmon-rerun.gz

Here are my three htdig run times (3.2.0b5):

  Total dig time:  01:37:35 == 5255 seconds

With exclude_perform.0

  Total dig time:  00:58:48 == 3528 seconds, or ~33% less time

With exclude_perform.1

  Total dig time:  00:57:35 == 3455 seconds, or ~34% less time

Note the correction of speed gain; I had not correctly calculated the
percent in my previous messages.

Regards,

Joe
-- 
     _/   _/_/_/       _/              ____________    __o
     _/   _/   _/      _/         ______________     _-\<,_
 _/  _/   _/_/_/   _/  _/                     ......(_)/ (_)
  _/_/ oe _/   _/.  _/_/ ah        jj...@cl...