[htdig-dev] htdig 3.2 beta, slow SSL retrieval

[Will B. <wi...@ch...>]

I've noticed a periodic/pause sleep when retrieving content from an SSL
site.  The exact same site with the same configuration under 3.1.x does
not have the problem, nor does the content show the problem if SSL is not
used.  The information is still retrieved correctly, but the pause of 10
or so seconds every few pages makes it impossible to index the entire
site.  Again, the exact same configuration to a non-SSL version with the
same content does not exhibit the pauses.  There are no delays configured
in either htdig or the web site.  The web site is local (same machine) and
there are no network delays.  There is no activity during the pause (cpu
is idle).

I added some debug statements and the pause occurs within the
Connection::Read_Partial call from Connection.cc.  The pause seems to
occur when the read call is made in line 663 (using snapshot from
20030330).  Anyone else run into this problem?