FRESH_CONNECT=1 and TIMER_AFTER_URL_SLEEP =5000

[BuraphaLinux S. <bur...@gm...>]

Hello,

     I have a severe problem using curl-loader with vsftpd.  I
reported it once before but I guess I didn't supply enough
information.  I use

FRESH_CONNECT=1

and I use

TIMER_AFTER_URL_SLEEP=5000

So what I expect to happen is that after the download and the
connection is closed, there will be a 5 second pause, then a new
connection will be opened.  Unfortuantely this is not what happens.  I
guess that after the download there is a 5 second pause, then a close
and reopen almost instantly.  The problem is that on my ftp server it
takes time to teardown the socket and end the process.  Most human
users would have a gap while they pick something else and click on it.
 Automated tools would reuse the connection (no FRESH_CONNECT=1).  I
am trying to simulate humans hitting the ftp site quickly, but not
instantly.  I have 'max_clients' set in my vsftpd.conf file to limit
the total number of people connecting.

What happens is that after one batch of URLs is fetched, the
curl-loader goes insane.

It tries to connect instanatly and goes into an ultra-fast loop doing
that.  Well the ftp server correctly just refuses everything at that
point since curl-loader is opening hundreds of connections without
waiting between failures.  The curl-loader does not slow down when it
gets notified there are too many connections from the server.  I can
see parsing that for many different servers may not be practical and I
have no problem with that.  I do need a configurable pause between
connection attempts however.

I want to have the system pause after disconnection when I'm using
FRESH_CONNECT=1 and I guess we need some new TIMER_BETWEEN_CONNECTIONS
or some such.

Before I go and code that, I would like to know if it can already be
done some other way.  I can provide wireshark traces if you need them,
ftp logs, etc.  I am using curl_loader-0.41.

Thank you,

JGH