Re: FRESH_CONNECT=1 and TIMER_AFTER_URL_SLEEP =5000
Status: Alpha
Brought to you by:
coroberti
From: BuraphaLinux S. <bur...@gm...> - 2007-08-02 13:11:36
|
On 8/2/07, Robert Iakobashvili <cor...@gm...> wrote: > > On 8/2/07, BuraphaLinux Server <bur...@gm... > wrote: > > Hello, > > Nice hearing from you. > > > FRESH_CONNECT=1 > > TIMER_AFTER_URL_SLEEP=5000 > > > > So what I expect to happen is that after the download and the > > connection is closed, there will be a 5 second pause, then a new > > connection will be opened. Unfortuantely this is not what happens. I > > guess that after the download there is a 5 second pause, then a close > > and reopen almost instantly. > > My understanding here is that, when FRESH_CONNECT is set, > we need: > 1) to close the connection; > 2) only after the connection is closed to sleep for TIMER_AFTER_URL_SLEEP; > > Please, confirm, that I got it. Thanks. > In any case your proposal is "The Right Thing to Do" (myTM) > :) > > > What happens is that after one batch of URLs is fetched, the > > curl-loader goes insane. > > It tries to connect instanatly and goes into an ultra-fast loop doing > > that. Well the ftp server correctly just refuses everything at that > > point since curl-loader is opening hundreds of connections without > > waiting between failures. > > > > It is actually DOS-ing. Hope, that this will not be the primary usage of the > tool. > :) > > I will try next week (Sunday/Monday) to come with this correction and will > inform you, > when committed. > > My best wishes. > > Sincerely, > Robert Iakobashvili, Hello, Yes, you understand the problem and what the solution is. I look forward to testing your fix. Thanks! JGH |