Re: exact number of connections (was Re: limit connection cache growth on multi interface)
Status: Alpha
Brought to you by:
coroberti
From: Robert I. <cor...@gm...> - 2007-06-11 20:00:33
|
On 6/10/07, Aleksandar Lazic <al-...@no...> wrote: > > > >Let's say, somebody wants to emulate behavior of Firefox or MSIE, using > >libcurl. > > That's a very interesting question for a commandline tool, imho. > > > I would go like this: > > --- > set max_connections_per_site <NUM> > set deep_or_breadth (DEEP|BREADTH) > set deep_or_breadth_count <NUM> > set wait_human_read_time <NUM> > > repeat as long as deep_or_breadth_count is not reached { > > get site (e.g.: index.html) > parse site and ( count links and get the needed elements from remote > server > || if element is to get make new connection but not more > the max_connections_per_site > ) > > wait_human_read_time() > > if breadth && deep_or_breadth_count not reached { > get the next link from same directory-level (e.g.: /, /news/, ...) > }elsif deep && deep_or_breadth_count not reached { > get the next link from the next directory-level > } > } Thanks for your suggestion > Do you plan to add this into curl-loader ;-)? Kind of yes. Currently, there is a 1 to 1 mapping between the CURL-handle and curl-loader's client_context object; it requires certain re-design to think about. -- Sincerely, Robert Iakobashvili, coroberti %x40 gmail %x2e com ........................................................... http://curl-loader.sourceforge.net A web testing and traffic generation tool. |