Re: Simultaenous URL request

[Robert I. <cor...@gm...>]

Dear Ciaran,

Look at URL-probabality feature in README.

Regards,
Robert

On Wed, Jun 27, 2012 at 8:24 PM, Ciaran McCrisken <cmc...@gm...> wrote:
> Hi,
>
>
>
> Curlloader is a great piece of software – keep up the good work!
>
>
>
> I was wondering if it’s possible to fetch a list of URLS simultaneously? I
> have a script that automates the generation of large amounts of URLs. I’m
> looking to transfer a known amount of unique data and a known throughput via
> a proxy device.
>
>
>
> At the moment, Curlloader processes each URL sequentially for each Client.
> I’d like it to download each URL for each specified Client, once.
>
>
>
> E.g.
>
>
>
> ########## GENERAL SECTION ##########
>
> BATCH_NAME=sim_get
>
> CLIENTS_NUM_MAX=1000
>
> CLIENTS_NUM_START=1000
>
> CLIENTS_RAMPUP_INC=1
>
> INTERFACE=eth0
>
> NETMASK=255.255.224.0
>
> IP_ADDR_MIN=172.16.47.100
>
> IP_ADDR_MAX=172.16.47.100
>
> CYCLES_NUM=1
>
> URLS_NUM=1
>
>
>
> ########## URLs SECTION #############
>
>
>
> URL=http://172.16.62.110/cgi-bin/bytegenerator?size=100&seed=1
>
> URL_SHORT_NAME="1"
>
> REQUEST_TYPE=GET
>
> TRANSFER_LIMIT_RATE=1000
>
>
>
> URL=http://172.16.62.110/cgi-bin/bytegenerator?size=100&seed=2
>
> URL_SHORT_NAME="2"
>
> REQUEST_TYPE=GET
>
> TRANSFER_LIMIT_RATE=1000
>
>
>
> URL=http://172.16.62.110/cgi-bin/bytegenerator?size=100&seed=3
>
> URL_SHORT_NAME="3"
>
> REQUEST_TYPE=GET
>
> TRANSFER_LIMIT_RATE=1000
>
>
>
> ..
>
> ..
>
> ..
>
>
>
> URL=http://172.16.62.110/cgi-bin/bytegenerator?size=100&seed=1000
>
> URL_SHORT_NAME="1000"
>
> REQUEST_TYPE=GET
>
> TRANSFER_LIMIT_RATE=1000
>
>
>
> Thanks and regards!
>
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> _______________________________________________
> curl-loader-devel mailing list
> cur...@li...
> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel
>



-- 
Regards,
Robert Iakobashvili, Ph.D.

Home:       http://www.ghotit.com
Blog:         http://www.ghotit.com/category/ghotit-blogs/
Twitter:      http://twitter.com/ghotit
Facebook: http://facebook.com/ghotit
......................................................................
                   Ghotit Dyslexia
Assistive technology that understands you
......................................................................