curl-loader-devel — curl-loader usage and development issues

64-bit linux

[Robert I. <cor...@gm...>]

We have tested it recently on a 64-bit Debian linux.
The good new is that it works without any patches, AS IS.

curl-loader takes a bit more memory, than on 32-bit systems,
however, this is a general behavior of C/C++ written applications.

-- 
Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.

Re: Multiple Batch Definitions?

[Robert I. <cor...@gm...>]

Jose,

On 10/18/07, Jose Rivera <JR...@oc...> wrote:
>
>  Is it possible to provide multiple batch definitions in the same file
> were each is using separate URLS definitions?
>
Once it was supported, but not now.

I would recommend you to run a script, which is launching several
curl-loader processes, each with it's own batch file.
Note, that the name of each batch BATCH_NAME will be different
for all these batch files, otherwize they will try to write to the same
log-files
and crash.

If you wish to achive a higher load from a computer with multiple
CPUs/cores as seen in /proc/cpuinfo, you may use an option -t
<number-of-the-CPUs>.

Take care,

Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.

Multiple Batch Definitions?

[Jose R. <JR...@Oc...>]

Is it possible to provide multiple batch definitions in the same file were =
each is using separate URLS definitions?

Thanks ... Jose

Re: curl-loader 0.43 Segmentation fault

[Robert I. <cor...@gm...>]

Iliyan,

On 10/12/07, Iliyan Peychev <ili...@gm...> wrote:
> Here you are filled problem report file. I also recompiled curl-loader
> with the following options:
> make optimize=0 debug=1

Thank you for the PRF.
Please, take the latest version from svn, which is supposed to
fix the -d option bug.

The size of fgets_buff increased.
Y have been added to our THANKS list. Thank you.

Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.

Re: curl-loader 0.43 Segmentation fault

[Robert I. <cor...@gm...>]

Iliyan,

On 10/12/07, Iliyan Peychev <ili...@gm...> wrote:
> Here you are filled problem report file. I also recompiled curl-loader
> make optimize=0 debug=1

Thank you for using PROBLEM-REPORTING form, I will look into it on Sunday.

Although the backtrace it shows some libevent problems, I am suspecting
memory issues in client_tracing_function, loader.c, line 1087.


In meanwhile, please, try to use the tags:

LOG_RESP_HEADERS, when defined as 1, the program logs response headers
to a file. Directory <batch-name> is created with subdirs url0, url1,
url<n> Headers of responses are logged to the files named:
cl-<client-num>-cycle-<cycle-num>.hdr

LOG_RESP_BODIES, when defined as 1, the program logs response headers
to a file. Directory <batch-name> is created with subdirs url0,
url1... url<n> Headers of responses are logged to the files named:
cl-<client-num>-cycle-<cycle-num>.body



-- 
Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.

Re: curl-loader 0.43 Segmentation fault

[Iliyan P. <ili...@gm...>]

Robert,

Here you are filled problem report file. I also recompiled curl-loader  =

with the following options:
make optimize=3D0 debug=3D1

Regards,
Iliyan Peychev

On Fri, 12 Oct 2007 11:35:54 +0300, Robert Iakobashvili  =

<cor...@gm...> wrote:

> Iliyan,
>
> On 10/12/07, Iliyan Peychev <ili...@gm...> wrote:
>> First, I did one modification in fgets buffer, because its default va=
lue
>> (1024) was too short and curl-loader failed to parse my config file:
>> file: parse_conf.c
>> function: parse_config_file
>> row: 2638
>> change:
>> -char fgets_buff[1024];
>> +char fgets_buff[2048];
>
> I will increase it to some 4K.
> Thank you very much for your pointer.
>
>> After this change, curl-loader started successfully.
>> I tested my web server several times successfully.
>
> Good.
>
>> Unfortunately, curl-loader crashed with segmentation fault when I  =

>> started it with "-d"
>> option:
>> # curl-loader -d -f testWGM.cnf
>
> -d is a freshly added option, which is not well-debugged.
>
> If logging of only server responses is enough, you might try adding to=

> you batch config file the relevant logging tags.
>
> Please, kindly, fill the PROBLEM-REPORTING form in the tarball
> with more data.
>
>> Below is gdb's output. I can provide core file or whatelse you would =
 =

>> ask.
> The trace you sent was not informative.
> Could you try to run it just from gdb or any other debugger?
> Thank you.
>
> Sincerely,
> Robert Iakobashvili,
> coroberti %x40 gmail %x2e com
> ...........................................................
> http://curl-loader.sourceforge.net
> A web testing and traffic generation tool.
>
> ----------------------------------------------------------------------=
---
> This SF.net email is sponsored by: Splunk Inc.
> Still grepping through log files to find problems?  Stop.
> Now Search log events and configuration files using AJAX and a browser=
.
> Download your FREE copy of Splunk now >> http://get.splunk.com/
> _______________________________________________
> curl-loader-devel mailing list
> cur...@li...
> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel

curl-loader is a one year old project

[Robert I. <cor...@gm...>]

Happy birthday to curl-loader!

Thanks and best wishes to the people, who helped
to Michael Moser and me, provided patches and other
assistance.

Special thank to curl project team,
libevent team and
Mark Aberdour, a maintainer of www.opensourcetesting.org


Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
An open-source web testing and traffic generation tool.

Re: curl-loader 0.43 Segmentation fault

[Robert I. <cor...@gm...>]

Iliyan,

On 10/12/07, Iliyan Peychev <ili...@gm...> wrote:
> First, I did one modification in fgets buffer, because its default value
> (1024) was too short and curl-loader failed to parse my config file:
> file: parse_conf.c
> function: parse_config_file
> row: 2638
> change:
> -char fgets_buff[1024];
> +char fgets_buff[2048];

I will increase it to some 4K.
Thank you very much for your pointer.

> After this change, curl-loader started successfully.
> I tested my web server several times successfully.

Good.

> Unfortunately, curl-loader crashed with segmentation fault when I started it with "-d"
> option:
> # curl-loader -d -f testWGM.cnf

-d is a freshly added option, which is not well-debugged.

If logging of only server responses is enough, you might try adding to
you batch config file the relevant logging tags.

Please, kindly, fill the PROBLEM-REPORTING form in the tarball
with more data.

> Below is gdb's output. I can provide core file or whatelse you would ask.
The trace you sent was not informative.
Could you try to run it just from gdb or any other debugger?
Thank you.

Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.

curl-loader 0.43 Segmentation fault

[Iliyan P. <ili...@gm...>]

Hello,

I am using curl-loader-0.43
First, I did one modification in fgets buffer, because its default value=
  =

(1024) was too short and curl-loader failed to parse my config file:
file: parse_conf.c
function: parse_config_file
row: 2638
change:
-char fgets_buff[1024];
+char fgets_buff[2048];

After this change, curl-loader started successfully.

I tested my web server several times successfully. Unfortunately,  =

curl-loader crashed with segmentation fault when I started it with "-d" =
 =

option:
# curl-loader -d -f testWGM.cnf

Below is gdb's output. I can provide core file or whatelse you would ask=
.


=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D  loading batch is: Test        =

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
  Operations:             Success                 Failed                =
  =

Timed out
URL0:GetBestMap         0      0                0      0                =
 =

0      0
URL1:GetMapObject       0      0                0      0                =
 =

0      0
URL2:GetMapImage        0      0                0      0                =
 =

0      0
URL3:GetObjectTra       0      0                0      0                =
 =

0      0
URL4:GetObjectToo       0      0                0      0                =
 =

0      0
URL5:GetObjectsSt       0      0                0      0                =
 =

0      0
URL6:GetObjectDat       0      0                0      0                =
 =

0      0
URL7:GetObjectCom       0      0                0      0                =
 =

0      0
------------------------------------------------------------------------=
--------
Interval stats (latest:0 sec, clients:10, CAPS-curr:10000):
H/F    =

Req:10,1xx:0,2xx:0,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:0ms,D-2xx:0ms,Ti:0B=
/s,To:1700B/s
H/F/S  =

Req:0,1xx:0,2xx:0,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:0ms,D-2xx:0ms,Ti:0B/=
s,To:0B/s
------------------------------------------------------------------------=
--------
Summary stats (runs:1 secs, CAPS-average:10):
H/F    =

Req:10,1xx:0,2xx:0,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:0ms,D-2xx:0ms,Ti:0B=
/s,To:1700B/s
H/F/S  =

Req:0,1xx:0,2xx:0,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:0ms,D-2xx:0ms,Ti:0B/=
s,To:0B/s
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D
  Automatic: adding 10 clients/sec. Stop inc and manual [M].
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D
*** stack smashing detected ***:  =

/install/data/curl-loader/curl-loader-0.43/curl-loader terminated

Program received signal SIGABRT, Aborted.
[Switching to Thread -1212275008 (LWP 1095)]
0xffffe410 in __kernel_vsyscall ()
(gdb) bt
#0  0xffffe410 in __kernel_vsyscall ()
#1  0xb7c0cdf0 in raise () from /lib/tls/i686/cmov/libc.so.6
#2  0xb7c0e641 in abort () from /lib/tls/i686/cmov/libc.so.6
#3  0xb7c429bb in ?? () from /lib/tls/i686/cmov/libc.so.6
#4  0x080992ac in ?? ()
#5  0x00000000 in ?? ()
(gdb)

Regards,
Iliyan Peychev

Re: Thanks

[Robert I. <cor...@gm...>]

On 10/10/07, mehdi khalilzadeh <meh...@ya...> wrote:
> Dear Robert
>
> Thanks for your Kindness.There isn't any error and the code has been
> compiled successfully.
>
> Sincerely.
> M.khalilzadeh

No problemo.

What exactly was helpful?
Was it enough --without-ldap or
linking to -lldap was also necessary?

Sincerely,
Robert

Re: Help me to compile curl-loader

[Robert I. <cor...@gm...>]

Mehdi,

On 10/9/07, mehdi khalilzadeh <meh...@ya...> wrote:
> I do your guidance, but it's error didn't solve. can you help me more?

My guess, that you are doing it well.
Sure, we will work together till the problem gets resolved.
This is a problem of libcurl, and I will report it to them, but in
meanwhile let's
work-around it.

Y have added to the makefile --without-ldap.
After this correction, you were supposed to run

$make cleanall
$make

If it is still has the same linking problems with ldap functions, please,
find in the Makefile the linking line:

# Link Libraries. In some cases, plese add -lidn
   LIBS= -ldl -lpthread -lrt -lcurl -levent -lz -lssl -lcrypto

Please, add at the end -lldap
The result will look like:
   LIBS= -ldl -lpthread -lrt -lcurl -levent -lz -lssl -lcrypto -lldap

please, run just
$make

> - how I can remove ldap option from making?
I will report the bug it to curl project.


Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.

Re: Help me to compile curl-loader

[mehdi k. <meh...@ya...>]

Hi Robert

Thanks a lot for your kindnes;
I do your guidance, but it's error didn't solve. can you help me more?
- how I can remove ldap option from making?
- can you send a version of curl-loader that hasn't ldap? 
- or can you edit Makefile and send it to me?

Sincerely
M.Khalilzadeh





Robert Iakobashvili <cor...@gm...> wrote: Hi Mehdi,

On 10/9/07, mehdi khalilzadeh <meh...@ya...> wrote: 
We get your tools (curl-loader 0.43) from the web, but we have problem in installing it. please help us.

>>>system specification<<<

CPU: Pentium 4 3.0 GHz
RAM: 1GB
OS: Linux EL 5
 Kernel version: 2.6.18-8.el5
gcc version: 4.1.1 20070105 (Red Hat 4.1.1-52)

>>>error detail<<<

[root@localhost curl-loader-0.43]# make
gcc  -g  -o curl-loader  obj/batch.o  obj/cl_alloc.o  obj/client.o  obj/conf.o  obj/environment.o  obj/heap.o  obj/ip_secondary.o  obj/loader.o  obj/loader_fsm.o  obj/loader_hyper.o  obj/loader_smooth.o  obj/mpool.o  obj/parse_conf.o  obj/screen.o  obj/ssl_thr_lock.o  obj/statistics.o  obj/timer_queue.o  obj/url.o -L./lib -L/usr//lib -ldl -lpthread -lrt -lcurl -levent -lz -lssl -lcrypto 
./lib/libcurl.a(ldap.o): In function `Curl_ldap':
ldap.c:(.text+0x97): undefined reference to `ldap_url_parse'
l

Please, edit the Makefile, and where it is 
    --without-libidn \ 
make it to appear
    --without-libidn --without-ldap \

In a simplier words add --without-ldap between --without-libidn and \

Please, report, if it is helpful. Thanks.

Sincerely,
Robert Iakobashvili,  
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool. -------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/_______________________________________________
curl-loader-devel mailing list
cur...@li...
https://lists.sourceforge.net/lists/listinfo/curl-loader-devel


       
---------------------------------
Building a website is a piece of cake. 
Yahoo! Small Business gives you all the tools to get online.

Re: Help me to compile curl-loader

[Robert I. <cor...@gm...>]

Hi Mehdi,

On 10/9/07, mehdi khalilzadeh <meh...@ya...> wrote:
>
>
> We get your tools (curl-loader 0.43) from the web, but we have problem in
> installing it. please help us.
>
> >>>system specification<<<
>
> CPU: Pentium 4 3.0 GHz
> RAM: 1GB
> OS: Linux EL 5
> Kernel version: 2.6.18-8.el5
> gcc version: 4.1.1 20070105 (Red Hat 4.1.1-52)
>
> >>>error detail<<<
>
> [root@localhost curl-loader-0.43]# make
> gcc  -g  -o curl-loader  obj/batch.o  obj/cl_alloc.o  obj/client.o
>  obj/conf.o  obj/environment.o  obj/heap.o  obj/ip_secondary.o  obj/loader.o
>  obj/loader_fsm.o  obj/loader_hyper.o  obj/loader_smooth.o  obj/mpool.o
>  obj/parse_conf.o  obj/screen.o  obj/ssl_thr_lock.o  obj/statistics.o
>  obj/timer_queue.o  obj/url.o -L./lib -L/usr//lib -ldl -lpthread -lrt -lcurl
> -levent -lz -lssl -lcrypto
> ./lib/libcurl.a(ldap.o): In function `Curl_ldap':
> ldap.c:(.text+0x97): undefined reference to `ldap_url_parse'
> l


Please, edit the Makefile, and where it is
    --without-libidn \
make it to appear
    --without-libidn --without-ldap \

In a simplier words add --without-ldap between --without-libidn and \

Please, report, if it is helpful. Thanks.

Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.

Re: Help me to compile curl-loader

[Robert I. <cor...@gm...>]

Hi Mehdi,

On 10/9/07, mehdi khalilzadeh <meh...@ya...> wrote:
>
>
> We get your tools (curl-loader 0.43) from the web, but we have problem in
> installing it. please help us.
> >>>system specification<<<
>
> CPU: Pentium 4 3.0 GHz
> RAM: 1GB
> OS: Linux EL 5
> Kernel version: 2.6.18-8.el5
> gcc version: 4.1.1 20070105 (Red Hat 4.1.1-52)
>
> >>>error detail<<<
>
> [root@localhost curl-loader-0.43]# make
> gcc  -g  -o curl-loader  obj/batch.o  obj/cl_alloc.o  obj/client.o
>  obj/conf.o  obj/environment.o  obj/heap.o  obj/ip_secondary.o  obj/loader.o
>  obj/loader_fsm.o  obj/loader_hyper.o  obj/loader_smooth.o  obj/mpool.o
>  obj/parse_conf.o  obj/screen.o  obj/ssl_thr_lock.o  obj/statistics.o
>  obj/timer_queue.o  obj/url.o -L./lib -L/usr//lib -ldl -lpthread -lrt -lcurl
> -levent -lz -lssl -lcrypto
> ./lib/libcurl.a(ldap.o): In function `Curl_ldap':
> ldap.c:(.text+0x97): undefined reference to `ldap_url_parse'
>

Please, edit the Makefile and
instead of


Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.

Help me to compile curl-loader

[mehdi k. <meh...@ya...>]

Hi dear,
We get your tools (curl-loader 0.43) from the web, but we have problem in installing it. please help us.

>>>system specification<<<

CPU: Pentium 4 3.0 GHz
RAM: 1GB
OS: Linux EL 5
Kernel version: 2.6.18-8.el5
gcc version: 4.1.1 20070105 (Red Hat 4.1.1-52)

>>>error detail<<<

[root@localhost curl-loader-0.43]# make
gcc  -g  -o curl-loader  obj/batch.o  obj/cl_alloc.o  obj/client.o  obj/conf.o  obj/environment.o  obj/heap.o  obj/ip_secondary.o  obj/loader.o  obj/loader_fsm.o  obj/loader_hyper.o  obj/loader_smooth.o  obj/mpool.o  obj/parse_conf.o  obj/screen.o  obj/ssl_thr_lock.o  obj/statistics.o  obj/timer_queue.o  obj/url.o -L./lib -L/usr//lib -ldl -lpthread -lrt -lcurl -levent -lz -lssl -lcrypto
./lib/libcurl.a(ldap.o): In function `Curl_ldap':
ldap.c:(.text+0x97): undefined reference to `ldap_url_parse'
ldap.c:(.text+0xb0): undefined reference to `ldap_err2string'
ldap.c:(.text+0xe8): undefined reference to `ldap_msgfree'
ldap.c:(.text+0x103): undefined reference to `ldap_free_urldesc'
ldap.c:(.text+0x117): undefined reference to `ldap_unbind_s'
ldap.c:(.text+0x1f5): undefined reference to `ldap_set_option'
ldap.c:(.text+0x215): undefined reference to `ldap_set_option'
ldap.c:(.text+0x22e): undefined reference to `ldap_init'
ldap.c:(.text+0x2b3): undefined reference to `ldap_set_option'
ldap.c:(.text+0x2d3): undefined reference to `ldap_set_option'
ldap.c:(.text+0x309): undefined reference to `ldap_simple_bind_s'
ldap.c:(.text+0x339): undefined reference to `ldap_set_option'
ldap.c:(.text+0x367): undefined reference to `ldap_simple_bind_s'
ldap.c:(.text+0x37f): undefined reference to `ldap_err2string'
ldap.c:(.text+0x3e5): undefined reference to `ldap_search_s'
ldap.c:(.text+0x3ff): undefined reference to `ldap_err2string'
ldap.c:(.text+0x43a): undefined reference to `ldap_first_entry'
ldap.c:(.text+0x46e): undefined reference to `ldap_get_dn'
ldap.c:(.text+0x4ff): undefined reference to `ldap_first_attribute'
ldap.c:(.text+0x524): undefined reference to `ldap_get_values_len'
ldap.c:(.text+0x6b8): undefined reference to `ldap_value_free_len'
ldap.c:(.text+0x6e7): undefined reference to `ldap_memfree'
ldap.c:(.text+0x703): undefined reference to `ldap_next_attribute'
ldap.c:(.text+0x719): undefined reference to `ldap_memfree'
ldap.c:(.text+0x731): undefined reference to `ber_free'
ldap.c:(.text+0x745): undefined reference to `ldap_next_entry'
collect2: ld returned 1 exit status
make: *** [curl-loader] Error 1


Thanks a lot.

Re: Example of URL section for invoking a web service

[Robert I. <cor...@gm...>]

Huy,

On 10/4/07, Huy Huynh <zac...@gm...> wrote:
>
> Hey,
>
> Does anybody here have an example of the URL section for the conf file
> that would post a SOAP message to a web service? I am trying to do it but
> just lost.
>

Please, post your PROBLEM-REPORTING form filled ion due course.

Also logs and explanation of your problems will be more
helpful instead of "just lost" statement. "Don't panic"

Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.

Example of URL section for invoking a web service

[Huy H. <zac...@gm...>]

Hey,

Does anybody here have an example of the URL section for the conf file that
would post a SOAP message to a web service? I am trying to do it but just
lost.

-- 
Thank you,

Re: Curl-Loader Usage

[Robert I. <cor...@gm...>]

Hi Pavan,

On 10/4/07, pavan varma <pav...@gm...> wrote:
>
> Hi Robert,
>
> This is pavan from India Working as a software QA. Came to know that this
> tool is going to stimulate and generate real time traffic like HTTP and FTP,
> so in regards to that i would like to know the usage and how will i change
> the sample configuration examples of the files are been installed with the
> curl-loader source code package. I have taken one sample example of
> ftp-upload.conf file...Wats exactly is this General section and URL
> section mean??


Please, read FAQs first: http://curl-loader.sourceforge.net/doc/faq.html

If i would like to have a setup running...with my client IP address as
> 192.170.1.65 and the ftp server address as 192.170.1.143. How should i
> edit the below configuration file in that case. When i am trying to compile
> and generate the load  " ./curl-loader -f ./configs/ftp-upload.conf " i
> couldnt see any connections are been established to my FTP Server and i
> could observe errors are generated at the statistics file.
>
> ########### GENERAL SECTION ################################
> BATCH_NAME= ftp-upload
> CLIENTS_NUM_MAX=2
> INTERFACE   = eth0
> NETMASK=24
> IP_ADDR_MIN= 192.170.1.65
> IP_ADDR_MAX= 192.170.1.65  #Actually - this is for self-control
> CYCLES_NUM= -1
> URLS_NUM = 1
>
> ########### URL SECTION ####################################
>
> URL= ftp://pavan:pavan@192.170.1.143/
>
FRESH_CONNECT=1                                  # At least my proftpd has
> problems with connection re-use
> UPLOAD_FILE=/root/softwares/tfn.tgz
> HEADER="RNFR"
> HEADER=" tfn.tgz"
> HEADER="RNTO "
> HEADER="tfn.tgz"
> TIMER_URL_COMPLETION = 30 # In msec. When positive, Now it is enforced by
> cancelling url fetch on timeout
> TIMER_AFTER_URL_SLEEP =3000


I am not sure, that  you need all the HEADER sections,
Instead, please, try,
URL= ftp://pavan:pavan@192.170.1.143/tfn.tgz<ftp://pavan:pavan@192.170.1.143/>

Also try running it with -v option and look into the ftp-upload.log file.
Actual headers and traffic you can see in ethereal.

Please, kindly, use for support the mailing list, namely:
Subscribe to the curl-loader-devel list and mail your filled
PROBLEM-REPORTING form located in the curl-loader tarball to the list.
https://lists.sourceforge.net/lists/listinfo/curl-loader-devel

Y properly formed PROBLEM-REPORTING form is very essential for support;
please, find the form in the curl-loader-<version> directory.

Thanks.

-- 
Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.

Re: HTTP Soap Post

[Robert I. <cor...@gm...>]

Hi Huy,

On 10/3/07, Huy Huynh <zac...@gm...> wrote:

> I am trying to do an HTTP posting a SOAP file.


Please, always report you problems using filled PROBLEM-REPORTING
form, which is in curl-loader tarball. For example, I do not see the command
line options,
that you are running.

Here is my conf file:
> ########### GENERAL SECTION ################################
> BATCH_NAME= 20K
> CLIENTS_NUM_MAX=100
> CLIENTS_NUM_START=1
> CLIENTS_RAMPUP_INC=2
> INTERFACE = eth2
> NETMASK=16
> IP_ADDR_MIN= 192.168.1.2
> IP_ADDR_MAX= 192.168.1.9  #Actually - this is for self-control


So, you have 7 ip-addresses for 100 clients. It should fail.
If  you want  to  use a dedicated IP for each client, please,
set IP_ADDR_MAX= 192.168.1.101. <http://192.168.1.9/>
If you want to use a common-IP, please, set IP_ADDR_MAX= 192.168.1.2

CYCLES_NUM= 2
> URLS_NUM= 1


 Let's start debugging with some lower numbers, like
CLIENTS_NUM_MAX=1
CLIENTS_NUM_START=1
#CLIENTS_RAMPUP_INC=2
CYCLES_NUM= 2

and, when it works, you will increase the numbers.

########### URL SECTION ####################################
> URL = http://9.33.97.69:6014/services/AddressSearch


Have you ensured IP-routing from your network  192.168.1.2 to that
addresses?

URL_SHORT_NAME = "EastAddressPost2RouterFirewall"
> REQUEST_TYPE=POST
> MULTIPART_FORM_DATA="file=@EastfindByLocation.xml"
> TIMER_URL_COMPLETION = 3000
> TIMER_AFTER_URL_SLEEP = 100
> HEADER = "SOAPAction:"


Are you sure, that you wish to send a header without any value?

HEADER = "Content-Type: text/xml"
>
> Is this a correct way of doing this? I am totally confused. Anybody got a
> sample web service test conf?


So, what is the problem, finally?
What curl-loader reports? What happens?

Have you tried running curl-loader with -v command line option and looking
in the logfile?
If you are using the latest versions, like curl-loader-0.43, you can run -d
option, which
outputs to logfile also all HTTP requests and responses received and sent.
Y can also combine -v and -d option for the latest versions.

Please, also read about various debugging facilities in FAQs (they are
updated for the
latest version, however)
http://curl-loader.sourceforge.net/doc/faq.html


Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.

HTTP Soap Post

[Huy H. <zac...@gm...>]

Hi,

I am trying to do an HTTP posting a SOAP file. Here is my conf file:
########### GENERAL SECTION ################################
BATCH_NAME= 20K
CLIENTS_NUM_MAX=100
CLIENTS_NUM_START=1
CLIENTS_RAMPUP_INC=2
INTERFACE = eth2
NETMASK=16
IP_ADDR_MIN= 192.168.1.2
IP_ADDR_MAX= 192.168.1.9  #Actually - this is for self-control
CYCLES_NUM= 2
URLS_NUM= 1

########### URL SECTION ####################################
URL = http://9.33.97.69:6014/services/AddressSearch
URL_SHORT_NAME = "EastAddressPost2RouterFirewall"
REQUEST_TYPE=POST
MULTIPART_FORM_DATA="file=@EastfindByLocation.xml"
TIMER_URL_COMPLETION = 3000
TIMER_AFTER_URL_SLEEP = 100
HEADER = "SOAPAction:"
HEADER = "Content-Type: text/xml"

Is this a correct way of doing this? I am totally confused. Anybody got a
sample web service test conf?

-- 
Thank you,

[ANN] curl-loader version 0.43 released

[Robert I. <cor...@gm...>]

curl-loader version 0.43 delivers:

- shared IPs facility, which allows using of a limited pool of client
IP-addresses by any number of virtual clients.
  This is actually opens the road to 100 000 - 200 000 and higher
simultaneous clients numbers.
- random client credetials, which allows using e.g. 100 simultaneous virtual
clients to simulate a load of e.g.
  1000000 clients by choosing client credentials randomly for each cycle;
- compilation, FTP, IPv6 bug-fixes;
- advanced to the latest curl-7.17.0.

-- 
Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.

IPv6 bug resolved. Shared IPs feature added

[Robert I. <cor...@gm...>]

In svn:

* Resolved IPv6 bug, when using a dedicated IPv6-address per client.
   It was broken with the first address used by all virtual clients.

Is somebody using IPv6?

* Tag IP_SHARED_NUM added to enable multiple clients to use not a
   single common IP and not a unique IP-address, but several IP-address.
   If IP_SHARED_NUM=3, first client gets the first address, second the
second,
   third gets the third, whereas the forth client gets back the first
address and so on.
   The feature should enable to support more than 64K loading clients
without
   a need to assign a unique address to each client (which has its memory
price and
   its own limitations).

   Thus, to enable 200K loading clients, one can use about 64K clients per
address
   and IP_SHARED_NUM=4 will be enough for such cases.
   The feature can be useful also, when somebody is not willing to use a
unique
   IP per client, but does not like, that all clients are coming from the
same IP-address.
   An example of the IP_SHARED_NUM usage is in ./conf-examples/bulk.conf

   IP_SHARED_NUM=1 is the cases of the so-called "common-IP" for all
clients.
   Still defining the same IP-address in IP_ADDR_MIN and IP_ADDR_MAX will
   work as before for backward compartibility, and no need to specify
IP_SHARED_NUM=1.

Enjoy,

-- 
Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.

Re: [ 1790625 ] asm/page.h is unportable

[Robert I. <cor...@gm...>]

Hi Gregor,

On 9/9/07, Gregor Riepl <set...@fr...> wrote:

Thanks for your PROBLEM-REPORTING form.
The bug is fixed and you have been added to our THANKS list.

With my be wishes,

Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.

[ 1790625 ] asm/page.h is unportable

[Gregor R. <set...@fr...>]

Sorry that I didn't report this the way I was supposed to.
I generally prefer filing bugs through a bug tracking system, and  
since I'm subscribed to so many mailing lists already, I'm a bit  
reluctant to add more.
But I'll gladly provide more information, since this was an issue  
that could pop up for other users in the future.

Here's the proper report:

CURL-LOADER VERSION: 0.42, released September 5, 2007

HW DETAILS: Dual Pentium III 1GHz, 1.5GB RAM, Software-RAID5 with 4  
SCSI disks

LINUX DISTRIBUTION and KERNEL (uname -r): 2.6.21-gentoo-r1

GCC VERSION (gcc -v): gcc version 3.4.6 (Gentoo 3.4.6-r2,  
ssp-3.4.6-1.0, pie-8.7.10)

GLIBC VERSION: 2.5 (gentoo-r4)

DOES THE PROBLEM AFFECT:
        COMPILATION? Yes
        LINKING? No
        EXECUTION? No
        OTHER (please specify)? Portability

DESCRIPTION:
The source file mpool.c contains a bit of unportable code, that  
doesn't build on GNU/Linux systems with recent glibc versions and  
UNIX systems other than Linux (*BSD, Mac OS X, ...):
#include <asm/page.h>
#if !defined PAGE_SIZE
#define PAGE_SIZE 4096
#endif
glibc 2.5 (and 2.4 too I think) do not duplicate or symlink the  
headers of the live Linux kernel, but use a compatible subset  
instead, which does not contain asm/page.h.
The portable (POSIX) way to get the page size is:
#include <unistd.h>
sysconf(_SC_PAGESIZE)
Plus there is also the legacy getpagesize(), which should work on  
even more UNIX platforms.

QUESTION/ SUGGESTION/ PATCH:
Change the fragment above to:
#include <unistd.h>
#define PAGE_SIZE (getpagesize())

Thank you for fixing this!
Gregor

Re: web server optimization question

[Robert I. <cor...@gm...>]

Aleks,

On 9/7/07, Aleksandar Lazic <al-...@no...> wrote:
>
> I'am not a fan of lighty but to be fair have you looked into:
>
> http://trac.lighttpd.net/trac/wiki/Docs%3APerformance
>
> >   Nginx  with default settings has persistence,
> >    (and not sure if there is directive to make it not to do so),
> >    so this seems to explain the higher CAPS number.
>
> Afaik there is no option to switch off the keep-alive but you can tune
> it:
>
> http://wiki.codemongers.com/NginxHttpCoreModule#keepalive_timeout
>
> >   I also experimented a little with the number of virtual clients,
> >   but I got about the same results with 256 clients,
> >    and performance started to degrade around 1500 clients.
> >
> >       - Finally, I tried configuration  where client closing the
> connection, but with this
> >     I got  much lower CAPS with both lighttpd and nginx.
>
> Have you tried to turn on/off tcp_{nodelay,nopush), yust for info?!
>
> http://wiki.codemongers.com/NginxHttpCoreModule#tcp_nodelay
>

Interesting links, thanks.

-- 
Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.