curl-loader-devel

a few questions.. huge load testing job

[aaron s. <bei...@gm...>]

Hey Guys,

Thanks for the work on curl loader. I've got a couple questions..

-This should work on a mac right? (intel mac)

-Are there any other documentation/examples of using curl-loader?

I've got a pretty big testing task ahead of me for a soon to be released
website. The site is built with Flex and uses the AMF binary protocol.
(Flash Remoting). The way AMF is transmitted from the player is over regular
HTTP, but the entire AMF message is in the body of the request. And the
content-type is application/x-amf.

The Remoting/AMF Gateway sits on the webserver, and handles Remote Object
calls from Flex. What I need to test is this remoting gateway, with a
combination of pre-saved AMF messages directly from the flash player, and
curl-loader.

I've got a generic solution for capturing an AMF request to a file so that I
can use the pre-generated AMF requests in combination with curl-loader. Is
it possible to specify a file's contents as the contents/body of a request?

The request from the flash player comes over as a POST, but i'm not sure if
the AMF comes over in a form variable? Usually in a remoting gateway I can
get the AMF from the request.raw_body. How does that correlate to a request?

The workflow that I see with curl loader is the batch file, changing the
header to supply the content-type of application/x-amf, and the
content-length. Then associating the AMF from a file with the content/body
of the request.. The site is expected to be getting millions of hits daily
possibly weekly. In any case huge loads.

Has anything like this been accomplished with curl-loader?

Thanks much for any help!
-Aaron

Re: a few questions.. huge load testing job

[Robert I. <cor...@gm...>]

Hi Aaron,

On Dec 7, 2007 7:32 AM, aaron smith <bei...@gm...> wrote:
> -This should work on a mac right? (intel mac)

It works on linux. If you have managed to run linux on some MAC HW
- you can try.

> -Are there any other documentation/examples of using curl-loader?

Examples of the batches (testing plans) are inside the tarball in
conf-examples directory. The FAQs are here:
http://curl-loader.sourceforge.net/doc/faq.html
even more docs are here:
http://curl-loader.sourceforge.net

> The request from the flash player comes over as a POST, but i'm not sure if
> the AMF comes over in a form variable? Usually in a remoting gateway I can
> get the AMF from the request.raw_body. How does that correlate to a request?

Y can try to sniff the traffic, using wireshark (ethereal) and know, what are
the HTTP request/responses.

> The workflow that I see with curl loader is the batch file, changing the
> header to supply the content-type of application/x-amf, and the
> content-length. Then associating the AMF from a file with the content/body
> of the request.. The site is expected to be getting millions of hits daily
> possibly weekly. In any case huge loads.

There are two ways of doing POST-ing:
a) a regular one;
b) a multiform POST-ing.

Try to capture the traffic, remove all private info and send here to see,
what happens.

> Has anything like this been accomplished with curl-loader?

Let's say 10 mln of hits per day are only about 400 000 per hour, which
means only 7000 heats/minute. I do not see any problem for curl-loader f
rom the point of number of request.
Your scenario, however, may require high bandwidth, high CPU,
but a dual core Core2 Intel CPU with some 2G of memory should manage it.

The question is about your application part.

> Thanks much for any help!
> -Aaron

Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
An open-source web testing and traffic generation.

Re: a few questions.. huge load testing job

[Robert I. <cor...@gm...>]

Aaron,

On Dec 7, 2007 8:33 AM, aaron smith <bei...@gm...> wrote:
> >There are two ways of doing POST-ing:
> >a) a regular one;
> >b) a multiform POST-ing.
> What is the difference?

Please, read about HTTP multipart form data POST-ing as in RFC1867

> >Try to capture the traffic, remove all private info and send here to see,
> >what happens.
>
> I've attached a Charles Debugging Proxy tool session. It can sniff and
> deserialize AMF. If you download Charles, you can go to file->open session
> and open that file. It'll show you one request I made to a remoting gateway.
> as well as the response.

Doe it have a linux version

>I can save the AMF to a file, but from
> curl-loader, how do I tell it to load that file as the content to send?

It should be an example of posting a file. I will look into it later.
If it is not (somehow) supported
by curl-loader, it will be rather easy to add.

>
> Thanks for those examples btw. I didn't realize that 1.4.3 had them in it. I
> DL 1.4.4, not in there.. 1.4.4 must be a patch eh. Anyway, for the most part
> I see through the examples of what has to be done. Just this one issue of
> associating the AMF as the content with it..

Examples were inside from the day one.

By the way, you can use Bugnux linux Live-CD curl-loader version
just to start from any computer, even Windows.
The Bugnux version, however, might have some performance penalty.
-- 
Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
An open-source web testing and traffic generation.

Re: a few questions.. huge load testing job

[aaron s. <bei...@gm...>]

>Examples were inside from the day one.
They're not in 0.4.4. There aren't any make files either, It looks like
0.4.4. is a patch, lot's of files missing.

>By the way, you can use Bugnux linux Live-CD curl-loader version
>just to start from any computer, even Windows.
>The Bugnux version, however, might have some performance penalty.
Sweet! That's perfect.

>Doe it have a linux version
Yep. It's java.

>It should be an example of posting a file. I will look into it later.
>If it is not (somehow) supported
>by curl-loader, it will be rather easy to add.

Ah I think I got it. So basically when you post a file, it's just posting
the binary data. So I can just post whatever file the AMF is in and that
will be the AMF. Right? I don't see why that wouldn't work.





On Dec 6, 2007 10:42 PM, Robert Iakobashvili <cor...@gm...> wrote:

> Aaron,
>
> On Dec 7, 2007 8:33 AM, aaron smith <bei...@gm...>
> wrote:
> > >There are two ways of doing POST-ing:
> > >a) a regular one;
> > >b) a multiform POST-ing.
> > What is the difference?
>
> Please, read about HTTP multipart form data POST-ing as in RFC1867
>
> > >Try to capture the traffic, remove all private info and send here to
> see,
> > >what happens.
> >
> > I've attached a Charles Debugging Proxy tool session. It can sniff and
> > deserialize AMF. If you download Charles, you can go to file->open
> session
> > and open that file. It'll show you one request I made to a remoting
> gateway.
> > as well as the response.
>
> Doe it have a linux version
>
> >I can save the AMF to a file, but from
> > curl-loader, how do I tell it to load that file as the content to send?
>
> It should be an example of posting a file. I will look into it later.
> If it is not (somehow) supported
> by curl-loader, it will be rather easy to add.
>
> >
> > Thanks for those examples btw. I didn't realize that 1.4.3 had them in
> it. I
> > DL 1.4.4, not in there.. 1.4.4 must be a patch eh. Anyway, for the most
> part
> > I see through the examples of what has to be done. Just this one issue
> of
> > associating the AMF as the content with it..
>
> Examples were inside from the day one.
>
> By the way, you can use Bugnux linux Live-CD curl-loader version
> just to start from any computer, even Windows.
> The Bugnux version, however, might have some performance penalty.
> --
> Sincerely,
> Robert Iakobashvili,
> coroberti %x40 gmail %x2e com
> ...........................................................
> http://curl-loader.sourceforge.net
> An open-source web testing and traffic generation.
>
> -------------------------------------------------------------------------
> SF.Net email is sponsored by:
> Check out the new SourceForge.net Marketplace.
> It's the best place to buy or sell services for
> just about anything Open Source.
> http://sourceforge.net/services/buy/index.php
> _______________________________________________
> curl-loader-devel mailing list
> cur...@li...
> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel
>

Re: a few questions.. huge load testing job

[aaron s. <bei...@gm...>]

>Please, read about HTTP multipart form data POST-ing as in RFC1867

I took a look at this. The key difference, and where the flash player (I
think)breaks this standard, is with posting data. It doesn't conform to this
multi-part rfc. Specifically in section 3.3 it says "the HTTP protocol can
transport arbitrary BINARY data". That's what the flash player does. It
arbitrarily puts AMF into the body, and gives the content-type /
content-length. hmm.

Here is a sample conf I'm thinking will maybe do the trick.. Based off of
one of the examples..

########### URL SECTION ##################################

# GET-part
URL= http://10.30.6.42:8888/vax/root/Admin
URL_SHORT_NAME="Login-GET"
#URL_DONT_CYCLE = 1
REQUEST_TYPE=GET
TIMER_URL_COMPLETION = 4000
TIMER_AFTER_URL_SLEEP =0

# POST-part
URL=""
URL_SHORT_NAME="Login-POST"
URL_USE_CURRENT= 1
#URL_DONT_CYCLE = 1
REQUEST_TYPE=POST
MULTIPART_FORM_DATA="htmlcode=<HTML></HTML>;type=application/x-amf"
MULTIPART_FORM_DATA="file=@myamf.amf"

I'm also wondering about taking out the file=? so like so?
MULTIPART_FORM_DATA="@myamf.amf"

To try and get arbitrary binary in the body..

What do you think?

Anyway, I'm gonna try some of this out tomorrow. hopefully i'll be able to
get something working..

-Thanks
-Aaron


On Dec 6, 2007 11:01 PM, aaron smith <bei...@gm...>
wrote:

> >Examples were inside from the day one.
> They're not in 0.4.4. There aren't any make files either, It looks like
> 0.4.4. is a patch, lot's of files missing.
>
> >By the way, you can use Bugnux linux Live-CD curl-loader version
> >just to start from any computer, even Windows.
> >The Bugnux version, however, might have some performance penalty.
> Sweet! That's perfect.
>
> >Doe it have a linux version
> Yep. It's java.
>
> >It should be an example of posting a file. I will look into it later.
> >If it is not (somehow) supported
> >by curl-loader, it will be rather easy to add.
>
> Ah I think I got it. So basically when you post a file, it's just posting
> the binary data. So I can just post whatever file the AMF is in and that
> will be the AMF. Right? I don't see why that wouldn't work.
>
>
>
>
>
>
> On Dec 6, 2007 10:42 PM, Robert Iakobashvili <cor...@gm...> wrote:
>
> > Aaron,
> >
> > On Dec 7, 2007 8:33 AM, aaron smith <bei...@gm...>
> > wrote:
> > > >There are two ways of doing POST-ing:
> > > >a) a regular one;
> > > >b) a multiform POST-ing.
> > > What is the difference?
> >
> > Please, read about HTTP multipart form data POST-ing as in RFC1867
> >
> > > >Try to capture the traffic, remove all private info and send here to
> > see,
> > > >what happens.
> > >
> > > I've attached a Charles Debugging Proxy tool session. It can sniff and
> > > deserialize AMF. If you download Charles, you can go to file->open
> > session
> > > and open that file. It'll show you one request I made to a remoting
> > gateway.
> > > as well as the response.
> >
> > Doe it have a linux version
> >
> > >I can save the AMF to a file, but from
> > > curl-loader, how do I tell it to load that file as the content to
> > send?
> >
> > It should be an example of posting a file. I will look into it later.
> > If it is not (somehow) supported
> > by curl-loader, it will be rather easy to add.
> >
> > >
> > > Thanks for those examples btw. I didn't realize that 1.4.3 had them in
> > it. I
> > > DL 1.4.4, not in there.. 1.4.4 must be a patch eh. Anyway, for the
> > most part
> > > I see through the examples of what has to be done. Just this one issue
> > of
> > > associating the AMF as the content with it..
> >
> > Examples were inside from the day one.
> >
> > By the way, you can use Bugnux linux Live-CD curl-loader version
> > just to start from any computer, even Windows.
> > The Bugnux version, however, might have some performance penalty.
> > --
> > Sincerely,
> > Robert Iakobashvili,
> > coroberti %x40 gmail %x2e com
> > ...........................................................
> > http://curl-loader.sourceforge.net
> > An open-source web testing and traffic generation.
> >
> >
> > -------------------------------------------------------------------------
> > SF.Net email is sponsored by:
> > Check out the new SourceForge.net Marketplace.
> > It's the best place to buy or sell services for
> > just about anything Open Source.
> > http://sourceforge.net/services/buy/index.php
> > _______________________________________________
> > curl-loader-devel mailing list
> > cur...@li...
> > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel
> >
>
>

Re: a few questions.. huge load testing job

[Robert I. <cor...@gm...>]

Aaron,

On Dec 7, 2007 9:32 AM, aaron smith <bei...@gm...> wrote:
I will look at it on Sunday or Mozei Shabbat, as we are on the eve of Shabbat
here in Israel.

Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
An open-source web testing and traffic generation.

Re: a few questions.. huge load testing job

[aaron s. <bei...@gm...>]

ok. thanks for all the help. I'm writing up a pretty big article about what
I'm doing for this kind of stress testing and remoting gateways. Their
aren't any for Flex that are good, so this could be huge for our community..
Thanks again for any help. -Aaron

On Dec 7, 2007 1:23 AM, Robert Iakobashvili <cor...@gm...> wrote:

> Aaron,
>
> On Dec 7, 2007 9:32 AM, aaron smith <bei...@gm...>
> wrote:
> I will look at it on Sunday or Mozei Shabbat, as we are on the eve of
> Shabbat
> here in Israel.
>
> Sincerely,
> Robert Iakobashvili,
> coroberti %x40 gmail %x2e com
> ...........................................................
> http://curl-loader.sourceforge.net
> An open-source web testing and traffic generation.
>
> -------------------------------------------------------------------------
> SF.Net email is sponsored by:
> Check out the new SourceForge.net Marketplace.
> It's the best place to buy or sell services for
> just about anything Open Source.
> http://sourceforge.net/services/buy/index.php
> _______________________________________________
> curl-loader-devel mailing list
> cur...@li...
> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel
>

Re: a few questions.. huge load testing job

[Robert I. <cor...@gm...>]

On Dec 7, 2007 9:32 AM, aaron smith <bei...@gm...> wrote:
> >Please, read about HTTP multipart form data POST-ing as in RFC1867
>
> I took a look at this. The key difference, and where the flash player (I
> think)breaks this standard, is with posting data. It doesn't conform to this
> multi-part rfc

It means, that it is not multipart form data, but rather a regular POST-ing.

I tried to make Charles Debugging Proxy working on my linux spending some time,
but it fails. Probably, jdk-6 is the reason, but nether mind, send to
me a wireshark
traffic capture for a single HTTP session, and I will tell what to do,
or, if necessary,
will patch curl-loader to support it.

Waiting for your wireshark capture.

Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
An open-source web testing and traffic generation.

Re: a few questions.. huge load testing job

[Robert I. <cor...@gm...>]

Aaron,

On Dec 10, 2007 3:45 AM, aaron smith <bei...@gm...> wrote:
> I would appreciate the help so much, and a patch would be awesome! Thanks!
> Here is a wireshark dump.

POST //amfphp/gateway.php HTTP/1.1
Accept: */*
Accept-Language: en-US
Referer: http://www.petmoustache.com/global/swf/main.swf
x-flash-version: 9,0,115,0
Content-Type: application/x-amf
Content-Length: 55561
Accept-Encoding: gzip, deflate
User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
Host: petmoustache.com
Connection: Keep-Alive
Cache-Control: no-cache
Cookie: __utma=110968324.1943311580.1197250082.1197250082.1197250082.1;
__utmb=110968324; __utmc=110968324;
__utmz=110968324.1197250082.1.1.utmccn=(direct)|utmcsr=(direct)|utmcmd=(none);
PHPSESSID=70624e053d197b61ce5e704d45f1a5ff
-----------------------------------------------------------------------------
body
-----------------------------------------------------------------------------

This is the POST, which we see.

The url to be used seems to be:
http://petmoustache.com/amfphp/gateway.php

The essential header to be added via HEADER-tag up to me are:

HEADER="Referer: http://www.petmoustache.com/global/swf/main.swf"
HEADER="x-flash-version: 9,0,115,0"
HEADER="Content-Type: application/x-amf"
HEADER="Cache-Control: no-cache"
HEADER="Cookie:
__utma=110968324.1943311580.1197250082.1197250082.1197250082.1;
__utmb=110968324; __utmc=110968324;
__utmz=110968324.1197250082.1.1.utmccn=(direct)|utmcsr=(direct)|utmcmd=(none);
PHPSESSID=70624e053d197b61ce5e704d45f1a5ff"

Note, that Cookie is a separate story, which is generated per user and
it depends on
the policy of you web-server. Y may need to play with it or without it, etc.

What the POST is doing is actually uploading some binary file.
We have such an example for the PUT method, namely put.conf.

Your url section may be similar:
--------------------------------------------------------------------------------------------------------
URL=http://petmoustache.com/amfphp/gateway.php
URL_SHORT_NAME="POST-file"
REQUEST_TYPE=POST
UPLOAD_FILE=Atterntion!!!** place a path to your file from
curl-loader, like ./myfile***
HEADER="Referer: http://www.petmoustache.com/global/swf/main.swf"
HEADER="x-flash-version: 9,0,115,0"
HEADER="Content-Type: application/x-amf"
HEADER="Cache-Control: no-cache"
HEADER="Cookie:
__utma=110968324.1943311580.1197250082.1197250082.1197250082.1;
__utmb=110968324; __utmc=110968324;
__utmz=110968324.1197250082.1.1.utmccn=(direct)|utmcsr=(direct)|utmcmd=(none);
PHPSESSID=70624e053d197b61ce5e704d45f1a5ff"
TIMER_URL_COMPLETION = 0  # In msec. When positive, Now it is enforced
by cancelling url fetch on timeout
TIMER_AFTER_URL_SLEEP =3000

Please, run that (sure on linux) with a single client
and a single cycle with -v and -u options also added (verbose
debugging) to curl-loader
command line (learn for -f <batch file> and other options) and
wireshark capture to see, if there are any problems.

If it works, start increasing, etc.
If not, send to me:
a) the log of curl-loader <your-batch-name>.log;
b) the wireshark capture.


Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
An open-source web testing and traffic generation.

Re: a few questions.. huge load testing job

[aaron s. <bei...@gm...>]

Thanks Robert! I''ll be trying this out sometime today or tomorrow and let
you know what happens..

-A

On Dec 9, 2007 11:54 PM, Robert Iakobashvili <cor...@gm...> wrote:

> Aaron,
>
> On Dec 10, 2007 3:45 AM, aaron smith <bei...@gm...>
> wrote:
> > I would appreciate the help so much, and a patch would be awesome!
> Thanks!
> > Here is a wireshark dump.
>
> POST //amfphp/gateway.php HTTP/1.1
> Accept: */*
> Accept-Language: en-US
> Referer: http://www.petmoustache.com/global/swf/main.swf
> x-flash-version: 9,0,115,0
> Content-Type: application/x-amf
> Content-Length: 55561
> Accept-Encoding: gzip, deflate
> User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
> Host: petmoustache.com
> Connection: Keep-Alive
> Cache-Control: no-cache
> Cookie: __utma=110968324.1943311580.1197250082.1197250082.1197250082.1;
> __utmb=110968324; __utmc=110968324;
> __utmz=110968324.1197250082.1.1.utmccn=
> (direct)|utmcsr=(direct)|utmcmd=(none);
> PHPSESSID=70624e053d197b61ce5e704d45f1a5ff
>
> -----------------------------------------------------------------------------
> body
>
> -----------------------------------------------------------------------------
>
> This is the POST, which we see.
>
> The url to be used seems to be:
> http://petmoustache.com/amfphp/gateway.php
>
> The essential header to be added via HEADER-tag up to me are:
>
> HEADER="Referer: http://www.petmoustache.com/global/swf/main.swf"
> HEADER="x-flash-version: 9,0,115,0"
> HEADER="Content-Type: application/x-amf"
> HEADER="Cache-Control: no-cache"
> HEADER="Cookie:
> __utma=110968324.1943311580.1197250082.1197250082.1197250082.1;
> __utmb=110968324; __utmc=110968324;
> __utmz=110968324.1197250082.1.1.utmccn=
> (direct)|utmcsr=(direct)|utmcmd=(none);
> PHPSESSID=70624e053d197b61ce5e704d45f1a5ff"
>
> Note, that Cookie is a separate story, which is generated per user and
> it depends on
> the policy of you web-server. Y may need to play with it or without it,
> etc.
>
> What the POST is doing is actually uploading some binary file.
> We have such an example for the PUT method, namely put.conf.
>
> Your url section may be similar:
>
> --------------------------------------------------------------------------------------------------------
> URL=http://petmoustache.com/amfphp/gateway.php
> URL_SHORT_NAME="POST-file"
> REQUEST_TYPE=POST
> UPLOAD_FILE=Atterntion!!!** place a path to your file from
> curl-loader, like ./myfile***
> HEADER="Referer: http://www.petmoustache.com/global/swf/main.swf"
> HEADER="x-flash-version: 9,0,115,0"
> HEADER="Content-Type: application/x-amf"
> HEADER="Cache-Control: no-cache"
> HEADER="Cookie:
> __utma=110968324.1943311580.1197250082.1197250082.1197250082.1;
> __utmb=110968324; __utmc=110968324;
> __utmz=110968324.1197250082.1.1.utmccn=
> (direct)|utmcsr=(direct)|utmcmd=(none);
> PHPSESSID=70624e053d197b61ce5e704d45f1a5ff"
> TIMER_URL_COMPLETION = 0  # In msec. When positive, Now it is enforced
> by cancelling url fetch on timeout
> TIMER_AFTER_URL_SLEEP =3000
>
> Please, run that (sure on linux) with a single client
> and a single cycle with -v and -u options also added (verbose
> debugging) to curl-loader
> command line (learn for -f <batch file> and other options) and
> wireshark capture to see, if there are any problems.
>
> If it works, start increasing, etc.
> If not, send to me:
> a) the log of curl-loader <your-batch-name>.log;
> b) the wireshark capture.
>
>
> Sincerely,
> Robert Iakobashvili,
> coroberti %x40 gmail %x2e com
> ...........................................................
> http://curl-loader.sourceforge.net
> An open-source web testing and traffic generation.
>
> -------------------------------------------------------------------------
> SF.Net email is sponsored by:
> Check out the new SourceForge.net Marketplace.
> It's the best place to buy or sell services for
> just about anything Open Source.
> http://sourceforge.net/services/buy/index.php
> _______________________________________________
> curl-loader-devel mailing list
> cur...@li...
> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel
>

Re: a few questions.. huge load testing job

[Robert I. <cor...@gm...>]

Aaron,

On Dec 10, 2007 7:04 PM, aaron smith <bei...@gm...>
wrote:

> Thanks Robert! I''ll be trying this out sometime today or tomorrow and let
> you know what happens..
>
>
> > POST //amfphp/gateway.php HTTP/1.1
> > Accept: */*
> > Accept-Language: en-US
> > Referer: http://www.petmoustache.com/global/swf/main.swf
> > x-flash-version<http://www.petmoustache.com/global/swf/main.swfx-flash-version>:
> > 9,0,115,0
> > Content-Type: application/x-amf
> > Content-Length: 55561
> > Accept-Encoding: gzip, deflate
> > User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
> > Host: petmoustache.com
> > Connection: Keep-Alive
> > Cache-Control: no-cache
> > Cookie: __utma=110968324.1943311580.1197250082.1197250082.1197250082.1;
> > __utmb=110968324; __utmc=110968324;
> > __utmz=110968324.1197250082.1.1.utmccn=(direct)|utmcsr=(direct)|utmcmd=(none);
> > PHPSESSID=70624e053d197b61ce5e704d45f1a5ff
> >
> > -----------------------------------------------------------------------------
> > body
> > -----------------------------------------------------------------------------
> >
> >
> > This is the POST, which we see.
> >
> > The url to be used seems to be:
> > http://petmoustache.com/amfphp/gateway.php
> >
> > The essential header to be added via HEADER-tag up to me are:
> >
> > HEADER="Referer: http://www.petmoustache.com/global/swf/main.swf "
> > HEADER="x-flash-version: 9,0,115,0"
> > HEADER="Content-Type: application/x-amf"
> > HEADER="Cache-Control: no-cache"
> > HEADER="Cookie:
> > __utma=110968324.1943311580.1197250082.1197250082.1197250082.1 ;
> > __utmb=110968324; __utmc=110968324;
> > __utmz=110968324.1197250082.1.1.utmccn=
> > (direct)|utmcsr=(direct)|utmcmd=(none);
> > PHPSESSID=70624e053d197b61ce5e704d45f1a5ff"
> >
> > Note, that Cookie is a separate story, which is generated per user and
> > it depends on
> > the policy of you web-server. Y may need to play with it or without it,
> > etc.
> >
> > What the POST is doing is actually uploading some binary file.
> > We have such an example for the PUT method, namely put.conf.
> >
> > Your url section may be similar:
> >
> > --------------------------------------------------------------------------------------------------------
> > URL= http://petmoustache.com/amfphp/gateway.php
> > URL_SHORT_NAME="POST-file"
> > REQUEST_TYPE=POST
> > UPLOAD_FILE=Atterntion!!!** place a path to your file from
> > curl-loader, like ./myfile***
> > HEADER="Referer: http://www.petmoustache.com/global/swf/main.swf"
> > HEADER="x-flash-version: 9,0,115,0"
> > HEADER="Content-Type: application/x-amf"
> > HEADER="Cache-Control: no-cache"
> > HEADER="Cookie:
> > __utma=110968324.1943311580.1197250082.1197250082.1197250082.1;
> > __utmb=110968324; __utmc=110968324;
> > __utmz=110968324.1197250082.1.1.utmccn=(direct)|utmcsr=(direct)|utmcmd=(none);
> >
> > PHPSESSID=70624e053d197b61ce5e704d45f1a5ff"
> > TIMER_URL_COMPLETION = 0  # In msec. When positive, Now it is enforced
> > by cancelling url fetch on timeout
> > TIMER_AFTER_URL_SLEEP =3000
> >
> > Please, run that (sure on linux) with a single client
> > and a single cycle with -v and -u options also added (verbose
> > debugging) to curl-loader
> > command line (learn for -f <batch file> and other options) and
> > wireshark capture to see, if there are any problems.
> >
> > If it works, start increasing, etc.
> > If not, send to me:
> > a) the log of curl-loader <your-batch-name>.log;
> > b) the wireshark capture.
> >
> >
Better late, than nether.
Occasionally, I seen, that our checks do not allow POST-ing
of a binary file without any POST-form.

The error message will be something like: error: post_data is NULL.

Therefore, I have committed a small patch.
Y can either checkout the latest svn code, or apply the patch attached.

Best wishes.

-- 
Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
An open-source web testing and traffic generation.

Re: a few questions.. huge load testing job

[Robert I. <cor...@gm...>]

Aaron,

On Jan 5, 2008 1:16 AM, aaron smith <bei...@gm...> wrote:

>
> Basically what's happening is the content from the file is not being put
> into the body. But It does grab the content-length correctly. It seems to me
> everything is ok, except the binary data isn't being attached..

You are correct on your side. The problem seen in wireshark is that
curl-loader was sending PUT and not POST.

This is due to verification by libcurl, the HTTP stack library, that
we are using.
I am sorry to conclude, that it will require patching of libcurl and
more time on our side to fix the issue.

Y can try to use JMeter in meanwhile.


Sincerely,
Robert Iakobashvili
"Light will come from Jerusalem"
...........................................................
http://curl-loader.sourceforge.net
An open-source web testing and traffic generation.

Re: a few questions.. huge load testing job

[aaron s. <bei...@gm...>]

Thanks Robert, I guess that's unfortunate. However jmeter was very easy to
setup and it works just as expected. Thank you for your time helping me.
-Aaron

On Jan 5, 2008 1:02 AM, Robert Iakobashvili <cor...@gm...> wrote:

> Aaron,
>
> On Jan 5, 2008 1:16 AM, aaron smith <bei...@gm...>
> wrote:
>
> >
> > Basically what's happening is the content from the file is not being put
> > into the body. But It does grab the content-length correctly. It seems
> to me
> > everything is ok, except the binary data isn't being attached..
>
> You are correct on your side. The problem seen in wireshark is that
> curl-loader was sending PUT and not POST.
>
> This is due to verification by libcurl, the HTTP stack library, that
> we are using.
> I am sorry to conclude, that it will require patching of libcurl and
> more time on our side to fix the issue.
>
> Y can try to use JMeter in meanwhile.
>
>
> Sincerely,
> Robert Iakobashvili
> "Light will come from Jerusalem"
> ...........................................................
> http://curl-loader.sourceforge.net
> An open-source web testing and traffic generation.
>
> -------------------------------------------------------------------------
> This SF.net email is sponsored by: Microsoft
> Defy all challenges. Microsoft(R) Visual Studio 2005.
> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
> _______________________________________________
> curl-loader-devel mailing list
> cur...@li...
> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel
>

Re: a few questions.. huge load testing job

[Robert I. <cor...@gm...>]

Aaron,

On Jan 10, 2008 5:40 AM, aaron smith <bei...@gm...>
wrote:

> Thanks Robert, I guess that's unfortunate. However jmeter was very easy to
> setup and it works just as expected. Thank you for your time helping me.
> -Aaron
>
> JMeter is a great tool, that we like.
curl-loader is supposed to deliver a high-performance and heavy load.
When the fix for PUT instead POST in either libcurl or our workaround will
be available, I'll inform you.

Sincerely,
Robert Iakobashvili
"Light will come from Jerusalem"
...........................................................
http://curl-loader.sourceforge.net
An open-source web testing and traffic generation.