Re: web server optimization question

[Robert I. <cor...@gm...>]

Hi Jari,

On 9/2/07, jari pietila <jar...@ho...> wrote:
> My main purpose for using  curl-load is to load a device (stateful fw)
> beetween clients and server.
>
> The question: how to optimize Apache and curl-load query parameters
> to achieve  max in terms of CAPS

Default Apache configuration is really limiting.

>   -how to optimize Apache (or would Lighthttpd be better ?)

I would suggest you to use nginx, which was found even better,
than lighttpd. It has a Debian package and nice docs here, but you can use just
the default conf
http://wiki.codemongers.com/Main?action=show&redirect=Nginx

>   - what curl-load client options could be adjusted one increase connection
> rate?

We seen, that you do not need much connections to reach high CAPS.
Something between 100 and 1000 is enough.

Compile curl-loader with optimization as described:
http://curl-loader.sourceforge.net/doc/faq.html#big-load
http://curl-loader.sourceforge.net/high-load-hw/index.html
Most probably, you do not need to fine-tune linux, whereas you can try.

What is most important is to ensure persistance of the tcp-connections.
curl-loader makes its best, therefore make sure, that server does as well.

If your client machine has multiple-core or multiple CPU, you can also try
an option to run it with -t <number> option, where the numbers to try are
2, 4, 8

With nginx I have seen 6000 - 8000 CAPS with a small file of 100-200 bytes
and 200-400 curl-loader virtual clients, each with an established keep-alived
connection.

Highest number of CAPS you'll get as a guess, when
TIMER_URL_COMPLETION = 0
TIMER_AFTER_URL_SLEEP = 0

Best wishes and report to the list you best experience.

-- 
Sincerely,
Robert Iakobashvili,
coroberti %x40 gmail %x2e com
...........................................................
http://curl-loader.sourceforge.net
A web testing and traffic generation tool.