curl-loader-devel Mailing List for curl-loader - web application testing (Page 5)
Status: Alpha
Brought to you by:
coroberti
Menu
▾
▴
curl-loader-devel — curl-loader usage and development issues
You can subscribe to this list here.
| 2006 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
(1) |
Dec
|
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2007 |
Jan
|
Feb
(1) |
Mar
(7) |
Apr
(19) |
May
(25) |
Jun
(16) |
Jul
(59) |
Aug
(29) |
Sep
(18) |
Oct
(19) |
Nov
(7) |
Dec
(29) |
| 2008 |
Jan
(6) |
Feb
(18) |
Mar
(8) |
Apr
(27) |
May
(26) |
Jun
(5) |
Jul
(6) |
Aug
|
Sep
(9) |
Oct
(37) |
Nov
(61) |
Dec
(17) |
| 2009 |
Jan
(21) |
Feb
(25) |
Mar
(4) |
Apr
(2) |
May
(8) |
Jun
(15) |
Jul
(18) |
Aug
(23) |
Sep
(10) |
Oct
(16) |
Nov
(14) |
Dec
(22) |
| 2010 |
Jan
(23) |
Feb
(8) |
Mar
(18) |
Apr
(1) |
May
(34) |
Jun
(23) |
Jul
(11) |
Aug
(1) |
Sep
(13) |
Oct
(10) |
Nov
(2) |
Dec
(8) |
| 2011 |
Jan
|
Feb
(7) |
Mar
(24) |
Apr
(12) |
May
(3) |
Jun
(2) |
Jul
(2) |
Aug
|
Sep
(5) |
Oct
(20) |
Nov
(7) |
Dec
(11) |
| 2012 |
Jan
(12) |
Feb
(5) |
Mar
(16) |
Apr
(3) |
May
|
Jun
(5) |
Jul
(12) |
Aug
(6) |
Sep
|
Oct
|
Nov
(8) |
Dec
|
| 2013 |
Jan
(1) |
Feb
(3) |
Mar
(5) |
Apr
(3) |
May
(1) |
Jun
|
Jul
(1) |
Aug
(2) |
Sep
(9) |
Oct
|
Nov
(8) |
Dec
(4) |
| 2014 |
Jan
(4) |
Feb
|
Mar
(1) |
Apr
|
May
(1) |
Jun
|
Jul
|
Aug
|
Sep
(4) |
Oct
|
Nov
(11) |
Dec
(5) |
| 2015 |
Jan
(1) |
Feb
|
Mar
(11) |
Apr
(3) |
May
(1) |
Jun
(1) |
Jul
(4) |
Aug
(1) |
Sep
(7) |
Oct
(4) |
Nov
(2) |
Dec
|
| 2016 |
Jan
|
Feb
(1) |
Mar
|
Apr
|
May
|
Jun
|
Jul
(1) |
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
| 2018 |
Jan
|
Feb
|
Mar
|
Apr
|
May
(1) |
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
| 2020 |
Jan
|
Feb
|
Mar
|
Apr
(1) |
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
| 2022 |
Jan
(1) |
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Toz Ed <toz...@ya...> - 2013-02-07 00:34:24
|
http://www.cellforce.com/cxbkw/0jcbd0o5oovb7cotrxftgfha2lp487hqd2maq |
|
From: Toz Ed <toz...@ya...> - 2013-02-01 18:57:11
|
http://e-comercial.com/erwdvb.html ------------------------ Toz Ed ------------------- tuh% |
|
From: Alexander K. <a....@gm...> - 2013-01-24 16:09:56
|
Hello, when I fill config with with string like >>MULTIPART_FORM_DATA="package=@/root/tools/test/files/Dispatcher\ 4.1.0.zip" then I've got an error >> ERR couldn't open file "/root/tools/test/files/Dispatcher\ 4.1.0.zip" Same thing caused when I use path @/root/tools/test/files/Dispatcher 4.1.0.zip and @"/root/tools/test/files/Dispatcher 4.1.0.zip". perl-loader 0.56 Could you please give me a solution to solve this problem? |
|
From: Fred H. <di...@gm...> - 2012-11-26 07:08:28
|
yes. I will follow up. one more thing I see is that cares driven by libcurl sends queries in req/resp/req/resp/req/resp mode while adnshost sends queries in req,req,req/resp, resp,resp/... mode. that is to say, libcares doesnot use multi-querying in the wire line. req/resp/req/resp mode has a limit between 250~600 queries/s, while req,req,req/resp, resp,resp/... mode can reach 10,000 queries/s 2012/11/24 Robert Iakobashvili <cor...@gm...> > Hi Fred, > I think you can address this suggestion and your observations to the lists > of cares and curl-development. > > Take care, > Thanks > Robert > > On Sat, Nov 24, 2012 at 5:00 PM, Fred Huang <di...@gm...> wrote: > > hi all, > > > > is it possible to use adns (http://www.chiark.greenend.org.uk/~ian/adns/) > to > > do dns resolving instead of libc-ares? all my test results shows that > > lib-cares can do no more than 300 queries per second. however, using 'dig > > +short -f hostnames.list &>/dev/null' against same dns server I can get > more > > 7500 queries per second. I think libc-ares is also limited by the system > API > > of gethostbyname. > > > > About ADNS lib: > > Many clients for DNS resolution are coded poorly.Most UNIX systems > > provide an implementation of gethostbyname (the DNS client > API—application > > program interface), which cannot concurrently handle multiple outstanding > > requests. Therefore, the crawler cannot issue many resolution requests > > together and poll at a later time for completion of individual requests, > > which is critical for acceptable performance. Furthermore, if the > > system-provided client is used, there is no way to distribute load among > a > > number of DNS servers. For all these reasons, many crawlers choose to > > include their own custom client for DNS name resolution. The Mercator > > crawler from Compaq System Research Center reduced the time spent in DNS > > from as high as 87% to a modest 25% by implementing a custom client. The > > ADNS asynchronous DNS client library is ideal for use in crawlers. > > In spite of these optimizations, a large-scale crawler will spend a > > substantial fraction of its network time not waiting for Http data > transfer, > > but for address resolution. For every hostname that has not been resolved > > before (which happens frequently with crawlers), the local DNS may have > to > > go across many network hops to fill its cache for the first time. To > overlap > > this unavoidable delay with useful work, prefetching can be used. When a > > page that has just been fetched is parsed, a stream of HREFs is > extracted. > > Right at this time, that is, even before any of the corresponding URLs > are > > fetched, hostnames are extracted from the HREF targets, and DNS > resolution > > requests are made to the caching server. The prefetching client is > usually > > implemented using UDP instead of TCP, and it does not wait for > resolution > > to be completed. The request serves only to fill the DNS cache so that > > resolution will be fast when the page is actually needed later on. > > > > ===end > > > > > > 2012/3/5 Fred Huang <di...@gm...> > >> > >> test 1: > >> > >> dns server: dnsmasq@127.0.0.1, 2,000,000 dns entry cache, resolve > *.com to > >> one IP address > >> number of domain names in all https URLs: 780,000 > >> number of client: 1000 > >> CPU usage: 78% > >> cpu% irq% sirq% sys% iowt% mem_used buf&cached > >> 78.8 0.0 0.6 3.8 0.0 3640.9Mb 282.1Mb > >> SSL TPS: 300 > >> SSL throughput: 200Mbps > >> > >> # gprof /usr/bin/curl-loader gmon.out -p | head -50 > >> Flat profile: > >> Each sample counts as 0.01 seconds. > >> % cumulative self self total > >> time seconds seconds calls s/call s/call name > >> 38.55 127.10 127.10 130975 0.00 0.00 > >> Curl_hash_clean_with_criterium > >> 24.63 208.32 81.22 1247528407 0.00 0.00 > >> hostcache_timestamp_remove > >> 13.08 251.44 43.12 2791988 0.00 0.00 Curl_hash_pick > >> 7.30 275.51 24.07 352490 0.00 0.00 Curl_hash_add > >> 6.01 295.31 19.80 410760770 0.00 0.00 > >> Curl_str_key_compare > >> 2.95 305.04 9.73 131015 0.00 0.00 create_conn > >> 0.88 307.94 2.90 4841390 0.00 0.00 dprintf_formatf > >> 0.74 310.38 2.44 136036 0.00 0.00 ConnectionStore > >> 0.48 311.96 1.58 814604911 0.00 0.00 > ares__is_list_empty > >> 0.36 313.16 1.20 locking_function > >> 0.27 314.06 0.90 261608 0.00 0.00 ares_cancel > >> 0.22 314.79 0.73 127417 0.00 0.00 > >> curl_multi_remove_handle > >> 0.19 315.40 0.62 8906301 0.00 0.00 > >> client_tracing_function > >> 0.17 315.97 0.57 135305 0.00 0.00 Curl_num_addresses > >> 0.17 316.54 0.57 181937907 0.00 0.00 addbyter > >> 0.17 317.09 0.55 2374363 0.00 0.00 multi_runsingle > >> 0.16 317.62 0.53 541954 0.00 0.00 > ares__init_list_node > >> 0.16 318.14 0.52 494412 0.00 0.00 > >> curl_multi_socket_action > >> 0.14 318.60 0.46 33578897 0.00 0.00 Curl_socket_check > >> 0.13 319.04 0.44 102951052 0.00 0.00 Curl_raw_toupper > >> 0.13 319.48 0.44 787558 0.00 0.00 Curl_readwrite > >> 0.13 319.91 0.44 id_function > >> 0.12 320.29 0.38 391390 0.00 0.00 Curl_hash_str > >> 0.09 320.58 0.29 9216 0.00 0.00 curl_multi_perform > >> 0.08 320.86 0.28 2350908 0.00 0.00 Curl_raw_equal > >> 0.08 321.14 0.28 2019415 0.00 0.00 Curl_splay > >> 0.08 321.40 0.26 520625 0.00 0.00 > ossl_connect_common > >> 0.08 321.65 0.25 3532992 0.00 0.00 Curl_pgrsUpdate > >> 0.07 321.87 0.22 131778537 0.00 0.00 curl_strequal > >> 0.05 322.05 0.18 8954118 0.00 0.00 scan_response > >> 0.05 322.23 0.18 533644 0.00 0.00 ares_expand_name > >> 0.05 322.40 0.17 2477345 0.00 0.00 fd_key_compare > >> 0.05 322.57 0.17 2429135 0.00 0.00 Curl_infof > >> 0.05 322.74 0.17 130966 0.00 0.00 singleipconnect > >> 0.05 322.90 0.16 9292 0.00 0.00 > >> curl_multi_socket_all > >> 0.05 323.06 0.16 270137 0.00 0.00 ares__get_hostent > >> 0.05 323.21 0.15 8943657 0.00 0.00 Curl_debug > >> 0.04 323.35 0.14 262493 0.00 0.00 > >> Curl_ssl_getsessionid > >> 0.04 323.48 0.13 566006 0.00 0.00 socket_callback > >> 0.04 323.61 0.13 33983864 0.00 0.00 curlx_tvdiff > >> 0.04 323.74 0.13 132853 0.00 0.00 > >> Curl_http_readwrite_headers > >> 0.04 323.86 0.12 344032 0.00 0.00 epoll_del > >> 0.04 323.98 0.12 223477 0.00 0.00 Curl_poll > >> 0.04 324.10 0.12 8526280 0.00 0.00 Curl_raw_nequal > >> 0.03 324.21 0.11 348839 0.00 0.00 event_del > >> > >> > >> > >> > >> test 2: > >> > >> dns server: dnsmasq@127.0.0.1, 2,000,000 dns entry cache, resolve > *.com to > >> one IP address > >> number of domain names in all https URLs: 1 > >> number of client: 1000 > >> CPU usage: 75% > >> SSL TPS: 1300 > >> SSL throughput: 700Mbps > >> > >> # gprof /usr/bin/curl-loader gmon.out -p | head -50 > >> Flat profile: > >> Each sample counts as 0.01 seconds. > >> % cumulative self self total > >> time seconds seconds calls s/call s/call name > >> 8.98 2.45 2.45 5127312 0.00 0.00 dprintf_formatf > >> 8.90 4.88 2.43 1292796503 0.00 0.00 > >> ares__is_list_empty > >> 6.12 6.55 1.67 322461 0.00 0.00 create_conn > >> 4.58 7.80 1.25 419872 0.00 0.00 ares_cancel > >> 4.10 8.92 1.12 2100162 0.00 0.00 Curl_readwrite > >> 3.92 9.99 1.07 4527388 0.00 0.00 Curl_hash_pick > >> 3.43 10.93 0.94 locking_function > >> 3.04 11.76 0.83 909759 0.00 0.00 > >> curl_multi_socket_action > >> 3.00 12.58 0.82 97252 0.00 0.00 > >> Curl_hash_clean_with_criterium > >> 2.71 13.32 0.74 179704016 0.00 0.00 Curl_raw_toupper > >> 2.68 14.05 0.73 4646524 0.00 0.00 multi_runsingle > >> 2.44 14.71 0.67 13862992 0.00 0.00 > >> client_tracing_function > >> 2.42 15.37 0.66 319735 0.00 0.00 > >> curl_multi_remove_handle > >> 2.42 16.03 0.66 22 0.03 0.03 > ares__init_list_node > >> 1.94 16.56 0.53 9930244 0.00 0.00 > >> hostcache_timestamp_remove > >> 1.94 17.09 0.53 169320088 0.00 0.00 addbyter > >> 1.80 17.58 0.49 id_function > >> 1.36 17.95 0.37 7057146 0.00 0.00 Curl_pgrsUpdate > >> 1.36 18.32 0.37 16835 0.00 0.00 > >> curl_multi_socket_all > >> 1.25 18.66 0.34 16719 0.00 0.00 curl_multi_perform > >> 1.21 18.99 0.33 329403 0.00 0.00 > >> Curl_http_readwrite_headers > >> 1.17 19.31 0.32 4036624 0.00 0.00 Curl_splay > >> 1.14 19.62 0.31 20838902 0.00 0.00 Curl_raw_nequal > >> 0.82 19.85 0.23 2764123 0.00 0.00 Curl_infof > >> 0.81 20.07 0.22 5933857 0.00 0.00 ossl_recv > >> 0.77 20.28 0.21 323112 0.00 0.00 > >> Curl_splayremovebyaddr > >> 0.75 20.48 0.21 5943991 0.00 0.00 Curl_read > >> 0.70 20.67 0.19 425174 0.00 0.00 event_del > >> 0.70 20.86 0.19 98652 0.00 0.00 > >> Curl_if_is_interface_name > >> 0.70 21.05 0.19 8677733 0.00 0.00 Curl_socket_check > >> 0.59 21.21 0.16 4129554 0.00 0.00 fd_key_compare > >> 0.57 21.37 0.16 14017019 0.00 0.00 Curl_debug > >> 0.55 21.52 0.15 9376861 0.00 0.00 stat_data_in_add > >> 0.55 21.67 0.15 6840468 0.00 0.00 Curl_timeleft > >> 0.55 21.82 0.15 2054602 0.00 0.00 Curl_raw_equal > >> 0.55 21.97 0.15 1291611 0.00 0.00 Curl_expire > >> 0.51 22.11 0.14 16570063 0.00 0.00 curlx_tvnow > >> 0.51 22.25 0.14 13863284 0.00 0.00 scan_response > >> 0.51 22.39 0.14 5498864 0.00 0.00 Curl_setopt > >> 0.48 22.52 0.13 97490291 0.00 0.00 curl_strequal > >> 0.44 22.64 0.12 324253 0.00 0.00 Curl_http > >> 0.44 22.76 0.12 394386 0.00 0.00 > ossl_connect_common > >> 0.40 22.87 0.11 3581335 0.00 0.00 Curl_getinfo > >> 0.38 22.97 0.11 26983092 0.00 0.00 alloc_addbyter > >> 0.37 23.07 0.10 8729044 0.00 0.00 Curl_client_write > >> > > > > > > > ------------------------------------------------------------------------------ > > Monitor your physical, virtual and cloud infrastructure from a single > > web console. Get in-depth insight into apps, servers, databases, vmware, > > SAP, cloud infrastructure, etc. Download 30-day Free Trial. > > Pricing starts from $795 for 25 servers or applications! > > http://p.sf.net/sfu/zoho_dev2dev_nov > > _______________________________________________ > > curl-loader-devel mailing list > > cur...@li... > > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > > > > > -- > Regards, > Robert Iakobashvili, Ph.D. > > Home: http://www.ghotit.com > ......................................................... > Ghotit Dyslexia -> Das Ist Real Writer > ......................................................... > > > ------------------------------------------------------------------------------ > Monitor your physical, virtual and cloud infrastructure from a single > web console. Get in-depth insight into apps, servers, databases, vmware, > SAP, cloud infrastructure, etc. Download 30-day Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > |
|
From: Robert I. <cor...@gm...> - 2012-11-24 15:06:43
|
Hi Fred, I think you can address this suggestion and your observations to the lists of cares and curl-development. Take care, Thanks Robert On Sat, Nov 24, 2012 at 5:00 PM, Fred Huang <di...@gm...> wrote: > hi all, > > is it possible to use adns (http://www.chiark.greenend.org.uk/~ian/adns/) to > do dns resolving instead of libc-ares? all my test results shows that > lib-cares can do no more than 300 queries per second. however, using 'dig > +short -f hostnames.list &>/dev/null' against same dns server I can get more > 7500 queries per second. I think libc-ares is also limited by the system API > of gethostbyname. > > About ADNS lib: > Many clients for DNS resolution are coded poorly.Most UNIX systems > provide an implementation of gethostbyname (the DNS client API—application > program interface), which cannot concurrently handle multiple outstanding > requests. Therefore, the crawler cannot issue many resolution requests > together and poll at a later time for completion of individual requests, > which is critical for acceptable performance. Furthermore, if the > system-provided client is used, there is no way to distribute load among a > number of DNS servers. For all these reasons, many crawlers choose to > include their own custom client for DNS name resolution. The Mercator > crawler from Compaq System Research Center reduced the time spent in DNS > from as high as 87% to a modest 25% by implementing a custom client. The > ADNS asynchronous DNS client library is ideal for use in crawlers. > In spite of these optimizations, a large-scale crawler will spend a > substantial fraction of its network time not waiting for Http data transfer, > but for address resolution. For every hostname that has not been resolved > before (which happens frequently with crawlers), the local DNS may have to > go across many network hops to fill its cache for the first time. To overlap > this unavoidable delay with useful work, prefetching can be used. When a > page that has just been fetched is parsed, a stream of HREFs is extracted. > Right at this time, that is, even before any of the corresponding URLs are > fetched, hostnames are extracted from the HREF targets, and DNS resolution > requests are made to the caching server. The prefetching client is usually > implemented using UDP instead of TCP, and it does not wait for resolution > to be completed. The request serves only to fill the DNS cache so that > resolution will be fast when the page is actually needed later on. > > ===end > > > 2012/3/5 Fred Huang <di...@gm...> >> >> test 1: >> >> dns server: dnsmasq@127.0.0.1, 2,000,000 dns entry cache, resolve *.com to >> one IP address >> number of domain names in all https URLs: 780,000 >> number of client: 1000 >> CPU usage: 78% >> cpu% irq% sirq% sys% iowt% mem_used buf&cached >> 78.8 0.0 0.6 3.8 0.0 3640.9Mb 282.1Mb >> SSL TPS: 300 >> SSL throughput: 200Mbps >> >> # gprof /usr/bin/curl-loader gmon.out -p | head -50 >> Flat profile: >> Each sample counts as 0.01 seconds. >> % cumulative self self total >> time seconds seconds calls s/call s/call name >> 38.55 127.10 127.10 130975 0.00 0.00 >> Curl_hash_clean_with_criterium >> 24.63 208.32 81.22 1247528407 0.00 0.00 >> hostcache_timestamp_remove >> 13.08 251.44 43.12 2791988 0.00 0.00 Curl_hash_pick >> 7.30 275.51 24.07 352490 0.00 0.00 Curl_hash_add >> 6.01 295.31 19.80 410760770 0.00 0.00 >> Curl_str_key_compare >> 2.95 305.04 9.73 131015 0.00 0.00 create_conn >> 0.88 307.94 2.90 4841390 0.00 0.00 dprintf_formatf >> 0.74 310.38 2.44 136036 0.00 0.00 ConnectionStore >> 0.48 311.96 1.58 814604911 0.00 0.00 ares__is_list_empty >> 0.36 313.16 1.20 locking_function >> 0.27 314.06 0.90 261608 0.00 0.00 ares_cancel >> 0.22 314.79 0.73 127417 0.00 0.00 >> curl_multi_remove_handle >> 0.19 315.40 0.62 8906301 0.00 0.00 >> client_tracing_function >> 0.17 315.97 0.57 135305 0.00 0.00 Curl_num_addresses >> 0.17 316.54 0.57 181937907 0.00 0.00 addbyter >> 0.17 317.09 0.55 2374363 0.00 0.00 multi_runsingle >> 0.16 317.62 0.53 541954 0.00 0.00 ares__init_list_node >> 0.16 318.14 0.52 494412 0.00 0.00 >> curl_multi_socket_action >> 0.14 318.60 0.46 33578897 0.00 0.00 Curl_socket_check >> 0.13 319.04 0.44 102951052 0.00 0.00 Curl_raw_toupper >> 0.13 319.48 0.44 787558 0.00 0.00 Curl_readwrite >> 0.13 319.91 0.44 id_function >> 0.12 320.29 0.38 391390 0.00 0.00 Curl_hash_str >> 0.09 320.58 0.29 9216 0.00 0.00 curl_multi_perform >> 0.08 320.86 0.28 2350908 0.00 0.00 Curl_raw_equal >> 0.08 321.14 0.28 2019415 0.00 0.00 Curl_splay >> 0.08 321.40 0.26 520625 0.00 0.00 ossl_connect_common >> 0.08 321.65 0.25 3532992 0.00 0.00 Curl_pgrsUpdate >> 0.07 321.87 0.22 131778537 0.00 0.00 curl_strequal >> 0.05 322.05 0.18 8954118 0.00 0.00 scan_response >> 0.05 322.23 0.18 533644 0.00 0.00 ares_expand_name >> 0.05 322.40 0.17 2477345 0.00 0.00 fd_key_compare >> 0.05 322.57 0.17 2429135 0.00 0.00 Curl_infof >> 0.05 322.74 0.17 130966 0.00 0.00 singleipconnect >> 0.05 322.90 0.16 9292 0.00 0.00 >> curl_multi_socket_all >> 0.05 323.06 0.16 270137 0.00 0.00 ares__get_hostent >> 0.05 323.21 0.15 8943657 0.00 0.00 Curl_debug >> 0.04 323.35 0.14 262493 0.00 0.00 >> Curl_ssl_getsessionid >> 0.04 323.48 0.13 566006 0.00 0.00 socket_callback >> 0.04 323.61 0.13 33983864 0.00 0.00 curlx_tvdiff >> 0.04 323.74 0.13 132853 0.00 0.00 >> Curl_http_readwrite_headers >> 0.04 323.86 0.12 344032 0.00 0.00 epoll_del >> 0.04 323.98 0.12 223477 0.00 0.00 Curl_poll >> 0.04 324.10 0.12 8526280 0.00 0.00 Curl_raw_nequal >> 0.03 324.21 0.11 348839 0.00 0.00 event_del >> >> >> >> >> test 2: >> >> dns server: dnsmasq@127.0.0.1, 2,000,000 dns entry cache, resolve *.com to >> one IP address >> number of domain names in all https URLs: 1 >> number of client: 1000 >> CPU usage: 75% >> SSL TPS: 1300 >> SSL throughput: 700Mbps >> >> # gprof /usr/bin/curl-loader gmon.out -p | head -50 >> Flat profile: >> Each sample counts as 0.01 seconds. >> % cumulative self self total >> time seconds seconds calls s/call s/call name >> 8.98 2.45 2.45 5127312 0.00 0.00 dprintf_formatf >> 8.90 4.88 2.43 1292796503 0.00 0.00 >> ares__is_list_empty >> 6.12 6.55 1.67 322461 0.00 0.00 create_conn >> 4.58 7.80 1.25 419872 0.00 0.00 ares_cancel >> 4.10 8.92 1.12 2100162 0.00 0.00 Curl_readwrite >> 3.92 9.99 1.07 4527388 0.00 0.00 Curl_hash_pick >> 3.43 10.93 0.94 locking_function >> 3.04 11.76 0.83 909759 0.00 0.00 >> curl_multi_socket_action >> 3.00 12.58 0.82 97252 0.00 0.00 >> Curl_hash_clean_with_criterium >> 2.71 13.32 0.74 179704016 0.00 0.00 Curl_raw_toupper >> 2.68 14.05 0.73 4646524 0.00 0.00 multi_runsingle >> 2.44 14.71 0.67 13862992 0.00 0.00 >> client_tracing_function >> 2.42 15.37 0.66 319735 0.00 0.00 >> curl_multi_remove_handle >> 2.42 16.03 0.66 22 0.03 0.03 ares__init_list_node >> 1.94 16.56 0.53 9930244 0.00 0.00 >> hostcache_timestamp_remove >> 1.94 17.09 0.53 169320088 0.00 0.00 addbyter >> 1.80 17.58 0.49 id_function >> 1.36 17.95 0.37 7057146 0.00 0.00 Curl_pgrsUpdate >> 1.36 18.32 0.37 16835 0.00 0.00 >> curl_multi_socket_all >> 1.25 18.66 0.34 16719 0.00 0.00 curl_multi_perform >> 1.21 18.99 0.33 329403 0.00 0.00 >> Curl_http_readwrite_headers >> 1.17 19.31 0.32 4036624 0.00 0.00 Curl_splay >> 1.14 19.62 0.31 20838902 0.00 0.00 Curl_raw_nequal >> 0.82 19.85 0.23 2764123 0.00 0.00 Curl_infof >> 0.81 20.07 0.22 5933857 0.00 0.00 ossl_recv >> 0.77 20.28 0.21 323112 0.00 0.00 >> Curl_splayremovebyaddr >> 0.75 20.48 0.21 5943991 0.00 0.00 Curl_read >> 0.70 20.67 0.19 425174 0.00 0.00 event_del >> 0.70 20.86 0.19 98652 0.00 0.00 >> Curl_if_is_interface_name >> 0.70 21.05 0.19 8677733 0.00 0.00 Curl_socket_check >> 0.59 21.21 0.16 4129554 0.00 0.00 fd_key_compare >> 0.57 21.37 0.16 14017019 0.00 0.00 Curl_debug >> 0.55 21.52 0.15 9376861 0.00 0.00 stat_data_in_add >> 0.55 21.67 0.15 6840468 0.00 0.00 Curl_timeleft >> 0.55 21.82 0.15 2054602 0.00 0.00 Curl_raw_equal >> 0.55 21.97 0.15 1291611 0.00 0.00 Curl_expire >> 0.51 22.11 0.14 16570063 0.00 0.00 curlx_tvnow >> 0.51 22.25 0.14 13863284 0.00 0.00 scan_response >> 0.51 22.39 0.14 5498864 0.00 0.00 Curl_setopt >> 0.48 22.52 0.13 97490291 0.00 0.00 curl_strequal >> 0.44 22.64 0.12 324253 0.00 0.00 Curl_http >> 0.44 22.76 0.12 394386 0.00 0.00 ossl_connect_common >> 0.40 22.87 0.11 3581335 0.00 0.00 Curl_getinfo >> 0.38 22.97 0.11 26983092 0.00 0.00 alloc_addbyter >> 0.37 23.07 0.10 8729044 0.00 0.00 Curl_client_write >> > > > ------------------------------------------------------------------------------ > Monitor your physical, virtual and cloud infrastructure from a single > web console. Get in-depth insight into apps, servers, databases, vmware, > SAP, cloud infrastructure, etc. Download 30-day Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > -- Regards, Robert Iakobashvili, Ph.D. Home: http://www.ghotit.com ......................................................... Ghotit Dyslexia -> Das Ist Real Writer ......................................................... |
|
From: Fred H. <di...@gm...> - 2012-11-24 15:00:18
|
hi all, is it possible to use adns (http://www.chiark.greenend.org.uk/~ian/adns/) to do dns resolving instead of libc-ares? all my test results shows that lib-cares can do no more than 300 queries per second. however, using 'dig +short -f hostnames.list &>/dev/null' against same dns server I can get more 7500 queries per second. I think libc-ares is also limited by the system API of gethostbyname. About ADNS lib: Many clients for DNS resolution are coded poorly.Most UNIX systems provide an implementation of gethostbyname (the DNS client API—application program interface), which cannot concurrently handle multiple outstanding requests. Therefore, the crawler cannot issue many resolution requests together and poll at a later time for completion of individual requests, which is critical for acceptable performance. Furthermore, if the system-provided client is used, there is no way to distribute load among a number of DNS servers. For all these reasons, many crawlers choose to include their own custom client for DNS name resolution. The Mercator crawler from Compaq System Research Center reduced the time spent in DNS from as high as 87% to a modest 25% by implementing a custom client. The ADNS asynchronous DNS client library is ideal for use in crawlers. In spite of these optimizations, a large-scale crawler will spend a substantial fraction of its network time not waiting for Http data transfer, but for address resolution. For every hostname that has not been resolved before (which happens frequently with crawlers), the local DNS may have to go across many network hops to fill its cache for the first time. To overlap this unavoidable delay with useful work, prefetching can be used. When a page that has just been fetched is parsed, a stream of HREFs is extracted. Right at this time, that is, even before any of the corresponding URLs are fetched, hostnames are extracted from the HREF targets, and DNS resolution requests are made to the caching server. The prefetching client is usually implemented using UDP instead of TCP, and it does not wait for resolution to be completed. The request serves only to fill the DNS cache so that resolution will be fast when the page is actually needed later on. ===end 2012/3/5 Fred Huang <di...@gm...> > test 1: > > dns server: dnsmasq@127.0.0.1, 2,000,000 dns entry cache, resolve *.com > to one IP address > number of domain names in all https URLs: 780,000 > number of client: 1000 > CPU usage: 78% > cpu% irq% sirq% sys% iowt% mem_used buf&cached > 78.8 0.0 0.6 3.8 0.0 3640.9Mb 282.1Mb > SSL TPS: 300 > SSL throughput: 200Mbps > > # gprof /usr/bin/curl-loader gmon.out -p | head -50 > Flat profile: > Each sample counts as 0.01 seconds. > % cumulative self self total > time seconds seconds calls s/call s/call name > * 38.55 127.10 127.10 130975 0.00 0.00 > Curl_hash_clean_with_criterium* > * 24.63 208.32 81.22 1247528407 0.00 0.00 > hostcache_timestamp_remove* > * 13.08 251.44 43.12 2791988 0.00 0.00 Curl_hash_pick* > 7.30 275.51 24.07 352490 0.00 0.00 Curl_hash_add > 6.01 295.31 19.80 410760770 0.00 0.00 Curl_str_key_compare > 2.95 305.04 9.73 131015 0.00 0.00 create_conn > 0.88 307.94 2.90 4841390 0.00 0.00 dprintf_formatf > 0.74 310.38 2.44 136036 0.00 0.00 ConnectionStore > 0.48 311.96 1.58 814604911 0.00 0.00 ares__is_list_empty > 0.36 313.16 1.20 locking_function > 0.27 314.06 0.90 261608 0.00 0.00 ares_cancel > 0.22 314.79 0.73 127417 0.00 0.00 > curl_multi_remove_handle > 0.19 315.40 0.62 8906301 0.00 0.00 > client_tracing_function > 0.17 315.97 0.57 135305 0.00 0.00 Curl_num_addresses > 0.17 316.54 0.57 181937907 0.00 0.00 addbyter > 0.17 317.09 0.55 2374363 0.00 0.00 multi_runsingle > 0.16 317.62 0.53 541954 0.00 0.00 ares__init_list_node > 0.16 318.14 0.52 494412 0.00 0.00 > curl_multi_socket_action > 0.14 318.60 0.46 33578897 0.00 0.00 Curl_socket_check > 0.13 319.04 0.44 102951052 0.00 0.00 Curl_raw_toupper > 0.13 319.48 0.44 787558 0.00 0.00 Curl_readwrite > 0.13 319.91 0.44 id_function > 0.12 320.29 0.38 391390 0.00 0.00 Curl_hash_str > 0.09 320.58 0.29 9216 0.00 0.00 curl_multi_perform > 0.08 320.86 0.28 2350908 0.00 0.00 Curl_raw_equal > 0.08 321.14 0.28 2019415 0.00 0.00 Curl_splay > 0.08 321.40 0.26 520625 0.00 0.00 ossl_connect_common > 0.08 321.65 0.25 3532992 0.00 0.00 Curl_pgrsUpdate > 0.07 321.87 0.22 131778537 0.00 0.00 curl_strequal > 0.05 322.05 0.18 8954118 0.00 0.00 scan_response > 0.05 322.23 0.18 533644 0.00 0.00 ares_expand_name > 0.05 322.40 0.17 2477345 0.00 0.00 fd_key_compare > 0.05 322.57 0.17 2429135 0.00 0.00 Curl_infof > 0.05 322.74 0.17 130966 0.00 0.00 singleipconnect > 0.05 322.90 0.16 9292 0.00 0.00 curl_multi_socket_all > 0.05 323.06 0.16 270137 0.00 0.00 ares__get_hostent > 0.05 323.21 0.15 8943657 0.00 0.00 Curl_debug > 0.04 323.35 0.14 262493 0.00 0.00 Curl_ssl_getsessionid > 0.04 323.48 0.13 566006 0.00 0.00 socket_callback > 0.04 323.61 0.13 33983864 0.00 0.00 curlx_tvdiff > 0.04 323.74 0.13 132853 0.00 0.00 > Curl_http_readwrite_headers > 0.04 323.86 0.12 344032 0.00 0.00 epoll_del > 0.04 323.98 0.12 223477 0.00 0.00 Curl_poll > 0.04 324.10 0.12 8526280 0.00 0.00 Curl_raw_nequal > 0.03 324.21 0.11 348839 0.00 0.00 event_del > > > > > test 2: > > dns server: dnsmasq@127.0.0.1, 2,000,000 dns entry cache, resolve *.com > to one IP address > number of domain names in all https URLs: 1 > number of client: 1000 > CPU usage: 75% > SSL TPS: 1300 > SSL throughput: 700Mbps > > # gprof /usr/bin/curl-loader gmon.out -p | head -50 > Flat profile: > Each sample counts as 0.01 seconds. > % cumulative self self total > time seconds seconds calls s/call s/call name > 8.98 2.45 2.45 5127312 0.00 0.00 dprintf_formatf > 8.90 4.88 2.43 1292796503 0.00 0.00 ares__is_list_empty > 6.12 6.55 1.67 322461 0.00 0.00 create_conn > 4.58 7.80 1.25 419872 0.00 0.00 ares_cancel > 4.10 8.92 1.12 2100162 0.00 0.00 Curl_readwrite > 3.92 9.99 1.07 4527388 0.00 0.00 Curl_hash_pick > 3.43 10.93 0.94 locking_function > 3.04 11.76 0.83 909759 0.00 0.00 > curl_multi_socket_action > 3.00 12.58 0.82 97252 0.00 0.00 > Curl_hash_clean_with_criterium > 2.71 13.32 0.74 179704016 0.00 0.00 Curl_raw_toupper > 2.68 14.05 0.73 4646524 0.00 0.00 multi_runsingle > 2.44 14.71 0.67 13862992 0.00 0.00 > client_tracing_function > 2.42 15.37 0.66 319735 0.00 0.00 > curl_multi_remove_handle > 2.42 16.03 0.66 22 0.03 0.03 ares__init_list_node > 1.94 16.56 0.53 9930244 0.00 0.00 > hostcache_timestamp_remove > 1.94 17.09 0.53 169320088 0.00 0.00 addbyter > 1.80 17.58 0.49 id_function > 1.36 17.95 0.37 7057146 0.00 0.00 Curl_pgrsUpdate > 1.36 18.32 0.37 16835 0.00 0.00 curl_multi_socket_all > 1.25 18.66 0.34 16719 0.00 0.00 curl_multi_perform > 1.21 18.99 0.33 329403 0.00 0.00 > Curl_http_readwrite_headers > 1.17 19.31 0.32 4036624 0.00 0.00 Curl_splay > 1.14 19.62 0.31 20838902 0.00 0.00 Curl_raw_nequal > 0.82 19.85 0.23 2764123 0.00 0.00 Curl_infof > 0.81 20.07 0.22 5933857 0.00 0.00 ossl_recv > 0.77 20.28 0.21 323112 0.00 0.00 > Curl_splayremovebyaddr > 0.75 20.48 0.21 5943991 0.00 0.00 Curl_read > 0.70 20.67 0.19 425174 0.00 0.00 event_del > 0.70 20.86 0.19 98652 0.00 0.00 > Curl_if_is_interface_name > 0.70 21.05 0.19 8677733 0.00 0.00 Curl_socket_check > 0.59 21.21 0.16 4129554 0.00 0.00 fd_key_compare > 0.57 21.37 0.16 14017019 0.00 0.00 Curl_debug > 0.55 21.52 0.15 9376861 0.00 0.00 stat_data_in_add > 0.55 21.67 0.15 6840468 0.00 0.00 Curl_timeleft > 0.55 21.82 0.15 2054602 0.00 0.00 Curl_raw_equal > 0.55 21.97 0.15 1291611 0.00 0.00 Curl_expire > 0.51 22.11 0.14 16570063 0.00 0.00 curlx_tvnow > 0.51 22.25 0.14 13863284 0.00 0.00 scan_response > 0.51 22.39 0.14 5498864 0.00 0.00 Curl_setopt > 0.48 22.52 0.13 97490291 0.00 0.00 curl_strequal > 0.44 22.64 0.12 324253 0.00 0.00 Curl_http > 0.44 22.76 0.12 394386 0.00 0.00 ossl_connect_common > 0.40 22.87 0.11 3581335 0.00 0.00 Curl_getinfo > 0.38 22.97 0.11 26983092 0.00 0.00 alloc_addbyter > 0.37 23.07 0.10 8729044 0.00 0.00 Curl_client_write > > |
|
From: Val S. <va...@nv...> - 2012-11-12 19:54:29
|
Some of us are missing on this exchange. I think it would help if all messages in this forum were sent in English. > >From: Robert Iakobashvili <cor...@gm...> >To: curl-loader-devel <cur...@li...> >Sent: Mon, November 12, 2012 10:06:16 AM >Subject: Re: to Robert Iakobashvili > >I've been asked questions today, not involved in decisions. > >Sorry. > > >2012/11/12 yaakov david <y.d...@gm...> > >בתור אדם ישר הייתי מצפה שתתקן או שלא תשלח את ההודעה הזו, שהרי ידעת שלא תהיה לי >הזדמנות כזו עוד 1.5 חודשים. >> >> >>בתאריך 8 בנובמבר 2012 21:28, מאת Robert Iakobashvili <cor...@gm...>: >> >> >>Hi David, >>>Learn C with Yossi successfully. >>> >>>You will have a chance in 1.5 months. >>> >>>Best wishes, >>>Robert >>> >>>2012/11/8 yaakov david <y.d...@gm...>: >>>> >>>>> רוברט שלום, >>>>> אני מבקש להיבחן שוב את המבחן של אתמול. >>>>> נראה לי כי נוצר רושם שגוי כאילו אינני משקיע, ולא כך הוא. >>>>> אני מאמין כי הפעם אעבור את הבחינה באופן מושלם. >>>>> אודה לך אם תסכים לבחון אותי שוב בנושא. >>>>> יעקב דוד >>>>> >>>> >>>> >>------------------------------------------------------------------------------ >>>> Everyone hates slow websites. So do we. >>>> Make your web apps faster with AppDynamics >>>> Download AppDynamics Lite for free today: >>>> http://p.sf.net/sfu/appdyn_d2d_nov >>>> _______________________________________________ >>>> curl-loader-devel mailing list >>>> cur...@li... >>>> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >>>> >>> >>> >>> >>>-- >>>Regards, >>>Robert Iakobashvili, Ph.D. >>> >>>Home: http://www.ghotit.com >>>Blog: http://www.ghotit.com/category/ghotit-blogs/ >>>Twitter: http://twitter.com/ghotit >>>Facebook: http://facebook.com/ghotit >>>...................................................................... >>> Ghotit Dyslexia >>>Assistive technology that understands you >>>...................................................................... >>>------------------------------------------------------------------------------ >>>Everyone hates slow websites. So do we. >>>Make your web apps faster with AppDynamics >>>Download AppDynamics Lite for free today: >>>http://p.sf.net/sfu/appdyn_d2d_nov >>>_______________________________________________ >>>curl-loader-devel mailing list >>>cur...@li... >>>https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >>> >> >>------------------------------------------------------------------------------ >>Everyone hates slow websites. So do we. >>Make your web apps faster with AppDynamics >>Download AppDynamics Lite for free today: >>http://p.sf.net/sfu/appdyn_d2d_nov >>_______________________________________________ >>curl-loader-devel mailing list >>cur...@li... >>https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >> > > >-- >Regards, >Robert Iakobashvili, Ph.D. > > > >Home: http://www.ghotit.com >Blog: http://www.ghotit.com/category/ghotit-blogs/Twitter: > http://twitter.com/ghotit >Facebook: http://facebook.com/ghotit >...................................................................... > Ghotit Dyslexia >Assistive technology that understands you >...................................................................... > |
|
From: Robert I. <cor...@gm...> - 2012-11-12 18:06:10
|
I've been asked questions today, not involved in decisions. Sorry. 2012/11/12 yaakov david <y.d...@gm...> > בתור אדם ישר הייתי מצפה שתתקן או שלא תשלח את ההודעה הזו, שהרי ידעת שלא > תהיה לי הזדמנות כזו עוד 1.5 חודשים. > > בתאריך 8 בנובמבר 2012 21:28, מאת Robert Iakobashvili <cor...@gm...> > : > > Hi David, >> Learn C with Yossi successfully. >> >> You will have a chance in 1.5 months. >> >> Best wishes, >> Robert >> >> 2012/11/8 yaakov david <y.d...@gm...>: >> > >> >> רוברט שלום, >> >> אני מבקש להיבחן שוב את המבחן של אתמול. >> >> נראה לי כי נוצר רושם שגוי כאילו אינני משקיע, ולא כך הוא. >> >> אני מאמין כי הפעם אעבור את הבחינה באופן מושלם. >> >> אודה לך אם תסכים לבחון אותי שוב בנושא. >> >> יעקב דוד >> >> >> > >> > >> ------------------------------------------------------------------------------ >> > Everyone hates slow websites. So do we. >> > Make your web apps faster with AppDynamics >> > Download AppDynamics Lite for free today: >> > http://p.sf.net/sfu/appdyn_d2d_nov >> > _______________________________________________ >> > curl-loader-devel mailing list >> > cur...@li... >> > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> > >> >> >> >> -- >> Regards, >> Robert Iakobashvili, Ph.D. >> >> Home: http://www.ghotit.com >> Blog: http://www.ghotit.com/category/ghotit-blogs/ >> Twitter: http://twitter.com/ghotit >> Facebook: http://facebook.com/ghotit >> ...................................................................... >> Ghotit Dyslexia >> Assistive technology that understands you >> ...................................................................... >> >> ------------------------------------------------------------------------------ >> Everyone hates slow websites. So do we. >> Make your web apps faster with AppDynamics >> Download AppDynamics Lite for free today: >> http://p.sf.net/sfu/appdyn_d2d_nov >> _______________________________________________ >> curl-loader-devel mailing list >> cur...@li... >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> > > > > ------------------------------------------------------------------------------ > Everyone hates slow websites. So do we. > Make your web apps faster with AppDynamics > Download AppDynamics Lite for free today: > http://p.sf.net/sfu/appdyn_d2d_nov > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > -- Regards, Robert Iakobashvili, Ph.D. Home: http://www.ghotit.com Blog: http://www.ghotit.com/category/ghotit-blogs/ Twitter: http://twitter.com/ghotit Facebook: http://facebook.com/ghotit ...................................................................... Ghotit Dyslexia Assistive technology that understands you ...................................................................... |
|
From: yaakov d. <y.d...@gm...> - 2012-11-12 17:59:36
|
בתור אדם ישר הייתי מצפה שתתקן או שלא תשלח את ההודעה הזו, שהרי ידעת שלא תהיה לי הזדמנות כזו עוד 1.5 חודשים. בתאריך 8 בנובמבר 2012 21:28, מאת Robert Iakobashvili <cor...@gm...>: > Hi David, > Learn C with Yossi successfully. > > You will have a chance in 1.5 months. > > Best wishes, > Robert > > 2012/11/8 yaakov david <y.d...@gm...>: > > > >> רוברט שלום, > >> אני מבקש להיבחן שוב את המבחן של אתמול. > >> נראה לי כי נוצר רושם שגוי כאילו אינני משקיע, ולא כך הוא. > >> אני מאמין כי הפעם אעבור את הבחינה באופן מושלם. > >> אודה לך אם תסכים לבחון אותי שוב בנושא. > >> יעקב דוד > >> > > > > > ------------------------------------------------------------------------------ > > Everyone hates slow websites. So do we. > > Make your web apps faster with AppDynamics > > Download AppDynamics Lite for free today: > > http://p.sf.net/sfu/appdyn_d2d_nov > > _______________________________________________ > > curl-loader-devel mailing list > > cur...@li... > > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > > > > > -- > Regards, > Robert Iakobashvili, Ph.D. > > Home: http://www.ghotit.com > Blog: http://www.ghotit.com/category/ghotit-blogs/ > Twitter: http://twitter.com/ghotit > Facebook: http://facebook.com/ghotit > ...................................................................... > Ghotit Dyslexia > Assistive technology that understands you > ...................................................................... > > ------------------------------------------------------------------------------ > Everyone hates slow websites. So do we. > Make your web apps faster with AppDynamics > Download AppDynamics Lite for free today: > http://p.sf.net/sfu/appdyn_d2d_nov > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > |
|
From: Robert I. <cor...@gm...> - 2012-11-08 19:28:15
|
Hi David, Learn C with Yossi successfully. You will have a chance in 1.5 months. Best wishes, Robert 2012/11/8 yaakov david <y.d...@gm...>: > >> רוברט שלום, >> אני מבקש להיבחן שוב את המבחן של אתמול. >> נראה לי כי נוצר רושם שגוי כאילו אינני משקיע, ולא כך הוא. >> אני מאמין כי הפעם אעבור את הבחינה באופן מושלם. >> אודה לך אם תסכים לבחון אותי שוב בנושא. >> יעקב דוד >> > > ------------------------------------------------------------------------------ > Everyone hates slow websites. So do we. > Make your web apps faster with AppDynamics > Download AppDynamics Lite for free today: > http://p.sf.net/sfu/appdyn_d2d_nov > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > -- Regards, Robert Iakobashvili, Ph.D. Home: http://www.ghotit.com Blog: http://www.ghotit.com/category/ghotit-blogs/ Twitter: http://twitter.com/ghotit Facebook: http://facebook.com/ghotit ...................................................................... Ghotit Dyslexia Assistive technology that understands you ...................................................................... |
|
From: yaakov d. <y.d...@gm...> - 2012-11-08 18:50:55
|
> רוברט שלום, > אני מבקש להיבחן שוב את המבחן של אתמול. > נראה לי כי נוצר רושם שגוי כאילו אינני משקיע, ולא כך הוא. > אני מאמין כי הפעם אעבור את הבחינה באופן מושלם. > אודה לך אם תסכים לבחון אותי שוב בנושא. > יעקב דוד > > |
|
From: Adrien U. <adr...@nb...> - 2012-08-30 17:02:06
|
Hello, I'm trying to generate alot of connections from different a single client to a single server (using multiple source IP). Unfortunatly, I get on a limit about ephemeral ports not being available if already used by an other IP. log shows: ERR bind failed with errno 98: Address already in use Is there a way to get curl-loader to have more connections than our ephemeral ports (aka, use the same port multiple times, with different IPs) ? Btw, I also removed the adding-IP as alias, as on Linux adding an IP like 10.128.0.0/14 to the interface lo, is enough to have all the ip available directly, (just need to route them back from the server). Regards, Adrien |
|
From: Robert I. <cor...@gm...> - 2012-08-28 03:39:38
|
Dear Wei Guo, Yes, your considerations are correct. You can increased descriptor limits and others as explained here: http://curl-loader.sourceforge.net/doc/faq.html#big-load Still, you will come to some openssl related limitations. You can try to build libcurl against some other TLS/SSL library (curl site explains how to do that) and to patch curl-loader's Makefile and some places in loader.c Kind regards, Robert On Tue, Aug 28, 2012 at 5:25 AM, wei guo <wei...@gm...> wrote: > hi, Robert: > May be my problem is another issue, I use FRESH_CONNECT in my test plan(for > I have to simulate huge of person login in a short peroid of time). when > CLIENT_NUM reach to 300, the cpu consumption in client end exhuasted very > much(client cpu 8*Intel(R) Xeon(R) CPU E31230 @ 3.20GHz), client idle below > to 30%, I change the https to http, Still the total QPS to server only 1100, > AND the server has litter pressure. > > I also found there many TIME_WAIT socket state in my nginx server, It reach > 68546(Ii use multi machine as client), does this have any affect? > > my question is FRESH_CONNECT operation is an very cpu-comsumption operation? > Do you have any suggestion? > > > > On Mon, Aug 27, 2012 at 12:09 PM, Robert Iakobashvili <cor...@gm...> > wrote: >> >> Hi wei guo, >> >> It's a libcurl issue when built with openssl. >> >> More throughput could be delivered, probably, if to build libcurl >> against some another TLS/SSL library. >> >> You can try it. >> >> Regards, >> Robert Iakobashvili, Ph.D. >> >> Home: http://www.ghotit.com >> Blog: http://www.ghotit.com/category/ghotit-blogs/ >> Twitter: http://twitter.com/ghotit >> Facebook: http://facebook.com/ghotit >> ...................................................................... >> Ghotit Dyslexia >> Assistive technology that understands you >> ...................................................................... >> >> >> On Mon, Aug 27, 2012 at 5:38 AM, wei guo <wei...@gm...> wrote: >> > hi,all: >> > do you have any conclusion for this issue？ I ran into the same problem, >> > I'll >> > look for answers for this. >> > >> > On Wed, Oct 12, 2011 at 4:51 PM, Robert Iakobashvili >> > <cor...@gm...> >> > wrote: >> >> >> >> Hi CK Zhang, >> >> >> >> Now it clear what happens. >> >> >> >> curl-loader: >> >> - establishes TCP connections; >> >> - makes expensive TLS/SSL handshake >> >> - fetches the file. >> >> >> >> After fetching file, curl-loader closes the TCP-connection. >> >> >> >> Next cycle it establishes the TCP-connection and makes the expensive >> >> TLS/SSL handshake again, >> >> and fetches the file. >> >> >> >> To achieve high throughput libcurl needs to be configured to re-use >> >> the established >> >> TCP connection and TLS/SSL for the next file transfer and not to >> >> re-establish it every cycle. >> >> >> >> I suggest you to look in curl (libcurl) options and I will also be >> >> doing >> >> that. >> >> >> >> Thanks for your reporting. >> >> >> >> On Wed, Oct 12, 2011 at 2:59 AM, CK Zhang <ck...@fo...> wrote: >> >> > >> >> > Attached logs, and output from console >> >> > >> >> > ============ loading batch is: Apach >> >> > ====================================== >> >> > >> >> > >> >> > ---------------------------------------------------------------------------- >> >> > ---- >> >> > Interval stats (latest:3 sec, clients:100, CAPS-curr:60): >> >> > H/F >> >> > >> >> > >> >> > Req:0,1xx:0,2xx:0,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:0ms,D-2xx:0ms,Ti:0B/s,To >> >> > :0B/s >> >> > H/F/S >> >> > >> >> > >> >> > Req:200,1xx:0,2xx:201,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:553ms,D-2xx:553ms,Ti >> >> > :6854220B/s,To:18800B/s >> >> > >> >> > >> >> > ---------------------------------------------------------------------------- >> >> > ---- >> >> > Summary stats (runs:48 secs, CAPS-average:60): >> >> > H/F >> >> > >> >> > >> >> > Req:0,1xx:0,2xx:0,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:0ms,D-2xx:0ms,Ti:0B/s,To >> >> > :0B/s >> >> > H/F/S >> >> > >> >> > >> >> > Req:2878,1xx:0,2xx:2873,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:614ms,D-2xx:614ms, >> >> > Ti:6087722B/s,To:17182B/s >> >> > >> >> > >> >> > ============================================================================ >> >> > ===== >> >> > Manual: clients:max[100],curr[100]. Inc num: [+|*]. >> >> > >> >> > >> >> > ============================================================================ >> >> > ===== >> >> > >> >> > Best Regards, >> >> > CK >> >> > #8042 >> >> > >> >> > >> >> > -----Original Message----- >> >> > From: Robert Iakobashvili [mailto:cor...@gm...] >> >> > Sent: Tuesday, October 11, 2011 5:49 PM >> >> > To: curl-loader-devel >> >> > Subject: Re: HTTPS throughput too low >> >> > >> >> > Please, try >> >> > >> >> > CLIENTS_NUM_MAX=100 >> >> > CLIENTS_NUM_START=100 >> >> > >> >> > and comment out >> >> > #CLIENTS_RAMPUP_INC=10 >> >> > >> >> > Say, what happens with traffic and send me the log. >> >> > >> >> > On Tue, Oct 11, 2011 at 11:36 AM, CK Zhang <ck...@fo...> >> >> > wrote: >> >> >> Attached :) thanks! >> >> >> >> >> >> Best Regards, >> >> >> CK >> >> >> #8042 >> >> >> >> >> >> >> >> >> -----Original Message----- >> >> >> From: Robert Iakobashvili [mailto:cor...@gm...] >> >> >> Sent: Tuesday, October 11, 2011 5:33 PM >> >> >> To: curl-loader-devel >> >> >> Subject: Re: HTTPS throughput too low >> >> >> >> >> >> Could you send me it zipped not rarred? >> >> >> Thanks! >> >> >> >> >> >> On Tue, Oct 11, 2011 at 11:30 AM, CK Zhang <ck...@fo...> >> >> >> wrote: >> >> >>> Dear Robert >> >> >>> >> >> >>> Attached test log by command "./curl-loader -f https.conf -v" >> >> >>> >> >> >>> Best Regards, >> >> >>> CK >> >> >>> #8042 >> >> >>> >> >> >>> -----Original Message----- >> >> >>> From: Robert Iakobashvili [mailto:cor...@gm...] >> >> >>> Sent: Tuesday, October 11, 2011 5:19 PM >> >> >>> To: curl-loader-devel >> >> >>> Subject: Re: HTTPS throughput too low >> >> >>> >> >> >>> Dear CK Zhang, >> >> >>> >> >> >>> Can you run HTTPS sessions with -v detailed logging and say if >> >> >>> you seen in logs something interesting. >> >> >>> Thanks, >> >> >>> Robert >> >> >>> >> >> >>> >> >> >>> >> >> >>> On Tue, Oct 11, 2011 at 11:14 AM, CK Zhang <ck...@fo...> >> >> >>> wrote: >> >> >>>> Dear Robert >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> Thanks a lot for your replay, >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> Here are some answer about your questions >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> What happens if you try HTTP? Does it impact throughput? >> >> >>>> >> >> >>>> It is normal and perfect if I test with HTTP, The throughput can >> >> >>>> reach >> >> >> to >> >> >>>> 950Mbps. >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> Which tools you are using to measure throughput? >> >> >>>> >> >> >>>> There are 2 ways I used, >> >> >>>> >> >> >>>> 1 check the log summary form cur-loader like this” >> >> >>>> Ti:5261372B/s,To:18375B/s” >> >> >>>> >> >> >>>> 2 check real time traffic speed on switch with connected test PC >> >> >>>> and >> >> > HTTP >> >> >>>> server >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> What happens, if you try just to ftp some large file between the >> >> >> machines? >> >> >>>> >> >> >>>> NO test >> >> >>>> >> >> >>>> What about CPU usage at both client and server? >> >> >>>> >> >> >>>> Both they are busy, about 80% >> >> >>>> >> >> >>>> Which HTTP server is in use? >> >> >>>> >> >> >>>> Apache/2.2.21 >> >> >>>> >> >> >>>> Have you looked into logs of curl-loader and your web-server? >> >> >>>> >> >> >>>> Checked log, not find abnormal issue. >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> Today, I used Loadrunner11 to simulate https traffic with same >> >> >>> environments >> >> >>>> (same apache server) , it can reach to 110Mpbs. But still only get >> >> >>> 800kbps >> >> >>>> with cur-loader. >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> Best Regards, >> >> >>>> >> >> >>>> CK >> >> >>>> >> >> >>>> #8042 >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> From: Robert Iakobashvili [mailto:cor...@gm...] >> >> >>>> Sent: Tuesday, September 27, 2011 1:19 PM >> >> >>>> To: curl-loader-devel >> >> >>>> Subject: Re: HTTPS throughput too low >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> Dear CK Zhang, >> >> >>>> >> >> >>>> On Mon, Sep 26, 2011 at 5:01 AM, CK Zhang <ck...@fo...> >> >> >>>> wrote: >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> I want to get high https stream with curl loader, but the Https >> >> >> throughput >> >> >>>> is about 800kbps between two PC, Http throughput can reach 950Mbps >> >> >>>> in >> >> >> that >> >> >>> 2 >> >> >>>> pcs, I do know if some have experience like this, and get a high >> >> >>>> https >> >> >>>> throughput with curl-loader, Thanks for any supports and help!! >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> Here is my configuration: >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> PC1:CPU Inter E2200, Mem 2G, 1000M NIC >> >> >>>> >> >> >>>> OpenSSL: >> >> >>>> >> >> >>>> openssl-devel-1.0.0-4.el6_0.2.x86_64 >> >> >>>> >> >> >>>> openssl-1.0.0-4.el6_0.2.x86_64 >> >> >>>> >> >> >>>> openssl-perl-1.0.0-4.el6_0.2.x86_64 >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> curl-loader-0.53 >> >> >>>> >> >> >>>> ########### GENERAL SECTION >> >> >>>> ################################ >> >> >>>> >> >> >>>> BATCH_NAME= Apach >> >> >>>> >> >> >>>> CLIENTS_NUM_MAX=400 >> >> >>>> >> >> >>>> CLIENTS_NUM_START=100 >> >> >>>> >> >> >>>> CLIENTS_RAMPUP_INC=10 >> >> >>>> >> >> >>>> INTERFACE =eth2 >> >> >>>> >> >> >>>> NETMASK=16 >> >> >>>> >> >> >>>> IP_ADDR_MIN= 172.16.76.150 >> >> >>>> >> >> >>>> IP_ADDR_MAX= 172.16.246.250 #Actually - this is for self-control >> >> >>>> >> >> >>>> CYCLES_NUM= -1 >> >> >>>> >> >> >>>> URLS_NUM= 1 >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> ########### URL SECTION #################################### >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> URL=https://172.16.76.142/was/100KB.txt # the size of 100KB.txt is >> >> >>>> 100KB >> >> >>>> >> >> >>>> #URL=http://localhost/ACE-INSTALL.html >> >> >>>> >> >> >>>> URL_SHORT_NAME="local-index" >> >> >>>> >> >> >>>> REQUEST_TYPE=GET >> >> >>>> >> >> >>>> TIMER_URL_COMPLETION = 0 # In msec. When positive, Now it is >> >> >> enforced >> >> >>>> by cancelling url fetch on timeout >> >> >>>> >> >> >>>> TIMER_AFTER_URL_SLEEP =1000 >> >> >>>> >> >> >>>> ~ >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> PC2. Works as Webserver,CPU Intel E7600,Mem 4G, 1000M NIC >> >> >>>> >> >> >>>> Server version: Apache/2.2.21 (Unix) >> >> >>>> >> >> >>>> Server built: Sep 21 2011 16:19:43 >> >> >>>> >> >> >>>> openssl-devel-1.0.0-4.el6_0.2.x86_64 >> >> >>>> >> >> >>>> openssl-1.0.0-4.el6_0.2.x86_64 >> >> >>>> >> >> >>>> openssl-perl-1.0.0-4.el6_0.2.x86_64 >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> Interesting. >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> What happens if you try HTTP? Does it impact throughput? >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> Which tools you are using to measure throughput? >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> What happens, if you try just to ftp some large file between the >> >> >> machines? >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> What about CPU usage at both client and server? >> >> >>>> >> >> >>>> Which HTTP server is in use? >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> Have you looked into logs of curl-loader and your web-server? >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> -- >> >> >>>> Regards, >> >> >>>> Robert Iakobashvili, Ph.D. >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> Home: http://www.ghotit.com >> >> >>>> >> >> >>>> Blog: http://dyslexia-blog.ghotit.com >> >> >>>> >> >> >>>> Twitter: http://twitter.com/ghotit >> >> >>>> >> >> >>>> Facebook: http://facebook.com/ghotit >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> ...................................................................... >> >> >>>> >> >> >>>> Ghotit Dyslexia >> >> >>>> >> >> >>>> Assistive technology that understands you >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> ...................................................................... >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> ________________________________ >> >> >>>> >> >> >>>> *** Please note that this message and any attachments may contain >> >> >>>> confidential >> >> >>>> and proprietary material and information and are intended only for >> >> >>>> the >> >> >> use >> >> >>>> of >> >> >>>> the intended recipient(s). If you are not the intended recipient, >> >> >>>> you >> >> > are >> >> >>>> hereby >> >> >>>> notified that any review, use, disclosure, dissemination, >> >> >>>> distribution >> >> > or >> >> >>>> copying >> >> >>>> of this message and any attachments is strictly prohibited. If you >> >> >>>> have >> >> >>>> received >> >> >>>> this email in error, please immediately notify the sender and >> >> >>>> destroy >> >> >> this >> >> >>>> e-mail >> >> >>>> and any attachments and all copies, whether electronic or printed. >> >> >>>> Please also note that any views, opinions, conclusions or >> >> >>>> commitments >> >> >>>> expressed >> >> >>>> in this message are those of the individual sender and do not >> >> > necessarily >> >> >>>> reflect >> >> >>>> the views of Fortinet, Inc., its affiliates, and emails are not >> >> >>>> binding >> >> >> on >> >> >>>> Fortinet and only a writing manually signed by Fortinet's General >> >> > Counsel >> >> >>>> can be >> >> >>>> a binding commitment of Fortinet to Fortinet's customers or >> >> >>>> partners. >> >> >>> Thank >> >> >>>> you. *** >> >> >>>> >> >> >>>> ________________________________ >> >> >>>> >> >> >>>> >> >> >>> >> >> >> >> >> > >> >> > >> >> > ---------------------------------------------------------------------------- >> >> >>> -- >> >> >>>> All the data continuously generated in your IT infrastructure >> >> >>>> contains a >> >> >>>> definitive record of customers, application performance, security >> >> >>>> threats, fraudulent activity and more. Splunk takes this data and >> >> >>>> makes >> >> >>>> sense of it. Business sense. IT sense. Common sense. >> >> >>>> http://p.sf.net/sfu/splunk-d2d-oct >> >> >>>> _______________________________________________ >> >> >>>> curl-loader-devel mailing list >> >> >>>> cur...@li... >> >> >>>> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >> >>>> >> >> >>>> >> >> >>> >> >> >>> >> >> >>> >> >> >>> -- >> >> >>> Regards, >> >> >>> Robert Iakobashvili, Ph.D. >> >> >>> >> >> >>> Home: http://www.ghotit.com >> >> >>> Blog: http://dyslexia-blog.ghotit.com >> >> >>> Twitter: http://twitter.com/ghotit >> >> >>> Facebook: http://facebook.com/ghotit >> >> >>> >> >> >>> ...................................................................... >> >> >>> Ghotit Dyslexia >> >> >>> Assistive technology that understands you >> >> >>> >> >> >>> ...................................................................... >> >> >>> >> >> >>> >> >> >> >> >> > >> >> > >> >> > ---------------------------------------------------------------------------- >> >> >>> -- >> >> >>> All the data continuously generated in your IT infrastructure >> >> >>> contains >> >> >>> a >> >> >>> definitive record of customers, application performance, security >> >> >>> threats, fraudulent activity and more. Splunk takes this data and >> >> >>> makes >> >> >>> sense of it. Business sense. IT sense. Common sense. >> >> >>> http://p.sf.net/sfu/splunk-d2d-oct >> >> >>> _______________________________________________ >> >> >>> curl-loader-devel mailing list >> >> >>> cur...@li... >> >> >>> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >> >>> >> >> >>> >> >> >>> *** Please note that this message and any attachments may contain >> >> >> confidential >> >> >>> and proprietary material and information and are intended only for >> >> >>> the >> >> > use >> >> >> of >> >> >>> the intended recipient(s). If you are not the intended recipient, >> >> >>> you >> >> >>> are >> >> >> hereby >> >> >>> notified that any review, use, disclosure, dissemination, >> >> >>> distribution >> >> >>> or >> >> >> copying >> >> >>> of this message and any attachments is strictly prohibited. If you >> >> >>> have >> >> >> received >> >> >>> this email in error, please immediately notify the sender and >> >> >>> destroy >> >> > this >> >> >> e-mail >> >> >>> and any attachments and all copies, whether electronic or printed. >> >> >>> Please also note that any views, opinions, conclusions or >> >> >>> commitments >> >> >> expressed >> >> >>> in this message are those of the individual sender and do not >> >> >>> necessarily >> >> >> reflect >> >> >>> the views of Fortinet, Inc., its affiliates, and emails are not >> >> >>> binding >> >> > on >> >> >>> Fortinet and only a writing manually signed by Fortinet's General >> >> >>> Counsel >> >> >> can be >> >> >>> a binding commitment of Fortinet to Fortinet's customers or >> >> >>> partners. >> >> >> Thank you. *** >> >> >>> >> >> >>> >> >> >> >> >> > >> >> > >> >> > ---------------------------------------------------------------------------- >> >> >> -- >> >> >>> All the data continuously generated in your IT infrastructure >> >> >>> contains >> >> >>> a >> >> >>> definitive record of customers, application performance, security >> >> >>> threats, fraudulent activity and more. Splunk takes this data and >> >> >>> makes >> >> >>> sense of it. Business sense. IT sense. Common sense. >> >> >>> http://p.sf.net/sfu/splunk-d2d-oct >> >> >>> _______________________________________________ >> >> >>> curl-loader-devel mailing list >> >> >>> cur...@li... >> >> >>> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >> >>> >> >> >>> >> >> >> >> >> >> >> >> >> >> >> >> -- >> >> >> Regards, >> >> >> Robert Iakobashvili, Ph.D. >> >> >> >> >> >> Home: http://www.ghotit.com >> >> >> Blog: http://dyslexia-blog.ghotit.com >> >> >> Twitter: http://twitter.com/ghotit >> >> >> Facebook: http://facebook.com/ghotit >> >> >> >> >> >> ...................................................................... >> >> >> Ghotit Dyslexia >> >> >> Assistive technology that understands you >> >> >> >> >> >> ...................................................................... >> >> >> >> >> >> >> >> > >> >> > >> >> > ---------------------------------------------------------------------------- >> >> >> -- >> >> >> All the data continuously generated in your IT infrastructure >> >> >> contains >> >> >> a >> >> >> definitive record of customers, application performance, security >> >> >> threats, fraudulent activity and more. Splunk takes this data and >> >> >> makes >> >> >> sense of it. Business sense. IT sense. Common sense. >> >> >> http://p.sf.net/sfu/splunk-d2d-oct >> >> >> _______________________________________________ >> >> >> curl-loader-devel mailing list >> >> >> cur...@li... >> >> >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >> >> >> >> >> >> >> >> *** Please note that this message and any attachments may contain >> >> > confidential >> >> >> and proprietary material and information and are intended only for >> >> >> the >> >> >> use >> >> > of >> >> >> the intended recipient(s). If you are not the intended recipient, >> >> >> you >> >> >> are >> >> > hereby >> >> >> notified that any review, use, disclosure, dissemination, >> >> >> distribution >> >> >> or >> >> > copying >> >> >> of this message and any attachments is strictly prohibited. If you >> >> >> have >> >> > received >> >> >> this email in error, please immediately notify the sender and >> >> >> destroy >> >> >> this >> >> > e-mail >> >> >> and any attachments and all copies, whether electronic or printed. >> >> >> Please also note that any views, opinions, conclusions or >> >> >> commitments >> >> > expressed >> >> >> in this message are those of the individual sender and do not >> >> >> necessarily >> >> > reflect >> >> >> the views of Fortinet, Inc., its affiliates, and emails are not >> >> >> binding >> >> >> on >> >> >> Fortinet and only a writing manually signed by Fortinet's General >> >> >> Counsel >> >> > can be >> >> >> a binding commitment of Fortinet to Fortinet's customers or >> >> >> partners. >> >> > Thank you. *** >> >> >> >> >> >> >> >> > >> >> > >> >> > ---------------------------------------------------------------------------- >> >> > -- >> >> >> All the data continuously generated in your IT infrastructure >> >> >> contains >> >> >> a >> >> >> definitive record of customers, application performance, security >> >> >> threats, fraudulent activity and more. Splunk takes this data and >> >> >> makes >> >> >> sense of it. Business sense. IT sense. Common sense. >> >> >> http://p.sf.net/sfu/splunk-d2d-oct >> >> >> _______________________________________________ >> >> >> curl-loader-devel mailing list >> >> >> cur...@li... >> >> >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >> >> >> >> >> >> >> > >> >> > >> >> > >> >> > -- >> >> > Regards, >> >> > Robert Iakobashvili, Ph.D. >> >> > >> >> > Home: http://www.ghotit.com >> >> > Blog: http://dyslexia-blog.ghotit.com >> >> > Twitter: http://twitter.com/ghotit >> >> > Facebook: http://facebook.com/ghotit >> >> > >> >> > ...................................................................... >> >> > Ghotit Dyslexia >> >> > Assistive technology that understands you >> >> > >> >> > ...................................................................... >> >> > >> >> > >> >> > >> >> > ---------------------------------------------------------------------------- >> >> > -- >> >> > All the data continuously generated in your IT infrastructure >> >> > contains a >> >> > definitive record of customers, application performance, security >> >> > threats, fraudulent activity and more. Splunk takes this data and >> >> > makes >> >> > sense of it. Business sense. IT sense. Common sense. >> >> > http://p.sf.net/sfu/splunk-d2d-oct >> >> > _______________________________________________ >> >> > curl-loader-devel mailing list >> >> > cur...@li... >> >> > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >> > >> >> > >> >> > *** Please note that this message and any attachments may contain >> >> > confidential >> >> > and proprietary material and information and are intended only for >> >> > the >> >> > use of >> >> > the intended recipient(s). If you are not the intended recipient, you >> >> > are hereby >> >> > notified that any review, use, disclosure, dissemination, >> >> > distribution >> >> > or copying >> >> > of this message and any attachments is strictly prohibited. If you >> >> > have >> >> > received >> >> > this email in error, please immediately notify the sender and destroy >> >> > this e-mail >> >> > and any attachments and all copies, whether electronic or printed. >> >> > Please also note that any views, opinions, conclusions or commitments >> >> > expressed >> >> > in this message are those of the individual sender and do not >> >> > necessarily reflect >> >> > the views of Fortinet, Inc., its affiliates, and emails are not >> >> > binding >> >> > on >> >> > Fortinet and only a writing manually signed by Fortinet's General >> >> > Counsel can be >> >> > a binding commitment of Fortinet to Fortinet's customers or partners. >> >> > Thank you. *** >> >> > >> >> > >> >> > >> >> > ------------------------------------------------------------------------------ >> >> > All the data continuously generated in your IT infrastructure >> >> > contains a >> >> > definitive record of customers, application performance, security >> >> > threats, fraudulent activity and more. Splunk takes this data and >> >> > makes >> >> > sense of it. Business sense. IT sense. Common sense. >> >> > http://p.sf.net/sfu/splunk-d2d-oct >> >> > _______________________________________________ >> >> > curl-loader-devel mailing list >> >> > cur...@li... >> >> > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >> > >> >> > >> >> >> >> >> >> >> >> -- >> >> Regards, >> >> Robert Iakobashvili, Ph.D. >> >> >> >> Home: http://www.ghotit.com >> >> Blog: http://dyslexia-blog.ghotit.com >> >> Twitter: http://twitter.com/ghotit >> >> Facebook: http://facebook.com/ghotit >> >> ...................................................................... >> >> Ghotit Dyslexia >> >> Assistive technology that understands you >> >> ...................................................................... >> >> >> >> >> >> >> >> ------------------------------------------------------------------------------ >> >> All the data continuously generated in your IT infrastructure contains >> >> a >> >> definitive record of customers, application performance, security >> >> threats, fraudulent activity and more. Splunk takes this data and makes >> >> sense of it. Business sense. IT sense. Common sense. >> >> http://p.sf.net/sfu/splunk-d2d-oct >> >> _______________________________________________ >> >> curl-loader-devel mailing list >> >> cur...@li... >> >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> > >> > >> > >> > >> > ------------------------------------------------------------------------------ >> > Live Security Virtual Conference >> > Exclusive live event will cover all the ways today's security and >> > threat landscape has changed and how IT managers can respond. >> > Discussions >> > will include endpoint security, mobile security and the latest in >> > malware >> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ >> > _______________________________________________ >> > curl-loader-devel mailing list >> > cur...@li... >> > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> > >> >> >> ------------------------------------------------------------------------------ >> Live Security Virtual Conference >> Exclusive live event will cover all the ways today's security and >> threat landscape has changed and how IT managers can respond. Discussions >> will include endpoint security, mobile security and the latest in malware >> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ >> _______________________________________________ >> curl-loader-devel mailing list >> cur...@li... >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > -- Regards, Robert Iakobashvili, Ph.D. Home: http://www.ghotit.com Blog: http://www.ghotit.com/category/ghotit-blogs/ Twitter: http://twitter.com/ghotit Facebook: http://facebook.com/ghotit ...................................................................... Ghotit Dyslexia Assistive technology that understands you ...................................................................... |
|
From: wei g. <wei...@gm...> - 2012-08-28 02:26:02
|
hi, Robert: May be my problem is another issue, I use FRESH_CONNECT in my test plan(for I have to simulate huge of person login in a short peroid of time). when CLIENT_NUM reach to 300, the cpu consumption in client end exhuasted very much(client cpu 8*Intel(R) Xeon(R) CPU E31230 @ 3.20GHz), client idle below to 30%, I change the https to http, Still the total QPS to server only 1100, AND the server has litter pressure. I also found there many TIME_WAIT socket state in my nginx server, It reach 68546(Ii use multi machine as client), does this have any affect? my question is FRESH_CONNECT operation is an very cpu-comsumption operation? Do you have any suggestion? On Mon, Aug 27, 2012 at 12:09 PM, Robert Iakobashvili <cor...@gm...>wrote: > Hi wei guo, > > It's a libcurl issue when built with openssl. > > More throughput could be delivered, probably, if to build libcurl > against some another TLS/SSL library. > > You can try it. > > Regards, > Robert Iakobashvili, Ph.D. > > Home: http://www.ghotit.com > Blog: http://www.ghotit.com/category/ghotit-blogs/ > Twitter: http://twitter.com/ghotit > Facebook: http://facebook.com/ghotit > ...................................................................... > Ghotit Dyslexia > Assistive technology that understands you > ...................................................................... > > > On Mon, Aug 27, 2012 at 5:38 AM, wei guo <wei...@gm...> wrote: > > hi,all: > > do you have any conclusion for this issue？ I ran into the same problem, > I'll > > look for answers for this. > > > > On Wed, Oct 12, 2011 at 4:51 PM, Robert Iakobashvili < > cor...@gm...> > > wrote: > >> > >> Hi CK Zhang, > >> > >> Now it clear what happens. > >> > >> curl-loader: > >> - establishes TCP connections; > >> - makes expensive TLS/SSL handshake > >> - fetches the file. > >> > >> After fetching file, curl-loader closes the TCP-connection. > >> > >> Next cycle it establishes the TCP-connection and makes the expensive > >> TLS/SSL handshake again, > >> and fetches the file. > >> > >> To achieve high throughput libcurl needs to be configured to re-use > >> the established > >> TCP connection and TLS/SSL for the next file transfer and not to > >> re-establish it every cycle. > >> > >> I suggest you to look in curl (libcurl) options and I will also be doing > >> that. > >> > >> Thanks for your reporting. > >> > >> On Wed, Oct 12, 2011 at 2:59 AM, CK Zhang <ck...@fo...> wrote: > >> > > >> > Attached logs, and output from console > >> > > >> > ============ loading batch is: Apach > >> > ====================================== > >> > > >> > > ---------------------------------------------------------------------------- > >> > ---- > >> > Interval stats (latest:3 sec, clients:100, CAPS-curr:60): > >> > H/F > >> > > >> > > Req:0,1xx:0,2xx:0,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:0ms,D-2xx:0ms,Ti:0B/s,To > >> > :0B/s > >> > H/F/S > >> > > >> > > Req:200,1xx:0,2xx:201,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:553ms,D-2xx:553ms,Ti > >> > :6854220B/s,To:18800B/s > >> > > >> > > ---------------------------------------------------------------------------- > >> > ---- > >> > Summary stats (runs:48 secs, CAPS-average:60): > >> > H/F > >> > > >> > > Req:0,1xx:0,2xx:0,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:0ms,D-2xx:0ms,Ti:0B/s,To > >> > :0B/s > >> > H/F/S > >> > > >> > > Req:2878,1xx:0,2xx:2873,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:614ms,D-2xx:614ms, > >> > Ti:6087722B/s,To:17182B/s > >> > > >> > > ============================================================================ > >> > ===== > >> > Manual: clients:max[100],curr[100]. Inc num: [+|*]. > >> > > >> > > ============================================================================ > >> > ===== > >> > > >> > Best Regards, > >> > CK > >> > #8042 > >> > > >> > > >> > -----Original Message----- > >> > From: Robert Iakobashvili [mailto:cor...@gm...] > >> > Sent: Tuesday, October 11, 2011 5:49 PM > >> > To: curl-loader-devel > >> > Subject: Re: HTTPS throughput too low > >> > > >> > Please, try > >> > > >> > CLIENTS_NUM_MAX=100 > >> > CLIENTS_NUM_START=100 > >> > > >> > and comment out > >> > #CLIENTS_RAMPUP_INC=10 > >> > > >> > Say, what happens with traffic and send me the log. > >> > > >> > On Tue, Oct 11, 2011 at 11:36 AM, CK Zhang <ck...@fo...> > wrote: > >> >> Attached :) thanks! > >> >> > >> >> Best Regards, > >> >> CK > >> >> #8042 > >> >> > >> >> > >> >> -----Original Message----- > >> >> From: Robert Iakobashvili [mailto:cor...@gm...] > >> >> Sent: Tuesday, October 11, 2011 5:33 PM > >> >> To: curl-loader-devel > >> >> Subject: Re: HTTPS throughput too low > >> >> > >> >> Could you send me it zipped not rarred? > >> >> Thanks! > >> >> > >> >> On Tue, Oct 11, 2011 at 11:30 AM, CK Zhang <ck...@fo...> > >> >> wrote: > >> >>> Dear Robert > >> >>> > >> >>> Attached test log by command "./curl-loader -f https.conf -v" > >> >>> > >> >>> Best Regards, > >> >>> CK > >> >>> #8042 > >> >>> > >> >>> -----Original Message----- > >> >>> From: Robert Iakobashvili [mailto:cor...@gm...] > >> >>> Sent: Tuesday, October 11, 2011 5:19 PM > >> >>> To: curl-loader-devel > >> >>> Subject: Re: HTTPS throughput too low > >> >>> > >> >>> Dear CK Zhang, > >> >>> > >> >>> Can you run HTTPS sessions with -v detailed logging and say if > >> >>> you seen in logs something interesting. > >> >>> Thanks, > >> >>> Robert > >> >>> > >> >>> > >> >>> > >> >>> On Tue, Oct 11, 2011 at 11:14 AM, CK Zhang <ck...@fo...> > >> >>> wrote: > >> >>>> Dear Robert > >> >>>> > >> >>>> > >> >>>> > >> >>>> Thanks a lot for your replay, > >> >>>> > >> >>>> > >> >>>> > >> >>>> Here are some answer about your questions > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> What happens if you try HTTP? Does it impact throughput? > >> >>>> > >> >>>> It is normal and perfect if I test with HTTP, The throughput can > >> >>>> reach > >> >> to > >> >>>> 950Mbps. > >> >>>> > >> >>>> > >> >>>> > >> >>>> Which tools you are using to measure throughput? > >> >>>> > >> >>>> There are 2 ways I used, > >> >>>> > >> >>>> 1 check the log summary form cur-loader like this” > >> >>>> Ti:5261372B/s,To:18375B/s” > >> >>>> > >> >>>> 2 check real time traffic speed on switch with connected test PC > and > >> > HTTP > >> >>>> server > >> >>>> > >> >>>> > >> >>>> > >> >>>> What happens, if you try just to ftp some large file between the > >> >> machines? > >> >>>> > >> >>>> NO test > >> >>>> > >> >>>> What about CPU usage at both client and server? > >> >>>> > >> >>>> Both they are busy, about 80% > >> >>>> > >> >>>> Which HTTP server is in use? > >> >>>> > >> >>>> Apache/2.2.21 > >> >>>> > >> >>>> Have you looked into logs of curl-loader and your web-server? > >> >>>> > >> >>>> Checked log, not find abnormal issue. > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> Today, I used Loadrunner11 to simulate https traffic with same > >> >>> environments > >> >>>> (same apache server) , it can reach to 110Mpbs. But still only get > >> >>> 800kbps > >> >>>> with cur-loader. > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> Best Regards, > >> >>>> > >> >>>> CK > >> >>>> > >> >>>> #8042 > >> >>>> > >> >>>> > >> >>>> > >> >>>> From: Robert Iakobashvili [mailto:cor...@gm...] > >> >>>> Sent: Tuesday, September 27, 2011 1:19 PM > >> >>>> To: curl-loader-devel > >> >>>> Subject: Re: HTTPS throughput too low > >> >>>> > >> >>>> > >> >>>> > >> >>>> Dear CK Zhang, > >> >>>> > >> >>>> On Mon, Sep 26, 2011 at 5:01 AM, CK Zhang <ck...@fo...> > >> >>>> wrote: > >> >>>> > >> >>>> > >> >>>> > >> >>>> I want to get high https stream with curl loader, but the Https > >> >> throughput > >> >>>> is about 800kbps between two PC, Http throughput can reach 950Mbps > in > >> >> that > >> >>> 2 > >> >>>> pcs, I do know if some have experience like this, and get a high > >> >>>> https > >> >>>> throughput with curl-loader, Thanks for any supports and help!! > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> Here is my configuration: > >> >>>> > >> >>>> > >> >>>> > >> >>>> PC1:CPU Inter E2200, Mem 2G, 1000M NIC > >> >>>> > >> >>>> OpenSSL: > >> >>>> > >> >>>> openssl-devel-1.0.0-4.el6_0.2.x86_64 > >> >>>> > >> >>>> openssl-1.0.0-4.el6_0.2.x86_64 > >> >>>> > >> >>>> openssl-perl-1.0.0-4.el6_0.2.x86_64 > >> >>>> > >> >>>> > >> >>>> > >> >>>> curl-loader-0.53 > >> >>>> > >> >>>> ########### GENERAL SECTION > >> >>>> ################################ > >> >>>> > >> >>>> BATCH_NAME= Apach > >> >>>> > >> >>>> CLIENTS_NUM_MAX=400 > >> >>>> > >> >>>> CLIENTS_NUM_START=100 > >> >>>> > >> >>>> CLIENTS_RAMPUP_INC=10 > >> >>>> > >> >>>> INTERFACE =eth2 > >> >>>> > >> >>>> NETMASK=16 > >> >>>> > >> >>>> IP_ADDR_MIN= 172.16.76.150 > >> >>>> > >> >>>> IP_ADDR_MAX= 172.16.246.250 #Actually - this is for self-control > >> >>>> > >> >>>> CYCLES_NUM= -1 > >> >>>> > >> >>>> URLS_NUM= 1 > >> >>>> > >> >>>> > >> >>>> > >> >>>> ########### URL SECTION #################################### > >> >>>> > >> >>>> > >> >>>> > >> >>>> URL=https://172.16.76.142/was/100KB.txt # the size of 100KB.txt is > >> >>>> 100KB > >> >>>> > >> >>>> #URL=http://localhost/ACE-INSTALL.html > >> >>>> > >> >>>> URL_SHORT_NAME="local-index" > >> >>>> > >> >>>> REQUEST_TYPE=GET > >> >>>> > >> >>>> TIMER_URL_COMPLETION = 0 # In msec. When positive, Now it is > >> >> enforced > >> >>>> by cancelling url fetch on timeout > >> >>>> > >> >>>> TIMER_AFTER_URL_SLEEP =1000 > >> >>>> > >> >>>> ~ > >> >>>> > >> >>>> > >> >>>> > >> >>>> PC2. Works as Webserver,CPU Intel E7600,Mem 4G, 1000M NIC > >> >>>> > >> >>>> Server version: Apache/2.2.21 (Unix) > >> >>>> > >> >>>> Server built: Sep 21 2011 16:19:43 > >> >>>> > >> >>>> openssl-devel-1.0.0-4.el6_0.2.x86_64 > >> >>>> > >> >>>> openssl-1.0.0-4.el6_0.2.x86_64 > >> >>>> > >> >>>> openssl-perl-1.0.0-4.el6_0.2.x86_64 > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> > >> >>>> Interesting. > >> >>>> > >> >>>> > >> >>>> > >> >>>> What happens if you try HTTP? Does it impact throughput? > >> >>>> > >> >>>> > >> >>>> > >> >>>> Which tools you are using to measure throughput? > >> >>>> > >> >>>> > >> >>>> > >> >>>> What happens, if you try just to ftp some large file between the > >> >> machines? > >> >>>> > >> >>>> > >> >>>> > >> >>>> What about CPU usage at both client and server? > >> >>>> > >> >>>> Which HTTP server is in use? > >> >>>> > >> >>>> > >> >>>> > >> >>>> Have you looked into logs of curl-loader and your web-server? > >> >>>> > >> >>>> > >> >>>> > >> >>>> -- > >> >>>> Regards, > >> >>>> Robert Iakobashvili, Ph.D. > >> >>>> > >> >>>> > >> >>>> > >> >>>> Home: http://www.ghotit.com > >> >>>> > >> >>>> Blog: http://dyslexia-blog.ghotit.com > >> >>>> > >> >>>> Twitter: http://twitter.com/ghotit > >> >>>> > >> >>>> Facebook: http://facebook.com/ghotit > >> >>>> > >> >>>> > >> >>>> > ...................................................................... > >> >>>> > >> >>>> Ghotit Dyslexia > >> >>>> > >> >>>> Assistive technology that understands you > >> >>>> > >> >>>> > >> >>>> > ...................................................................... > >> >>>> > >> >>>> > >> >>>> > >> >>>> ________________________________ > >> >>>> > >> >>>> *** Please note that this message and any attachments may contain > >> >>>> confidential > >> >>>> and proprietary material and information and are intended only for > >> >>>> the > >> >> use > >> >>>> of > >> >>>> the intended recipient(s). If you are not the intended recipient, > you > >> > are > >> >>>> hereby > >> >>>> notified that any review, use, disclosure, dissemination, > >> >>>> distribution > >> > or > >> >>>> copying > >> >>>> of this message and any attachments is strictly prohibited. If you > >> >>>> have > >> >>>> received > >> >>>> this email in error, please immediately notify the sender and > destroy > >> >> this > >> >>>> e-mail > >> >>>> and any attachments and all copies, whether electronic or printed. > >> >>>> Please also note that any views, opinions, conclusions or > commitments > >> >>>> expressed > >> >>>> in this message are those of the individual sender and do not > >> > necessarily > >> >>>> reflect > >> >>>> the views of Fortinet, Inc., its affiliates, and emails are not > >> >>>> binding > >> >> on > >> >>>> Fortinet and only a writing manually signed by Fortinet's General > >> > Counsel > >> >>>> can be > >> >>>> a binding commitment of Fortinet to Fortinet's customers or > partners. > >> >>> Thank > >> >>>> you. *** > >> >>>> > >> >>>> ________________________________ > >> >>>> > >> >>>> > >> >>> > >> >> > >> > > >> > > ---------------------------------------------------------------------------- > >> >>> -- > >> >>>> All the data continuously generated in your IT infrastructure > >> >>>> contains a > >> >>>> definitive record of customers, application performance, security > >> >>>> threats, fraudulent activity and more. Splunk takes this data and > >> >>>> makes > >> >>>> sense of it. Business sense. IT sense. Common sense. > >> >>>> http://p.sf.net/sfu/splunk-d2d-oct > >> >>>> _______________________________________________ > >> >>>> curl-loader-devel mailing list > >> >>>> cur...@li... > >> >>>> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >> >>>> > >> >>>> > >> >>> > >> >>> > >> >>> > >> >>> -- > >> >>> Regards, > >> >>> Robert Iakobashvili, Ph.D. > >> >>> > >> >>> Home: http://www.ghotit.com > >> >>> Blog: http://dyslexia-blog.ghotit.com > >> >>> Twitter: http://twitter.com/ghotit > >> >>> Facebook: http://facebook.com/ghotit > >> >>> > ...................................................................... > >> >>> Ghotit Dyslexia > >> >>> Assistive technology that understands you > >> >>> > ...................................................................... > >> >>> > >> >>> > >> >> > >> > > >> > > ---------------------------------------------------------------------------- > >> >>> -- > >> >>> All the data continuously generated in your IT infrastructure > contains > >> >>> a > >> >>> definitive record of customers, application performance, security > >> >>> threats, fraudulent activity and more. Splunk takes this data and > >> >>> makes > >> >>> sense of it. Business sense. IT sense. Common sense. > >> >>> http://p.sf.net/sfu/splunk-d2d-oct > >> >>> _______________________________________________ > >> >>> curl-loader-devel mailing list > >> >>> cur...@li... > >> >>> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >> >>> > >> >>> > >> >>> *** Please note that this message and any attachments may contain > >> >> confidential > >> >>> and proprietary material and information and are intended only for > the > >> > use > >> >> of > >> >>> the intended recipient(s). If you are not the intended recipient, > you > >> >>> are > >> >> hereby > >> >>> notified that any review, use, disclosure, dissemination, > distribution > >> >>> or > >> >> copying > >> >>> of this message and any attachments is strictly prohibited. If you > >> >>> have > >> >> received > >> >>> this email in error, please immediately notify the sender and > destroy > >> > this > >> >> e-mail > >> >>> and any attachments and all copies, whether electronic or printed. > >> >>> Please also note that any views, opinions, conclusions or > commitments > >> >> expressed > >> >>> in this message are those of the individual sender and do not > >> >>> necessarily > >> >> reflect > >> >>> the views of Fortinet, Inc., its affiliates, and emails are not > >> >>> binding > >> > on > >> >>> Fortinet and only a writing manually signed by Fortinet's General > >> >>> Counsel > >> >> can be > >> >>> a binding commitment of Fortinet to Fortinet's customers or > partners. > >> >> Thank you. *** > >> >>> > >> >>> > >> >> > >> > > >> > > ---------------------------------------------------------------------------- > >> >> -- > >> >>> All the data continuously generated in your IT infrastructure > contains > >> >>> a > >> >>> definitive record of customers, application performance, security > >> >>> threats, fraudulent activity and more. Splunk takes this data and > >> >>> makes > >> >>> sense of it. Business sense. IT sense. Common sense. > >> >>> http://p.sf.net/sfu/splunk-d2d-oct > >> >>> _______________________________________________ > >> >>> curl-loader-devel mailing list > >> >>> cur...@li... > >> >>> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >> >>> > >> >>> > >> >> > >> >> > >> >> > >> >> -- > >> >> Regards, > >> >> Robert Iakobashvili, Ph.D. > >> >> > >> >> Home: http://www.ghotit.com > >> >> Blog: http://dyslexia-blog.ghotit.com > >> >> Twitter: http://twitter.com/ghotit > >> >> Facebook: http://facebook.com/ghotit > >> >> > ...................................................................... > >> >> Ghotit Dyslexia > >> >> Assistive technology that understands you > >> >> > ...................................................................... > >> >> > >> >> > >> > > >> > > ---------------------------------------------------------------------------- > >> >> -- > >> >> All the data continuously generated in your IT infrastructure > contains > >> >> a > >> >> definitive record of customers, application performance, security > >> >> threats, fraudulent activity and more. Splunk takes this data and > makes > >> >> sense of it. Business sense. IT sense. Common sense. > >> >> http://p.sf.net/sfu/splunk-d2d-oct > >> >> _______________________________________________ > >> >> curl-loader-devel mailing list > >> >> cur...@li... > >> >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >> >> > >> >> > >> >> *** Please note that this message and any attachments may contain > >> > confidential > >> >> and proprietary material and information and are intended only for > the > >> >> use > >> > of > >> >> the intended recipient(s). If you are not the intended recipient, you > >> >> are > >> > hereby > >> >> notified that any review, use, disclosure, dissemination, > distribution > >> >> or > >> > copying > >> >> of this message and any attachments is strictly prohibited. If you > have > >> > received > >> >> this email in error, please immediately notify the sender and destroy > >> >> this > >> > e-mail > >> >> and any attachments and all copies, whether electronic or printed. > >> >> Please also note that any views, opinions, conclusions or commitments > >> > expressed > >> >> in this message are those of the individual sender and do not > >> >> necessarily > >> > reflect > >> >> the views of Fortinet, Inc., its affiliates, and emails are not > binding > >> >> on > >> >> Fortinet and only a writing manually signed by Fortinet's General > >> >> Counsel > >> > can be > >> >> a binding commitment of Fortinet to Fortinet's customers or partners. > >> > Thank you. *** > >> >> > >> >> > >> > > >> > > ---------------------------------------------------------------------------- > >> > -- > >> >> All the data continuously generated in your IT infrastructure > contains > >> >> a > >> >> definitive record of customers, application performance, security > >> >> threats, fraudulent activity and more. Splunk takes this data and > makes > >> >> sense of it. Business sense. IT sense. Common sense. > >> >> http://p.sf.net/sfu/splunk-d2d-oct > >> >> _______________________________________________ > >> >> curl-loader-devel mailing list > >> >> cur...@li... > >> >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >> >> > >> >> > >> > > >> > > >> > > >> > -- > >> > Regards, > >> > Robert Iakobashvili, Ph.D. > >> > > >> > Home: http://www.ghotit.com > >> > Blog: http://dyslexia-blog.ghotit.com > >> > Twitter: http://twitter.com/ghotit > >> > Facebook: http://facebook.com/ghotit > >> > ...................................................................... > >> > Ghotit Dyslexia > >> > Assistive technology that understands you > >> > ...................................................................... > >> > > >> > > >> > > ---------------------------------------------------------------------------- > >> > -- > >> > All the data continuously generated in your IT infrastructure > contains a > >> > definitive record of customers, application performance, security > >> > threats, fraudulent activity and more. Splunk takes this data and > makes > >> > sense of it. Business sense. IT sense. Common sense. > >> > http://p.sf.net/sfu/splunk-d2d-oct > >> > _______________________________________________ > >> > curl-loader-devel mailing list > >> > cur...@li... > >> > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >> > > >> > > >> > *** Please note that this message and any attachments may contain > >> > confidential > >> > and proprietary material and information and are intended only for the > >> > use of > >> > the intended recipient(s). If you are not the intended recipient, you > >> > are hereby > >> > notified that any review, use, disclosure, dissemination, distribution > >> > or copying > >> > of this message and any attachments is strictly prohibited. If you > have > >> > received > >> > this email in error, please immediately notify the sender and destroy > >> > this e-mail > >> > and any attachments and all copies, whether electronic or printed. > >> > Please also note that any views, opinions, conclusions or commitments > >> > expressed > >> > in this message are those of the individual sender and do not > >> > necessarily reflect > >> > the views of Fortinet, Inc., its affiliates, and emails are not > binding > >> > on > >> > Fortinet and only a writing manually signed by Fortinet's General > >> > Counsel can be > >> > a binding commitment of Fortinet to Fortinet's customers or partners. > >> > Thank you. *** > >> > > >> > > >> > > ------------------------------------------------------------------------------ > >> > All the data continuously generated in your IT infrastructure > contains a > >> > definitive record of customers, application performance, security > >> > threats, fraudulent activity and more. Splunk takes this data and > makes > >> > sense of it. Business sense. IT sense. Common sense. > >> > http://p.sf.net/sfu/splunk-d2d-oct > >> > _______________________________________________ > >> > curl-loader-devel mailing list > >> > cur...@li... > >> > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >> > > >> > > >> > >> > >> > >> -- > >> Regards, > >> Robert Iakobashvili, Ph.D. > >> > >> Home: http://www.ghotit.com > >> Blog: http://dyslexia-blog.ghotit.com > >> Twitter: http://twitter.com/ghotit > >> Facebook: http://facebook.com/ghotit > >> ...................................................................... > >> Ghotit Dyslexia > >> Assistive technology that understands you > >> ...................................................................... > >> > >> > >> > ------------------------------------------------------------------------------ > >> All the data continuously generated in your IT infrastructure contains a > >> definitive record of customers, application performance, security > >> threats, fraudulent activity and more. Splunk takes this data and makes > >> sense of it. Business sense. IT sense. Common sense. > >> http://p.sf.net/sfu/splunk-d2d-oct > >> _______________________________________________ > >> curl-loader-devel mailing list > >> cur...@li... > >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > > > > > > > > ------------------------------------------------------------------------------ > > Live Security Virtual Conference > > Exclusive live event will cover all the ways today's security and > > threat landscape has changed and how IT managers can respond. Discussions > > will include endpoint security, mobile security and the latest in malware > > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > > _______________________________________________ > > curl-loader-devel mailing list > > cur...@li... > > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > > > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > |
|
From: Robert I. <cor...@gm...> - 2012-08-27 04:09:29
|
Hi wei guo, It's a libcurl issue when built with openssl. More throughput could be delivered, probably, if to build libcurl against some another TLS/SSL library. You can try it. Regards, Robert Iakobashvili, Ph.D. Home: http://www.ghotit.com Blog: http://www.ghotit.com/category/ghotit-blogs/ Twitter: http://twitter.com/ghotit Facebook: http://facebook.com/ghotit ...................................................................... Ghotit Dyslexia Assistive technology that understands you ...................................................................... On Mon, Aug 27, 2012 at 5:38 AM, wei guo <wei...@gm...> wrote: > hi,all: > do you have any conclusion for this issue？ I ran into the same problem, I'll > look for answers for this. > > On Wed, Oct 12, 2011 at 4:51 PM, Robert Iakobashvili <cor...@gm...> > wrote: >> >> Hi CK Zhang, >> >> Now it clear what happens. >> >> curl-loader: >> - establishes TCP connections; >> - makes expensive TLS/SSL handshake >> - fetches the file. >> >> After fetching file, curl-loader closes the TCP-connection. >> >> Next cycle it establishes the TCP-connection and makes the expensive >> TLS/SSL handshake again, >> and fetches the file. >> >> To achieve high throughput libcurl needs to be configured to re-use >> the established >> TCP connection and TLS/SSL for the next file transfer and not to >> re-establish it every cycle. >> >> I suggest you to look in curl (libcurl) options and I will also be doing >> that. >> >> Thanks for your reporting. >> >> On Wed, Oct 12, 2011 at 2:59 AM, CK Zhang <ck...@fo...> wrote: >> > >> > Attached logs, and output from console >> > >> > ============ loading batch is: Apach >> > ====================================== >> > >> > ---------------------------------------------------------------------------- >> > ---- >> > Interval stats (latest:3 sec, clients:100, CAPS-curr:60): >> > H/F >> > >> > Req:0,1xx:0,2xx:0,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:0ms,D-2xx:0ms,Ti:0B/s,To >> > :0B/s >> > H/F/S >> > >> > Req:200,1xx:0,2xx:201,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:553ms,D-2xx:553ms,Ti >> > :6854220B/s,To:18800B/s >> > >> > ---------------------------------------------------------------------------- >> > ---- >> > Summary stats (runs:48 secs, CAPS-average:60): >> > H/F >> > >> > Req:0,1xx:0,2xx:0,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:0ms,D-2xx:0ms,Ti:0B/s,To >> > :0B/s >> > H/F/S >> > >> > Req:2878,1xx:0,2xx:2873,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:614ms,D-2xx:614ms, >> > Ti:6087722B/s,To:17182B/s >> > >> > ============================================================================ >> > ===== >> > Manual: clients:max[100],curr[100]. Inc num: [+|*]. >> > >> > ============================================================================ >> > ===== >> > >> > Best Regards, >> > CK >> > #8042 >> > >> > >> > -----Original Message----- >> > From: Robert Iakobashvili [mailto:cor...@gm...] >> > Sent: Tuesday, October 11, 2011 5:49 PM >> > To: curl-loader-devel >> > Subject: Re: HTTPS throughput too low >> > >> > Please, try >> > >> > CLIENTS_NUM_MAX=100 >> > CLIENTS_NUM_START=100 >> > >> > and comment out >> > #CLIENTS_RAMPUP_INC=10 >> > >> > Say, what happens with traffic and send me the log. >> > >> > On Tue, Oct 11, 2011 at 11:36 AM, CK Zhang <ck...@fo...> wrote: >> >> Attached :) thanks! >> >> >> >> Best Regards, >> >> CK >> >> #8042 >> >> >> >> >> >> -----Original Message----- >> >> From: Robert Iakobashvili [mailto:cor...@gm...] >> >> Sent: Tuesday, October 11, 2011 5:33 PM >> >> To: curl-loader-devel >> >> Subject: Re: HTTPS throughput too low >> >> >> >> Could you send me it zipped not rarred? >> >> Thanks! >> >> >> >> On Tue, Oct 11, 2011 at 11:30 AM, CK Zhang <ck...@fo...> >> >> wrote: >> >>> Dear Robert >> >>> >> >>> Attached test log by command "./curl-loader -f https.conf -v" >> >>> >> >>> Best Regards, >> >>> CK >> >>> #8042 >> >>> >> >>> -----Original Message----- >> >>> From: Robert Iakobashvili [mailto:cor...@gm...] >> >>> Sent: Tuesday, October 11, 2011 5:19 PM >> >>> To: curl-loader-devel >> >>> Subject: Re: HTTPS throughput too low >> >>> >> >>> Dear CK Zhang, >> >>> >> >>> Can you run HTTPS sessions with -v detailed logging and say if >> >>> you seen in logs something interesting. >> >>> Thanks, >> >>> Robert >> >>> >> >>> >> >>> >> >>> On Tue, Oct 11, 2011 at 11:14 AM, CK Zhang <ck...@fo...> >> >>> wrote: >> >>>> Dear Robert >> >>>> >> >>>> >> >>>> >> >>>> Thanks a lot for your replay, >> >>>> >> >>>> >> >>>> >> >>>> Here are some answer about your questions >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> What happens if you try HTTP? Does it impact throughput? >> >>>> >> >>>> It is normal and perfect if I test with HTTP, The throughput can >> >>>> reach >> >> to >> >>>> 950Mbps. >> >>>> >> >>>> >> >>>> >> >>>> Which tools you are using to measure throughput? >> >>>> >> >>>> There are 2 ways I used, >> >>>> >> >>>> 1 check the log summary form cur-loader like this” >> >>>> Ti:5261372B/s,To:18375B/s” >> >>>> >> >>>> 2 check real time traffic speed on switch with connected test PC and >> > HTTP >> >>>> server >> >>>> >> >>>> >> >>>> >> >>>> What happens, if you try just to ftp some large file between the >> >> machines? >> >>>> >> >>>> NO test >> >>>> >> >>>> What about CPU usage at both client and server? >> >>>> >> >>>> Both they are busy, about 80% >> >>>> >> >>>> Which HTTP server is in use? >> >>>> >> >>>> Apache/2.2.21 >> >>>> >> >>>> Have you looked into logs of curl-loader and your web-server? >> >>>> >> >>>> Checked log, not find abnormal issue. >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> Today, I used Loadrunner11 to simulate https traffic with same >> >>> environments >> >>>> (same apache server) , it can reach to 110Mpbs. But still only get >> >>> 800kbps >> >>>> with cur-loader. >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> Best Regards, >> >>>> >> >>>> CK >> >>>> >> >>>> #8042 >> >>>> >> >>>> >> >>>> >> >>>> From: Robert Iakobashvili [mailto:cor...@gm...] >> >>>> Sent: Tuesday, September 27, 2011 1:19 PM >> >>>> To: curl-loader-devel >> >>>> Subject: Re: HTTPS throughput too low >> >>>> >> >>>> >> >>>> >> >>>> Dear CK Zhang, >> >>>> >> >>>> On Mon, Sep 26, 2011 at 5:01 AM, CK Zhang <ck...@fo...> >> >>>> wrote: >> >>>> >> >>>> >> >>>> >> >>>> I want to get high https stream with curl loader, but the Https >> >> throughput >> >>>> is about 800kbps between two PC, Http throughput can reach 950Mbps in >> >> that >> >>> 2 >> >>>> pcs, I do know if some have experience like this, and get a high >> >>>> https >> >>>> throughput with curl-loader, Thanks for any supports and help!! >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> Here is my configuration: >> >>>> >> >>>> >> >>>> >> >>>> PC1:CPU Inter E2200, Mem 2G, 1000M NIC >> >>>> >> >>>> OpenSSL: >> >>>> >> >>>> openssl-devel-1.0.0-4.el6_0.2.x86_64 >> >>>> >> >>>> openssl-1.0.0-4.el6_0.2.x86_64 >> >>>> >> >>>> openssl-perl-1.0.0-4.el6_0.2.x86_64 >> >>>> >> >>>> >> >>>> >> >>>> curl-loader-0.53 >> >>>> >> >>>> ########### GENERAL SECTION >> >>>> ################################ >> >>>> >> >>>> BATCH_NAME= Apach >> >>>> >> >>>> CLIENTS_NUM_MAX=400 >> >>>> >> >>>> CLIENTS_NUM_START=100 >> >>>> >> >>>> CLIENTS_RAMPUP_INC=10 >> >>>> >> >>>> INTERFACE =eth2 >> >>>> >> >>>> NETMASK=16 >> >>>> >> >>>> IP_ADDR_MIN= 172.16.76.150 >> >>>> >> >>>> IP_ADDR_MAX= 172.16.246.250 #Actually - this is for self-control >> >>>> >> >>>> CYCLES_NUM= -1 >> >>>> >> >>>> URLS_NUM= 1 >> >>>> >> >>>> >> >>>> >> >>>> ########### URL SECTION #################################### >> >>>> >> >>>> >> >>>> >> >>>> URL=https://172.16.76.142/was/100KB.txt # the size of 100KB.txt is >> >>>> 100KB >> >>>> >> >>>> #URL=http://localhost/ACE-INSTALL.html >> >>>> >> >>>> URL_SHORT_NAME="local-index" >> >>>> >> >>>> REQUEST_TYPE=GET >> >>>> >> >>>> TIMER_URL_COMPLETION = 0 # In msec. When positive, Now it is >> >> enforced >> >>>> by cancelling url fetch on timeout >> >>>> >> >>>> TIMER_AFTER_URL_SLEEP =1000 >> >>>> >> >>>> ~ >> >>>> >> >>>> >> >>>> >> >>>> PC2. Works as Webserver,CPU Intel E7600,Mem 4G, 1000M NIC >> >>>> >> >>>> Server version: Apache/2.2.21 (Unix) >> >>>> >> >>>> Server built: Sep 21 2011 16:19:43 >> >>>> >> >>>> openssl-devel-1.0.0-4.el6_0.2.x86_64 >> >>>> >> >>>> openssl-1.0.0-4.el6_0.2.x86_64 >> >>>> >> >>>> openssl-perl-1.0.0-4.el6_0.2.x86_64 >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> Interesting. >> >>>> >> >>>> >> >>>> >> >>>> What happens if you try HTTP? Does it impact throughput? >> >>>> >> >>>> >> >>>> >> >>>> Which tools you are using to measure throughput? >> >>>> >> >>>> >> >>>> >> >>>> What happens, if you try just to ftp some large file between the >> >> machines? >> >>>> >> >>>> >> >>>> >> >>>> What about CPU usage at both client and server? >> >>>> >> >>>> Which HTTP server is in use? >> >>>> >> >>>> >> >>>> >> >>>> Have you looked into logs of curl-loader and your web-server? >> >>>> >> >>>> >> >>>> >> >>>> -- >> >>>> Regards, >> >>>> Robert Iakobashvili, Ph.D. >> >>>> >> >>>> >> >>>> >> >>>> Home: http://www.ghotit.com >> >>>> >> >>>> Blog: http://dyslexia-blog.ghotit.com >> >>>> >> >>>> Twitter: http://twitter.com/ghotit >> >>>> >> >>>> Facebook: http://facebook.com/ghotit >> >>>> >> >>>> >> >>>> ...................................................................... >> >>>> >> >>>> Ghotit Dyslexia >> >>>> >> >>>> Assistive technology that understands you >> >>>> >> >>>> >> >>>> ...................................................................... >> >>>> >> >>>> >> >>>> >> >>>> ________________________________ >> >>>> >> >>>> *** Please note that this message and any attachments may contain >> >>>> confidential >> >>>> and proprietary material and information and are intended only for >> >>>> the >> >> use >> >>>> of >> >>>> the intended recipient(s). If you are not the intended recipient, you >> > are >> >>>> hereby >> >>>> notified that any review, use, disclosure, dissemination, >> >>>> distribution >> > or >> >>>> copying >> >>>> of this message and any attachments is strictly prohibited. If you >> >>>> have >> >>>> received >> >>>> this email in error, please immediately notify the sender and destroy >> >> this >> >>>> e-mail >> >>>> and any attachments and all copies, whether electronic or printed. >> >>>> Please also note that any views, opinions, conclusions or commitments >> >>>> expressed >> >>>> in this message are those of the individual sender and do not >> > necessarily >> >>>> reflect >> >>>> the views of Fortinet, Inc., its affiliates, and emails are not >> >>>> binding >> >> on >> >>>> Fortinet and only a writing manually signed by Fortinet's General >> > Counsel >> >>>> can be >> >>>> a binding commitment of Fortinet to Fortinet's customers or partners. >> >>> Thank >> >>>> you. *** >> >>>> >> >>>> ________________________________ >> >>>> >> >>>> >> >>> >> >> >> > >> > ---------------------------------------------------------------------------- >> >>> -- >> >>>> All the data continuously generated in your IT infrastructure >> >>>> contains a >> >>>> definitive record of customers, application performance, security >> >>>> threats, fraudulent activity and more. Splunk takes this data and >> >>>> makes >> >>>> sense of it. Business sense. IT sense. Common sense. >> >>>> http://p.sf.net/sfu/splunk-d2d-oct >> >>>> _______________________________________________ >> >>>> curl-loader-devel mailing list >> >>>> cur...@li... >> >>>> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >>>> >> >>>> >> >>> >> >>> >> >>> >> >>> -- >> >>> Regards, >> >>> Robert Iakobashvili, Ph.D. >> >>> >> >>> Home: http://www.ghotit.com >> >>> Blog: http://dyslexia-blog.ghotit.com >> >>> Twitter: http://twitter.com/ghotit >> >>> Facebook: http://facebook.com/ghotit >> >>> ...................................................................... >> >>> Ghotit Dyslexia >> >>> Assistive technology that understands you >> >>> ...................................................................... >> >>> >> >>> >> >> >> > >> > ---------------------------------------------------------------------------- >> >>> -- >> >>> All the data continuously generated in your IT infrastructure contains >> >>> a >> >>> definitive record of customers, application performance, security >> >>> threats, fraudulent activity and more. Splunk takes this data and >> >>> makes >> >>> sense of it. Business sense. IT sense. Common sense. >> >>> http://p.sf.net/sfu/splunk-d2d-oct >> >>> _______________________________________________ >> >>> curl-loader-devel mailing list >> >>> cur...@li... >> >>> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >>> >> >>> >> >>> *** Please note that this message and any attachments may contain >> >> confidential >> >>> and proprietary material and information and are intended only for the >> > use >> >> of >> >>> the intended recipient(s). If you are not the intended recipient, you >> >>> are >> >> hereby >> >>> notified that any review, use, disclosure, dissemination, distribution >> >>> or >> >> copying >> >>> of this message and any attachments is strictly prohibited. If you >> >>> have >> >> received >> >>> this email in error, please immediately notify the sender and destroy >> > this >> >> e-mail >> >>> and any attachments and all copies, whether electronic or printed. >> >>> Please also note that any views, opinions, conclusions or commitments >> >> expressed >> >>> in this message are those of the individual sender and do not >> >>> necessarily >> >> reflect >> >>> the views of Fortinet, Inc., its affiliates, and emails are not >> >>> binding >> > on >> >>> Fortinet and only a writing manually signed by Fortinet's General >> >>> Counsel >> >> can be >> >>> a binding commitment of Fortinet to Fortinet's customers or partners. >> >> Thank you. *** >> >>> >> >>> >> >> >> > >> > ---------------------------------------------------------------------------- >> >> -- >> >>> All the data continuously generated in your IT infrastructure contains >> >>> a >> >>> definitive record of customers, application performance, security >> >>> threats, fraudulent activity and more. Splunk takes this data and >> >>> makes >> >>> sense of it. Business sense. IT sense. Common sense. >> >>> http://p.sf.net/sfu/splunk-d2d-oct >> >>> _______________________________________________ >> >>> curl-loader-devel mailing list >> >>> cur...@li... >> >>> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >>> >> >>> >> >> >> >> >> >> >> >> -- >> >> Regards, >> >> Robert Iakobashvili, Ph.D. >> >> >> >> Home: http://www.ghotit.com >> >> Blog: http://dyslexia-blog.ghotit.com >> >> Twitter: http://twitter.com/ghotit >> >> Facebook: http://facebook.com/ghotit >> >> ...................................................................... >> >> Ghotit Dyslexia >> >> Assistive technology that understands you >> >> ...................................................................... >> >> >> >> >> > >> > ---------------------------------------------------------------------------- >> >> -- >> >> All the data continuously generated in your IT infrastructure contains >> >> a >> >> definitive record of customers, application performance, security >> >> threats, fraudulent activity and more. Splunk takes this data and makes >> >> sense of it. Business sense. IT sense. Common sense. >> >> http://p.sf.net/sfu/splunk-d2d-oct >> >> _______________________________________________ >> >> curl-loader-devel mailing list >> >> cur...@li... >> >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >> >> >> >> >> *** Please note that this message and any attachments may contain >> > confidential >> >> and proprietary material and information and are intended only for the >> >> use >> > of >> >> the intended recipient(s). If you are not the intended recipient, you >> >> are >> > hereby >> >> notified that any review, use, disclosure, dissemination, distribution >> >> or >> > copying >> >> of this message and any attachments is strictly prohibited. If you have >> > received >> >> this email in error, please immediately notify the sender and destroy >> >> this >> > e-mail >> >> and any attachments and all copies, whether electronic or printed. >> >> Please also note that any views, opinions, conclusions or commitments >> > expressed >> >> in this message are those of the individual sender and do not >> >> necessarily >> > reflect >> >> the views of Fortinet, Inc., its affiliates, and emails are not binding >> >> on >> >> Fortinet and only a writing manually signed by Fortinet's General >> >> Counsel >> > can be >> >> a binding commitment of Fortinet to Fortinet's customers or partners. >> > Thank you. *** >> >> >> >> >> > >> > ---------------------------------------------------------------------------- >> > -- >> >> All the data continuously generated in your IT infrastructure contains >> >> a >> >> definitive record of customers, application performance, security >> >> threats, fraudulent activity and more. Splunk takes this data and makes >> >> sense of it. Business sense. IT sense. Common sense. >> >> http://p.sf.net/sfu/splunk-d2d-oct >> >> _______________________________________________ >> >> curl-loader-devel mailing list >> >> cur...@li... >> >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >> >> >> >> > >> > >> > >> > -- >> > Regards, >> > Robert Iakobashvili, Ph.D. >> > >> > Home: http://www.ghotit.com >> > Blog: http://dyslexia-blog.ghotit.com >> > Twitter: http://twitter.com/ghotit >> > Facebook: http://facebook.com/ghotit >> > ...................................................................... >> > Ghotit Dyslexia >> > Assistive technology that understands you >> > ...................................................................... >> > >> > >> > ---------------------------------------------------------------------------- >> > -- >> > All the data continuously generated in your IT infrastructure contains a >> > definitive record of customers, application performance, security >> > threats, fraudulent activity and more. Splunk takes this data and makes >> > sense of it. Business sense. IT sense. Common sense. >> > http://p.sf.net/sfu/splunk-d2d-oct >> > _______________________________________________ >> > curl-loader-devel mailing list >> > cur...@li... >> > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> > >> > >> > *** Please note that this message and any attachments may contain >> > confidential >> > and proprietary material and information and are intended only for the >> > use of >> > the intended recipient(s). If you are not the intended recipient, you >> > are hereby >> > notified that any review, use, disclosure, dissemination, distribution >> > or copying >> > of this message and any attachments is strictly prohibited. If you have >> > received >> > this email in error, please immediately notify the sender and destroy >> > this e-mail >> > and any attachments and all copies, whether electronic or printed. >> > Please also note that any views, opinions, conclusions or commitments >> > expressed >> > in this message are those of the individual sender and do not >> > necessarily reflect >> > the views of Fortinet, Inc., its affiliates, and emails are not binding >> > on >> > Fortinet and only a writing manually signed by Fortinet's General >> > Counsel can be >> > a binding commitment of Fortinet to Fortinet's customers or partners. >> > Thank you. *** >> > >> > >> > ------------------------------------------------------------------------------ >> > All the data continuously generated in your IT infrastructure contains a >> > definitive record of customers, application performance, security >> > threats, fraudulent activity and more. Splunk takes this data and makes >> > sense of it. Business sense. IT sense. Common sense. >> > http://p.sf.net/sfu/splunk-d2d-oct >> > _______________________________________________ >> > curl-loader-devel mailing list >> > cur...@li... >> > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> > >> > >> >> >> >> -- >> Regards, >> Robert Iakobashvili, Ph.D. >> >> Home: http://www.ghotit.com >> Blog: http://dyslexia-blog.ghotit.com >> Twitter: http://twitter.com/ghotit >> Facebook: http://facebook.com/ghotit >> ...................................................................... >> Ghotit Dyslexia >> Assistive technology that understands you >> ...................................................................... >> >> >> ------------------------------------------------------------------------------ >> All the data continuously generated in your IT infrastructure contains a >> definitive record of customers, application performance, security >> threats, fraudulent activity and more. Splunk takes this data and makes >> sense of it. Business sense. IT sense. Common sense. >> http://p.sf.net/sfu/splunk-d2d-oct >> _______________________________________________ >> curl-loader-devel mailing list >> cur...@li... >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > |
|
From: wei g. <wei...@gm...> - 2012-08-27 02:38:18
|
hi,all: do you have any conclusion for this issue？ I ran into the same problem, I'll look for answers for this. On Wed, Oct 12, 2011 at 4:51 PM, Robert Iakobashvili <cor...@gm...>wrote: > Hi CK Zhang, > > Now it clear what happens. > > curl-loader: > - establishes TCP connections; > - makes expensive TLS/SSL handshake > - fetches the file. > > After fetching file, curl-loader closes the TCP-connection. > > Next cycle it establishes the TCP-connection and makes the expensive > TLS/SSL handshake again, > and fetches the file. > > To achieve high throughput libcurl needs to be configured to re-use > the established > TCP connection and TLS/SSL for the next file transfer and not to > re-establish it every cycle. > > I suggest you to look in curl (libcurl) options and I will also be doing > that. > > Thanks for your reporting. > > On Wed, Oct 12, 2011 at 2:59 AM, CK Zhang <ck...@fo...> wrote: > > > > Attached logs, and output from console > > > > ============ loading batch is: Apach > > ====================================== > > > ---------------------------------------------------------------------------- > > ---- > > Interval stats (latest:3 sec, clients:100, CAPS-curr:60): > > H/F > > > Req:0,1xx:0,2xx:0,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:0ms,D-2xx:0ms,Ti:0B/s,To > > :0B/s > > H/F/S > > > Req:200,1xx:0,2xx:201,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:553ms,D-2xx:553ms,Ti > > :6854220B/s,To:18800B/s > > > ---------------------------------------------------------------------------- > > ---- > > Summary stats (runs:48 secs, CAPS-average:60): > > H/F > > > Req:0,1xx:0,2xx:0,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:0ms,D-2xx:0ms,Ti:0B/s,To > > :0B/s > > H/F/S > > > Req:2878,1xx:0,2xx:2873,3xx:0,4xx:0,5xx:0,Err:0,T-Err:0,D:614ms,D-2xx:614ms, > > Ti:6087722B/s,To:17182B/s > > > ============================================================================ > > ===== > > Manual: clients:max[100],curr[100]. Inc num: [+|*]. > > > ============================================================================ > > ===== > > > > Best Regards, > > CK > > #8042 > > > > > > -----Original Message----- > > From: Robert Iakobashvili [mailto:cor...@gm...] > > Sent: Tuesday, October 11, 2011 5:49 PM > > To: curl-loader-devel > > Subject: Re: HTTPS throughput too low > > > > Please, try > > > > CLIENTS_NUM_MAX=100 > > CLIENTS_NUM_START=100 > > > > and comment out > > #CLIENTS_RAMPUP_INC=10 > > > > Say, what happens with traffic and send me the log. > > > > On Tue, Oct 11, 2011 at 11:36 AM, CK Zhang <ck...@fo...> wrote: > >> Attached :) thanks! > >> > >> Best Regards, > >> CK > >> #8042 > >> > >> > >> -----Original Message----- > >> From: Robert Iakobashvili [mailto:cor...@gm...] > >> Sent: Tuesday, October 11, 2011 5:33 PM > >> To: curl-loader-devel > >> Subject: Re: HTTPS throughput too low > >> > >> Could you send me it zipped not rarred? > >> Thanks! > >> > >> On Tue, Oct 11, 2011 at 11:30 AM, CK Zhang <ck...@fo...> > wrote: > >>> Dear Robert > >>> > >>> Attached test log by command "./curl-loader -f https.conf -v" > >>> > >>> Best Regards, > >>> CK > >>> #8042 > >>> > >>> -----Original Message----- > >>> From: Robert Iakobashvili [mailto:cor...@gm...] > >>> Sent: Tuesday, October 11, 2011 5:19 PM > >>> To: curl-loader-devel > >>> Subject: Re: HTTPS throughput too low > >>> > >>> Dear CK Zhang, > >>> > >>> Can you run HTTPS sessions with -v detailed logging and say if > >>> you seen in logs something interesting. > >>> Thanks, > >>> Robert > >>> > >>> > >>> > >>> On Tue, Oct 11, 2011 at 11:14 AM, CK Zhang <ck...@fo...> > wrote: > >>>> Dear Robert > >>>> > >>>> > >>>> > >>>> Thanks a lot for your replay, > >>>> > >>>> > >>>> > >>>> Here are some answer about your questions > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> What happens if you try HTTP? Does it impact throughput? > >>>> > >>>> It is normal and perfect if I test with HTTP, The throughput can > reach > >> to > >>>> 950Mbps. > >>>> > >>>> > >>>> > >>>> Which tools you are using to measure throughput? > >>>> > >>>> There are 2 ways I used, > >>>> > >>>> 1 check the log summary form cur-loader like this” > >>>> Ti:5261372B/s,To:18375B/s” > >>>> > >>>> 2 check real time traffic speed on switch with connected test PC and > > HTTP > >>>> server > >>>> > >>>> > >>>> > >>>> What happens, if you try just to ftp some large file between the > >> machines? > >>>> > >>>> NO test > >>>> > >>>> What about CPU usage at both client and server? > >>>> > >>>> Both they are busy, about 80% > >>>> > >>>> Which HTTP server is in use? > >>>> > >>>> Apache/2.2.21 > >>>> > >>>> Have you looked into logs of curl-loader and your web-server? > >>>> > >>>> Checked log, not find abnormal issue. > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> Today, I used Loadrunner11 to simulate https traffic with same > >>> environments > >>>> (same apache server) , it can reach to 110Mpbs. But still only get > >>> 800kbps > >>>> with cur-loader. > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> Best Regards, > >>>> > >>>> CK > >>>> > >>>> #8042 > >>>> > >>>> > >>>> > >>>> From: Robert Iakobashvili [mailto:cor...@gm...] > >>>> Sent: Tuesday, September 27, 2011 1:19 PM > >>>> To: curl-loader-devel > >>>> Subject: Re: HTTPS throughput too low > >>>> > >>>> > >>>> > >>>> Dear CK Zhang, > >>>> > >>>> On Mon, Sep 26, 2011 at 5:01 AM, CK Zhang <ck...@fo...> > wrote: > >>>> > >>>> > >>>> > >>>> I want to get high https stream with curl loader, but the Https > >> throughput > >>>> is about 800kbps between two PC, Http throughput can reach 950Mbps in > >> that > >>> 2 > >>>> pcs, I do know if some have experience like this, and get a high https > >>>> throughput with curl-loader, Thanks for any supports and help!! > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> Here is my configuration: > >>>> > >>>> > >>>> > >>>> PC1:CPU Inter E2200, Mem 2G, 1000M NIC > >>>> > >>>> OpenSSL: > >>>> > >>>> openssl-devel-1.0.0-4.el6_0.2.x86_64 > >>>> > >>>> openssl-1.0.0-4.el6_0.2.x86_64 > >>>> > >>>> openssl-perl-1.0.0-4.el6_0.2.x86_64 > >>>> > >>>> > >>>> > >>>> curl-loader-0.53 > >>>> > >>>> ########### GENERAL SECTION > >>>> ################################ > >>>> > >>>> BATCH_NAME= Apach > >>>> > >>>> CLIENTS_NUM_MAX=400 > >>>> > >>>> CLIENTS_NUM_START=100 > >>>> > >>>> CLIENTS_RAMPUP_INC=10 > >>>> > >>>> INTERFACE =eth2 > >>>> > >>>> NETMASK=16 > >>>> > >>>> IP_ADDR_MIN= 172.16.76.150 > >>>> > >>>> IP_ADDR_MAX= 172.16.246.250 #Actually - this is for self-control > >>>> > >>>> CYCLES_NUM= -1 > >>>> > >>>> URLS_NUM= 1 > >>>> > >>>> > >>>> > >>>> ########### URL SECTION #################################### > >>>> > >>>> > >>>> > >>>> URL=https://172.16.76.142/was/100KB.txt # the size of 100KB.txt is > 100KB > >>>> > >>>> #URL=http://localhost/ACE-INSTALL.html > >>>> > >>>> URL_SHORT_NAME="local-index" > >>>> > >>>> REQUEST_TYPE=GET > >>>> > >>>> TIMER_URL_COMPLETION = 0 # In msec. When positive, Now it is > >> enforced > >>>> by cancelling url fetch on timeout > >>>> > >>>> TIMER_AFTER_URL_SLEEP =1000 > >>>> > >>>> ~ > >>>> > >>>> > >>>> > >>>> PC2. Works as Webserver,CPU Intel E7600,Mem 4G, 1000M NIC > >>>> > >>>> Server version: Apache/2.2.21 (Unix) > >>>> > >>>> Server built: Sep 21 2011 16:19:43 > >>>> > >>>> openssl-devel-1.0.0-4.el6_0.2.x86_64 > >>>> > >>>> openssl-1.0.0-4.el6_0.2.x86_64 > >>>> > >>>> openssl-perl-1.0.0-4.el6_0.2.x86_64 > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> Interesting. > >>>> > >>>> > >>>> > >>>> What happens if you try HTTP? Does it impact throughput? > >>>> > >>>> > >>>> > >>>> Which tools you are using to measure throughput? > >>>> > >>>> > >>>> > >>>> What happens, if you try just to ftp some large file between the > >> machines? > >>>> > >>>> > >>>> > >>>> What about CPU usage at both client and server? > >>>> > >>>> Which HTTP server is in use? > >>>> > >>>> > >>>> > >>>> Have you looked into logs of curl-loader and your web-server? > >>>> > >>>> > >>>> > >>>> -- > >>>> Regards, > >>>> Robert Iakobashvili, Ph.D. > >>>> > >>>> > >>>> > >>>> Home: http://www.ghotit.com > >>>> > >>>> Blog: http://dyslexia-blog.ghotit.com > >>>> > >>>> Twitter: http://twitter.com/ghotit > >>>> > >>>> Facebook: http://facebook.com/ghotit > >>>> > >>>> ...................................................................... > >>>> > >>>> Ghotit Dyslexia > >>>> > >>>> Assistive technology that understands you > >>>> > >>>> ...................................................................... > >>>> > >>>> > >>>> > >>>> ________________________________ > >>>> > >>>> *** Please note that this message and any attachments may contain > >>>> confidential > >>>> and proprietary material and information and are intended only for the > >> use > >>>> of > >>>> the intended recipient(s). If you are not the intended recipient, you > > are > >>>> hereby > >>>> notified that any review, use, disclosure, dissemination, distribution > > or > >>>> copying > >>>> of this message and any attachments is strictly prohibited. If you > have > >>>> received > >>>> this email in error, please immediately notify the sender and destroy > >> this > >>>> e-mail > >>>> and any attachments and all copies, whether electronic or printed. > >>>> Please also note that any views, opinions, conclusions or commitments > >>>> expressed > >>>> in this message are those of the individual sender and do not > > necessarily > >>>> reflect > >>>> the views of Fortinet, Inc., its affiliates, and emails are not > binding > >> on > >>>> Fortinet and only a writing manually signed by Fortinet's General > > Counsel > >>>> can be > >>>> a binding commitment of Fortinet to Fortinet's customers or partners. > >>> Thank > >>>> you. *** > >>>> > >>>> ________________________________ > >>>> > >>>> > >>> > >> > > > ---------------------------------------------------------------------------- > >>> -- > >>>> All the data continuously generated in your IT infrastructure > contains a > >>>> definitive record of customers, application performance, security > >>>> threats, fraudulent activity and more. Splunk takes this data and > makes > >>>> sense of it. Business sense. IT sense. Common sense. > >>>> http://p.sf.net/sfu/splunk-d2d-oct > >>>> _______________________________________________ > >>>> curl-loader-devel mailing list > >>>> cur...@li... > >>>> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >>>> > >>>> > >>> > >>> > >>> > >>> -- > >>> Regards, > >>> Robert Iakobashvili, Ph.D. > >>> > >>> Home: http://www.ghotit.com > >>> Blog: http://dyslexia-blog.ghotit.com > >>> Twitter: http://twitter.com/ghotit > >>> Facebook: http://facebook.com/ghotit > >>> ...................................................................... > >>> Ghotit Dyslexia > >>> Assistive technology that understands you > >>> ...................................................................... > >>> > >>> > >> > > > ---------------------------------------------------------------------------- > >>> -- > >>> All the data continuously generated in your IT infrastructure contains > a > >>> definitive record of customers, application performance, security > >>> threats, fraudulent activity and more. Splunk takes this data and makes > >>> sense of it. Business sense. IT sense. Common sense. > >>> http://p.sf.net/sfu/splunk-d2d-oct > >>> _______________________________________________ > >>> curl-loader-devel mailing list > >>> cur...@li... > >>> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >>> > >>> > >>> *** Please note that this message and any attachments may contain > >> confidential > >>> and proprietary material and information and are intended only for the > > use > >> of > >>> the intended recipient(s). If you are not the intended recipient, you > are > >> hereby > >>> notified that any review, use, disclosure, dissemination, distribution > or > >> copying > >>> of this message and any attachments is strictly prohibited. If you have > >> received > >>> this email in error, please immediately notify the sender and destroy > > this > >> e-mail > >>> and any attachments and all copies, whether electronic or printed. > >>> Please also note that any views, opinions, conclusions or commitments > >> expressed > >>> in this message are those of the individual sender and do not > necessarily > >> reflect > >>> the views of Fortinet, Inc., its affiliates, and emails are not binding > > on > >>> Fortinet and only a writing manually signed by Fortinet's General > Counsel > >> can be > >>> a binding commitment of Fortinet to Fortinet's customers or partners. > >> Thank you. *** > >>> > >>> > >> > > > ---------------------------------------------------------------------------- > >> -- > >>> All the data continuously generated in your IT infrastructure contains > a > >>> definitive record of customers, application performance, security > >>> threats, fraudulent activity and more. Splunk takes this data and makes > >>> sense of it. Business sense. IT sense. Common sense. > >>> http://p.sf.net/sfu/splunk-d2d-oct > >>> _______________________________________________ > >>> curl-loader-devel mailing list > >>> cur...@li... > >>> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >>> > >>> > >> > >> > >> > >> -- > >> Regards, > >> Robert Iakobashvili, Ph.D. > >> > >> Home: http://www.ghotit.com > >> Blog: http://dyslexia-blog.ghotit.com > >> Twitter: http://twitter.com/ghotit > >> Facebook: http://facebook.com/ghotit > >> ...................................................................... > >> Ghotit Dyslexia > >> Assistive technology that understands you > >> ...................................................................... > >> > >> > > > ---------------------------------------------------------------------------- > >> -- > >> All the data continuously generated in your IT infrastructure contains a > >> definitive record of customers, application performance, security > >> threats, fraudulent activity and more. Splunk takes this data and makes > >> sense of it. Business sense. IT sense. Common sense. > >> http://p.sf.net/sfu/splunk-d2d-oct > >> _______________________________________________ > >> curl-loader-devel mailing list > >> cur...@li... > >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >> > >> > >> *** Please note that this message and any attachments may contain > > confidential > >> and proprietary material and information and are intended only for the > use > > of > >> the intended recipient(s). If you are not the intended recipient, you > are > > hereby > >> notified that any review, use, disclosure, dissemination, distribution > or > > copying > >> of this message and any attachments is strictly prohibited. If you have > > received > >> this email in error, please immediately notify the sender and destroy > this > > e-mail > >> and any attachments and all copies, whether electronic or printed. > >> Please also note that any views, opinions, conclusions or commitments > > expressed > >> in this message are those of the individual sender and do not > necessarily > > reflect > >> the views of Fortinet, Inc., its affiliates, and emails are not binding > on > >> Fortinet and only a writing manually signed by Fortinet's General > Counsel > > can be > >> a binding commitment of Fortinet to Fortinet's customers or partners. > > Thank you. *** > >> > >> > > > ---------------------------------------------------------------------------- > > -- > >> All the data continuously generated in your IT infrastructure contains a > >> definitive record of customers, application performance, security > >> threats, fraudulent activity and more. Splunk takes this data and makes > >> sense of it. Business sense. IT sense. Common sense. > >> http://p.sf.net/sfu/splunk-d2d-oct > >> _______________________________________________ > >> curl-loader-devel mailing list > >> cur...@li... > >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >> > >> > > > > > > > > -- > > Regards, > > Robert Iakobashvili, Ph.D. > > > > Home: http://www.ghotit.com > > Blog: http://dyslexia-blog.ghotit.com > > Twitter: http://twitter.com/ghotit > > Facebook: http://facebook.com/ghotit > > ...................................................................... > > Ghotit Dyslexia > > Assistive technology that understands you > > ...................................................................... > > > > > ---------------------------------------------------------------------------- > > -- > > All the data continuously generated in your IT infrastructure contains a > > definitive record of customers, application performance, security > > threats, fraudulent activity and more. Splunk takes this data and makes > > sense of it. Business sense. IT sense. Common sense. > > http://p.sf.net/sfu/splunk-d2d-oct > > _______________________________________________ > > curl-loader-devel mailing list > > cur...@li... > > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > > > > > *** Please note that this message and any attachments may contain > confidential > > and proprietary material and information and are intended only for the > use of > > the intended recipient(s). If you are not the intended recipient, you > are hereby > > notified that any review, use, disclosure, dissemination, distribution > or copying > > of this message and any attachments is strictly prohibited. If you have > received > > this email in error, please immediately notify the sender and destroy > this e-mail > > and any attachments and all copies, whether electronic or printed. > > Please also note that any views, opinions, conclusions or commitments > expressed > > in this message are those of the individual sender and do not > necessarily reflect > > the views of Fortinet, Inc., its affiliates, and emails are not binding > on > > Fortinet and only a writing manually signed by Fortinet's General > Counsel can be > > a binding commitment of Fortinet to Fortinet's customers or partners. > Thank you. *** > > > > > ------------------------------------------------------------------------------ > > All the data continuously generated in your IT infrastructure contains a > > definitive record of customers, application performance, security > > threats, fraudulent activity and more. Splunk takes this data and makes > > sense of it. Business sense. IT sense. Common sense. > > http://p.sf.net/sfu/splunk-d2d-oct > > _______________________________________________ > > curl-loader-devel mailing list > > cur...@li... > > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > > > > > > > -- > Regards, > Robert Iakobashvili, Ph.D. > > Home: http://www.ghotit.com > Blog: http://dyslexia-blog.ghotit.com > Twitter: http://twitter.com/ghotit > Facebook: http://facebook.com/ghotit > ...................................................................... > Ghotit Dyslexia > Assistive technology that understands you > ...................................................................... > > > ------------------------------------------------------------------------------ > All the data continuously generated in your IT infrastructure contains a > definitive record of customers, application performance, security > threats, fraudulent activity and more. Splunk takes this data and makes > sense of it. Business sense. IT sense. Common sense. > http://p.sf.net/sfu/splunk-d2d-oct > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > |
|
From: Dhiraj L. <dhi...@gm...> - 2012-08-08 15:30:10
|
Hi I'm wondering if there is a way (tag or any other option) to specify the cipher to be used for https requests? Something similar to curl --cipher option would be great. Any help will be appreciated Thanks --dhiraj |
|
From: pankaj s. <pan...@gm...> - 2012-07-25 05:59:33
|
Hi Experts, I have created one html page and submitting some form on load of the page. This work fine while accessed directly through browser. And does not work while run through curl-loader -f ./10K.conf . Page does not submit the form. looks like java can not be understood curl-loader command line. Any help appreciated here. With Regards Pankaj Kumar |
|
From: Ciaran M. <cmc...@gm...> - 2012-07-23 15:53:48
|
Hi Robert, Sorry for the late response. I initially looked at this - I think I've perhaps misunderstood it's functionality, but it looks as though I could use this - I'll take another look at it. In the end, I was able to achieve what I wanted using the URL_RANDOM_RANGE functionality which complements the server-side random byte generator nicely. Thanks again! Ciaran. -----Original Message----- From: Robert Iakobashvili [mailto:cor...@gm...] Sent: 28 June 2012 12:25 To: curl-loader-devel Subject: Re: Simultaenous URL request Dear Ciaran, Look at URL-probabality feature in README. Regards, Robert On Wed, Jun 27, 2012 at 8:24 PM, Ciaran McCrisken <cmc...@gm...> wrote: > Hi, > > > > Curlloader is a great piece of software keep up the good work! > > > > I was wondering if its possible to fetch a list of URLS simultaneously? I > have a script that automates the generation of large amounts of URLs. Im > looking to transfer a known amount of unique data and a known throughput via > a proxy device. > > > > At the moment, Curlloader processes each URL sequentially for each Client. > Id like it to download each URL for each specified Client, once. > > > > E.g. > > > > ########## GENERAL SECTION ########## > > BATCH_NAME=sim_get > > CLIENTS_NUM_MAX=1000 > > CLIENTS_NUM_START=1000 > > CLIENTS_RAMPUP_INC=1 > > INTERFACE=eth0 > > NETMASK=255.255.224.0 > > IP_ADDR_MIN=172.16.47.100 > > IP_ADDR_MAX=172.16.47.100 > > CYCLES_NUM=1 > > URLS_NUM=1 > > > > ########## URLs SECTION ############# > > > > URL=http://172.16.62.110/cgi-bin/bytegenerator?size=100&seed=1 > > URL_SHORT_NAME="1" > > REQUEST_TYPE=GET > > TRANSFER_LIMIT_RATE=1000 > > > > URL=http://172.16.62.110/cgi-bin/bytegenerator?size=100&seed=2 > > URL_SHORT_NAME="2" > > REQUEST_TYPE=GET > > TRANSFER_LIMIT_RATE=1000 > > > > URL=http://172.16.62.110/cgi-bin/bytegenerator?size=100&seed=3 > > URL_SHORT_NAME="3" > > REQUEST_TYPE=GET > > TRANSFER_LIMIT_RATE=1000 > > > > .. > > .. > > .. > > > > URL=http://172.16.62.110/cgi-bin/bytegenerator?size=100&seed=1000 > > URL_SHORT_NAME="1000" > > REQUEST_TYPE=GET > > TRANSFER_LIMIT_RATE=1000 > > > > Thanks and regards! > > > ---------------------------------------------------------------------------- -- > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > -- Regards, Robert Iakobashvili, Ph.D. Home: http://www.ghotit.com Blog: http://www.ghotit.com/category/ghotit-blogs/ Twitter: http://twitter.com/ghotit Facebook: http://facebook.com/ghotit ...................................................................... Ghotit Dyslexia Assistive technology that understands you ...................................................................... ---------------------------------------------------------------------------- -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ _______________________________________________ curl-loader-devel mailing list cur...@li... https://lists.sourceforge.net/lists/listinfo/curl-loader-devel |
|
From: Robert I. <cor...@gm...> - 2012-07-11 18:01:27
|
Such behavior is the default. On Wed, Jul 11, 2012 at 8:37 PM, pankaj sharma <pan...@gm...> wrote: > Hi, > > I am not seeing these errors at command prompt of curl loader. I am seeing > these error while access the same page through any Browser. > > Suppose i have a page https://cust3.psc.com/index.html. so run a test i have > configured batch script 10k.conf like below: > > ########### GENERAL SECTION ################################ > BATCH_NAME= 10K > CLIENTS_NUM_MAX=80 > CLIENTS_NUM_START=80 > CLIENTS_RAMPUP_INC=80 > CLIENTS_RAMPUP_INC=5 > INTERFACE =eth2 > NETMASK=16 > USER_AGENT= "Mozilla/5.0 (X11; Linux i686; rv:12.0) Gecko/20100101 > Firefox/12.0" > IP_ADDR_MIN= 192.168.200.21 > IP_ADDR_MAX= 192.168.200.100 #Actually - this is for self-control > CYCLES_NUM= -1 > URLS_NUM= 1 > > ########### URL SECTION #################################### > > URL=https://cust3.eng.sonicwall.com/index.html > URL_SHORT_NAME="cust3.psc.com" > REQUEST_TYPE=GET > TIMER_URL_COMPLETION = 5000 # In msec. When positive, Now it is > enforced by cancelling url fetch on timeout > TIMER_AFTER_URL_SLEEP =20 > > and running the test curl-loader -f ./10K.conf > > So here i am assuming that the script does not load the original page. It > just loaded the page up to SSL self signed certificate warning message. > > actually here i want to curl-loaded to load the index.html page and ignore > the ssl certificate warning message. > > > Thanks > Pankaj > > On Wed, Jul 11, 2012 at 3:30 PM, divfor <di...@gm...> wrote: >> >> Did you use curl other than curl-loader? >> By default curl-loader ignore the warnings. >> >> For curl to ignore it, see curl's man pages. >> >> Sent from mobile >> >> 在 2012-7-11，12:44，pankaj sharma <pan...@gm...> 写道： >> >> Hi Guys, >> >> Sorry guys. I think i have replied some existing email. how can be ignore >> self signed certificate warning while running a HTTPS test? >> >> suppose 10k.conf configured like: >> URL=https://cust3.psc.com/index.html and test is started like curl-loader >> -f ./10k.conf >> So my site " https://cust3.psc.com " has self signed certificate and gives >> a warning while accessing this. How can i ignore these warning using curl to >> run a test to access this page. >> >> With Regards >> Pankaj >> >> On Tue, Jul 10, 2012 at 8:23 PM, Robert Iakobashvili <cor...@gm...> >> wrote: >>> >>> Hi Pankaj, >>> >>> It seems that the subject of your e-mail is not correct. >>> Please, provide a meaningful subject. >>> >>> libcurl API indeed provides means to relax SSL requirements >>> and not to alert users on self-signed certificates. >>> >>> Could you provide more details, please? >>> When do you seen the below message >>> >>> On Mon, Jul 9, 2012 at 11:38 AM, pankaj sharma <pan...@gm...> >>> wrote: >>> > Hi Experts, >>> > >>> > Is there any way to ignore pad lock warning message using curl-loader >>> > while >>> > accessing a ssl site? I mean when we configure a web site using self >>> > signed >>> > certificate then it displays a pad lock message on to the browser like >>> > below: >>> > >>> > "We recommend that you close this webpage and do not continue to this >>> > website. >>> > Click here to close this webpage. >>> > Continue to this website (not recommended). >>> > More information" >>> > >>> > can we ignore this message while lauching the test for a ssl site using >>> > curl-loader? >>> > >>> > Thanks & Regards >>> > Pankaj >>> > >>> > On Mon, Jul 9, 2012 at 1:55 PM, Neil Croft <in...@ma...> >>> > wrote: >>> >>>> >>> >>>> Hi, >>> >>>> >>> >>>> Wonder if you can assist im looking to switch mobile user-agents in >>> >>>> curl-loader requests so that i can test a mobile piwik plugin i >>> >>>> wrote. is >>> >>>> this possible? >>> >>>> im trying to call the following url >>> >>>> http://stats.mahalamobile.co.za/piwik.php?idsite=1&rec=1 i have >>> >>>> tried the >>> >>>> get and post but cant seem to get piwik to find the impression? >>> >>>> any ideas? >>> >>>> >>> >>>> thanks >>> >>>> Regards, >>> >>>> Neil Croft >>> >>> >>> >>> >>> >> >>> >> >>> >> >>> >> >>> >> ------------------------------------------------------------------------------ >>> >> Live Security Virtual Conference >>> >> Exclusive live event will cover all the ways today's security and >>> >> threat landscape has changed and how IT managers can respond. >>> >> Discussions >>> >> will include endpoint security, mobile security and the latest in >>> >> malware >>> >> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ >>> >> _______________________________________________ >>> >> curl-loader-devel mailing list >>> >> cur...@li... >>> >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >>> >> >>> > >>> > >>> > >>> > ------------------------------------------------------------------------------ >>> > Live Security Virtual Conference >>> > Exclusive live event will cover all the ways today's security and >>> > threat landscape has changed and how IT managers can respond. >>> > Discussions >>> > will include endpoint security, mobile security and the latest in >>> > malware >>> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ >>> > _______________________________________________ >>> > curl-loader-devel mailing list >>> > cur...@li... >>> > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >>> > >>> >>> >>> >>> -- >>> Regards, >>> Robert Iakobashvili, Ph.D. >>> >>> Home: http://www.ghotit.com >>> Blog: http://www.ghotit.com/category/ghotit-blogs/ >>> Twitter: http://twitter.com/ghotit >>> Facebook: http://facebook.com/ghotit >>> ...................................................................... >>> Ghotit Dyslexia >>> Assistive technology that understands you >>> ...................................................................... >>> >>> >>> ------------------------------------------------------------------------------ >>> Live Security Virtual Conference >>> Exclusive live event will cover all the ways today's security and >>> threat landscape has changed and how IT managers can respond. Discussions >>> will include endpoint security, mobile security and the latest in malware >>> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ >>> _______________________________________________ >>> curl-loader-devel mailing list >>> cur...@li... >>> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >> >> >> ------------------------------------------------------------------------------ >> Live Security Virtual Conference >> Exclusive live event will cover all the ways today's security and >> threat landscape has changed and how IT managers can respond. Discussions >> will include endpoint security, mobile security and the latest in malware >> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ >> >> _______________________________________________ >> curl-loader-devel mailing list >> cur...@li... >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >> >> >> ------------------------------------------------------------------------------ >> Live Security Virtual Conference >> Exclusive live event will cover all the ways today's security and >> threat landscape has changed and how IT managers can respond. Discussions >> will include endpoint security, mobile security and the latest in malware >> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ >> _______________________________________________ >> curl-loader-devel mailing list >> cur...@li... >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> > > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > -- Regards, Robert Iakobashvili, Ph.D. Home: http://www.ghotit.com Blog: http://www.ghotit.com/category/ghotit-blogs/ Twitter: http://twitter.com/ghotit Facebook: http://facebook.com/ghotit ...................................................................... Ghotit Dyslexia Assistive technology that understands you ...................................................................... |
|
From: pankaj s. <pan...@gm...> - 2012-07-11 17:38:12
|
Hi, I am not seeing these errors at command prompt of curl loader. I am seeing these error while access the same page through any Browser. Suppose i have a page https://cust3.psc.com/index.html. so run a test i have configured batch script 10k.conf like below: ########### GENERAL SECTION ################################ BATCH_NAME= 10K CLIENTS_NUM_MAX=80 CLIENTS_NUM_START=80 CLIENTS_RAMPUP_INC=80 CLIENTS_RAMPUP_INC=5 INTERFACE =eth2 NETMASK=16 USER_AGENT= "Mozilla/5.0 (X11; Linux i686; rv:12.0) Gecko/20100101 Firefox/12.0" IP_ADDR_MIN= 192.168.200.21 IP_ADDR_MAX= 192.168.200.100 #Actually - this is for self-control CYCLES_NUM= -1 URLS_NUM= 1 ########### URL SECTION #################################### URL=https://cust3.eng.sonicwall.com/index.html URL_SHORT_NAME="cust3.psc.com" REQUEST_TYPE=GET TIMER_URL_COMPLETION = 5000 # In msec. When positive, Now it is enforced by cancelling url fetch on timeout TIMER_AFTER_URL_SLEEP =20 and running the test curl-loader -f ./10K.conf So here i am assuming that the script does not load the original page. It just loaded the page up to SSL self signed certificate warning message. actually here i want to curl-loaded to load the index.html page and ignore the ssl certificate warning message. Thanks Pankaj On Wed, Jul 11, 2012 at 3:30 PM, divfor <di...@gm...> wrote: > Did you use curl other than curl-loader? > By default curl-loader ignore the warnings. > > For curl to ignore it, see curl's man pages. > > Sent from mobile > > 在 2012-7-11，12:44，pankaj sharma <pan...@gm...> 写道： > > Hi Guys, > > Sorry guys. I think i have replied some existing email. how can be ignore > self signed certificate warning while running a HTTPS test? > > suppose 10k.conf configured like: > URL=https://cust3.psc.com/index.html and test is started like curl-loader > -f ./10k.conf > So my site " https://cust3.psc.com " has self signed certificate and > gives a warning while accessing this. How can i ignore these warning using > curl to run a test to access this page. > > With Regards > Pankaj > > On Tue, Jul 10, 2012 at 8:23 PM, Robert Iakobashvili <cor...@gm...>wrote: > >> Hi Pankaj, >> >> It seems that the subject of your e-mail is not correct. >> Please, provide a meaningful subject. >> >> libcurl API indeed provides means to relax SSL requirements >> and not to alert users on self-signed certificates. >> >> Could you provide more details, please? >> When do you seen the below message >> >> On Mon, Jul 9, 2012 at 11:38 AM, pankaj sharma <pan...@gm...> >> wrote: >> > Hi Experts, >> > >> > Is there any way to ignore pad lock warning message using curl-loader >> while >> > accessing a ssl site? I mean when we configure a web site using self >> signed >> > certificate then it displays a pad lock message on to the browser like >> > below: >> > >> > "We recommend that you close this webpage and do not continue to this >> > website. >> > Click here to close this webpage. >> > Continue to this website (not recommended). >> > More information" >> > >> > can we ignore this message while lauching the test for a ssl site using >> > curl-loader? >> > >> > Thanks & Regards >> > Pankaj >> > >> > On Mon, Jul 9, 2012 at 1:55 PM, Neil Croft <in...@ma...> >> wrote: >> >>>> >> >>>> Hi, >> >>>> >> >>>> Wonder if you can assist im looking to switch mobile user-agents in >> >>>> curl-loader requests so that i can test a mobile piwik plugin i >> wrote. is >> >>>> this possible? >> >>>> im trying to call the following url >> >>>> http://stats.mahalamobile.co.za/piwik.php?idsite=1&rec=1 i have >> tried the >> >>>> get and post but cant seem to get piwik to find the impression? >> >>>> any ideas? >> >>>> >> >>>> thanks >> >>>> Regards, >> >>>> Neil Croft >> >>> >> >>> >> >> >> >> >> >> >> >> >> ------------------------------------------------------------------------------ >> >> Live Security Virtual Conference >> >> Exclusive live event will cover all the ways today's security and >> >> threat landscape has changed and how IT managers can respond. >> Discussions >> >> will include endpoint security, mobile security and the latest in >> malware >> >> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ >> >> _______________________________________________ >> >> curl-loader-devel mailing list >> >> cur...@li... >> >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> >> >> > >> > >> > >> ------------------------------------------------------------------------------ >> > Live Security Virtual Conference >> > Exclusive live event will cover all the ways today's security and >> > threat landscape has changed and how IT managers can respond. >> Discussions >> > will include endpoint security, mobile security and the latest in >> malware >> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ >> > _______________________________________________ >> > curl-loader-devel mailing list >> > cur...@li... >> > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> > >> >> >> >> -- >> Regards, >> Robert Iakobashvili, Ph.D. >> >> Home: http://www.ghotit.com >> Blog: http://www.ghotit.com/category/ghotit-blogs/ >> Twitter: http://twitter.com/ghotit >> Facebook: http://facebook.com/ghotit >> ...................................................................... >> Ghotit Dyslexia >> Assistive technology that understands you >> ...................................................................... >> >> >> ------------------------------------------------------------------------------ >> Live Security Virtual Conference >> Exclusive live event will cover all the ways today's security and >> threat landscape has changed and how IT managers can respond. Discussions >> will include endpoint security, mobile security and the latest in malware >> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ >> _______________________________________________ >> curl-loader-devel mailing list >> cur...@li... >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel >> > > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > |
|
From: divfor <di...@gm...> - 2012-07-11 10:00:46
|
Did you use curl other than curl-loader? By default curl-loader ignore the warnings. For curl to ignore it, see curl's man pages. Sent from mobile 在 2012-7-11，12:44，pankaj sharma <pan...@gm...> 写道： > Hi Guys, > > Sorry guys. I think i have replied some existing email. how can be ignore self signed certificate warning while running a HTTPS test? > > suppose 10k.conf configured like: > URL=https://cust3.psc.com/index.html and test is started like curl-loader -f ./10k.conf > So my site " https://cust3.psc.com " has self signed certificate and gives a warning while accessing this. How can i ignore these warning using curl to run a test to access this page. > > With Regards > Pankaj > > On Tue, Jul 10, 2012 at 8:23 PM, Robert Iakobashvili <cor...@gm...> wrote: > Hi Pankaj, > > It seems that the subject of your e-mail is not correct. > Please, provide a meaningful subject. > > libcurl API indeed provides means to relax SSL requirements > and not to alert users on self-signed certificates. > > Could you provide more details, please? > When do you seen the below message > > On Mon, Jul 9, 2012 at 11:38 AM, pankaj sharma <pan...@gm...> wrote: > > Hi Experts, > > > > Is there any way to ignore pad lock warning message using curl-loader while > > accessing a ssl site? I mean when we configure a web site using self signed > > certificate then it displays a pad lock message on to the browser like > > below: > > > > "We recommend that you close this webpage and do not continue to this > > website. > > Click here to close this webpage. > > Continue to this website (not recommended). > > More information" > > > > can we ignore this message while lauching the test for a ssl site using > > curl-loader? > > > > Thanks & Regards > > Pankaj > > > > On Mon, Jul 9, 2012 at 1:55 PM, Neil Croft <in...@ma...> wrote: > >>>> > >>>> Hi, > >>>> > >>>> Wonder if you can assist im looking to switch mobile user-agents in > >>>> curl-loader requests so that i can test a mobile piwik plugin i wrote. is > >>>> this possible? > >>>> im trying to call the following url > >>>> http://stats.mahalamobile.co.za/piwik.php?idsite=1&rec=1 i have tried the > >>>> get and post but cant seem to get piwik to find the impression? > >>>> any ideas? > >>>> > >>>> thanks > >>>> Regards, > >>>> Neil Croft > >>> > >>> > >> > >> > >> > >> ------------------------------------------------------------------------------ > >> Live Security Virtual Conference > >> Exclusive live event will cover all the ways today's security and > >> threat landscape has changed and how IT managers can respond. Discussions > >> will include endpoint security, mobile security and the latest in malware > >> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > >> _______________________________________________ > >> curl-loader-devel mailing list > >> cur...@li... > >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >> > > > > > > ------------------------------------------------------------------------------ > > Live Security Virtual Conference > > Exclusive live event will cover all the ways today's security and > > threat landscape has changed and how IT managers can respond. Discussions > > will include endpoint security, mobile security and the latest in malware > > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > > _______________________________________________ > > curl-loader-devel mailing list > > cur...@li... > > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > > > > > -- > Regards, > Robert Iakobashvili, Ph.D. > > Home: http://www.ghotit.com > Blog: http://www.ghotit.com/category/ghotit-blogs/ > Twitter: http://twitter.com/ghotit > Facebook: http://facebook.com/ghotit > ...................................................................... > Ghotit Dyslexia > Assistive technology that understands you > ...................................................................... > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel |
|
From: divfor <di...@gm...> - 2012-07-11 09:58:37
|
where do you see the warnings? Sent from mobile 在 2012-7-11，12:44，pankaj sharma <pan...@gm...> 写道： > Hi Guys, > > Sorry guys. I think i have replied some existing email. how can be ignore self signed certificate warning while running a HTTPS test? > > suppose 10k.conf configured like: > URL=https://cust3.psc.com/index.html and test is started like curl-loader -f ./10k.conf > So my site " https://cust3.psc.com " has self signed certificate and gives a warning while accessing this. How can i ignore these warning using curl to run a test to access this page. > > With Regards > Pankaj > > On Tue, Jul 10, 2012 at 8:23 PM, Robert Iakobashvili <cor...@gm...> wrote: > Hi Pankaj, > > It seems that the subject of your e-mail is not correct. > Please, provide a meaningful subject. > > libcurl API indeed provides means to relax SSL requirements > and not to alert users on self-signed certificates. > > Could you provide more details, please? > When do you seen the below message > > On Mon, Jul 9, 2012 at 11:38 AM, pankaj sharma <pan...@gm...> wrote: > > Hi Experts, > > > > Is there any way to ignore pad lock warning message using curl-loader while > > accessing a ssl site? I mean when we configure a web site using self signed > > certificate then it displays a pad lock message on to the browser like > > below: > > > > "We recommend that you close this webpage and do not continue to this > > website. > > Click here to close this webpage. > > Continue to this website (not recommended). > > More information" > > > > can we ignore this message while lauching the test for a ssl site using > > curl-loader? > > > > Thanks & Regards > > Pankaj > > > > On Mon, Jul 9, 2012 at 1:55 PM, Neil Croft <in...@ma...> wrote: > >>>> > >>>> Hi, > >>>> > >>>> Wonder if you can assist im looking to switch mobile user-agents in > >>>> curl-loader requests so that i can test a mobile piwik plugin i wrote. is > >>>> this possible? > >>>> im trying to call the following url > >>>> http://stats.mahalamobile.co.za/piwik.php?idsite=1&rec=1 i have tried the > >>>> get and post but cant seem to get piwik to find the impression? > >>>> any ideas? > >>>> > >>>> thanks > >>>> Regards, > >>>> Neil Croft > >>> > >>> > >> > >> > >> > >> ------------------------------------------------------------------------------ > >> Live Security Virtual Conference > >> Exclusive live event will cover all the ways today's security and > >> threat landscape has changed and how IT managers can respond. Discussions > >> will include endpoint security, mobile security and the latest in malware > >> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > >> _______________________________________________ > >> curl-loader-devel mailing list > >> cur...@li... > >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >> > > > > > > ------------------------------------------------------------------------------ > > Live Security Virtual Conference > > Exclusive live event will cover all the ways today's security and > > threat landscape has changed and how IT managers can respond. Discussions > > will include endpoint security, mobile security and the latest in malware > > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > > _______________________________________________ > > curl-loader-devel mailing list > > cur...@li... > > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > > > > > -- > Regards, > Robert Iakobashvili, Ph.D. > > Home: http://www.ghotit.com > Blog: http://www.ghotit.com/category/ghotit-blogs/ > Twitter: http://twitter.com/ghotit > Facebook: http://facebook.com/ghotit > ...................................................................... > Ghotit Dyslexia > Assistive technology that understands you > ...................................................................... > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel |
|
From: pankaj s. <pan...@gm...> - 2012-07-11 04:44:30
|
Hi Guys, Sorry guys. I think i have replied some existing email. how can be ignore self signed certificate warning while running a HTTPS test? suppose 10k.conf configured like: URL=https://cust3.psc.com/index.html and test is started like curl-loader -f ./10k.conf So my site " https://cust3.psc.com " has self signed certificate and gives a warning while accessing this. How can i ignore these warning using curl to run a test to access this page. With Regards Pankaj On Tue, Jul 10, 2012 at 8:23 PM, Robert Iakobashvili <cor...@gm...>wrote: > Hi Pankaj, > > It seems that the subject of your e-mail is not correct. > Please, provide a meaningful subject. > > libcurl API indeed provides means to relax SSL requirements > and not to alert users on self-signed certificates. > > Could you provide more details, please? > When do you seen the below message > > On Mon, Jul 9, 2012 at 11:38 AM, pankaj sharma <pan...@gm...> > wrote: > > Hi Experts, > > > > Is there any way to ignore pad lock warning message using curl-loader > while > > accessing a ssl site? I mean when we configure a web site using self > signed > > certificate then it displays a pad lock message on to the browser like > > below: > > > > "We recommend that you close this webpage and do not continue to this > > website. > > Click here to close this webpage. > > Continue to this website (not recommended). > > More information" > > > > can we ignore this message while lauching the test for a ssl site using > > curl-loader? > > > > Thanks & Regards > > Pankaj > > > > On Mon, Jul 9, 2012 at 1:55 PM, Neil Croft <in...@ma...> > wrote: > >>>> > >>>> Hi, > >>>> > >>>> Wonder if you can assist im looking to switch mobile user-agents in > >>>> curl-loader requests so that i can test a mobile piwik plugin i > wrote. is > >>>> this possible? > >>>> im trying to call the following url > >>>> http://stats.mahalamobile.co.za/piwik.php?idsite=1&rec=1 i have > tried the > >>>> get and post but cant seem to get piwik to find the impression? > >>>> any ideas? > >>>> > >>>> thanks > >>>> Regards, > >>>> Neil Croft > >>> > >>> > >> > >> > >> > >> > ------------------------------------------------------------------------------ > >> Live Security Virtual Conference > >> Exclusive live event will cover all the ways today's security and > >> threat landscape has changed and how IT managers can respond. > Discussions > >> will include endpoint security, mobile security and the latest in > malware > >> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > >> _______________________________________________ > >> curl-loader-devel mailing list > >> cur...@li... > >> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > >> > > > > > > > ------------------------------------------------------------------------------ > > Live Security Virtual Conference > > Exclusive live event will cover all the ways today's security and > > threat landscape has changed and how IT managers can respond. Discussions > > will include endpoint security, mobile security and the latest in malware > > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > > _______________________________________________ > > curl-loader-devel mailing list > > cur...@li... > > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > > > > > > -- > Regards, > Robert Iakobashvili, Ph.D. > > Home: http://www.ghotit.com > Blog: http://www.ghotit.com/category/ghotit-blogs/ > Twitter: http://twitter.com/ghotit > Facebook: http://facebook.com/ghotit > ...................................................................... > Ghotit Dyslexia > Assistive technology that understands you > ...................................................................... > > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > curl-loader-devel mailing list > cur...@li... > https://lists.sourceforge.net/lists/listinfo/curl-loader-devel > |
|
From: Graham B. <bi...@gm...> - 2012-07-10 15:04:54
|
On Tue, Jul 10, 2012 at 10:53 AM, Robert Iakobashvili <cor...@gm...> wrote: > Could you provide more details, please? > When do you seen the below message >> "We recommend that you close this webpage and do not continue to this >> website. This is a client side message displayed by the browser when connecting to a SSL site that doesn't have a trusted root cert. It isn't relevant to curl-loader unless you want to simulate a large group of people connecting to a site with a self-signed certificate. //Graham |
25 messages has been excluded from this view by a project administrator.
