curl-loader-devel — curl-loader usage and development issues

Re: Help curl-loader: proxy authentication multiple users

[Robert I. <cor...@gm...>]

Hi WP,

On Wed, Mar 3, 2010 at 3:56 PM, 王鹏 <sjz...@gm...> wrote:

> Hi Everyone,
>
> I get a question about authenticate mutiple users to an explicit proxy. I
> don't know how curl-loader specify username and password from conf file so
> that I can proxy auth with multiple users instead of only set one user
> credential in the tag PROXY_AUTH_CREDENTIALS
>
> FAQ does not mention that scenario, looks like it only have config for
> forms, such as FORM_USAGE_TYPE= "RECORDS_FROM_FILE"
>
> I can auth successfully with one user.
> PROXY_AUTH_METHOD=NTLM
> PROXY_AUTH_CREDENTIALS=Username:password
>
>
> Any assistance would be greatly appreciated.
>
> Thanks,
> WP
>
libcurl may be broken for NTLM.
All other methods of authentication can be used for thousands of users and
more.



-- 
Truly,
Robert Iakobashvili, Ph.D.
......................................................................
www.ghotit.com
Assistive technology that understands you
......................................................................

Help curl-loader: proxy authentication multiple users

[王鹏 <sjz...@gm...>]

Hi Everyone,

I get a question about authenticate mutiple users to an explicit proxy. I
don't know how curl-loader specify username and password from conf file so
that I can proxy auth with multiple users instead of only set one user
credential in the tag PROXY_AUTH_CREDENTIALS

FAQ does not mention that scenario, looks like it only have config for
forms, such as FORM_USAGE_TYPE= "RECORDS_FROM_FILE"

I can auth successfully with one user.
PROXY_AUTH_METHOD=NTLM
PROXY_AUTH_CREDENTIALS=Username:password


Any assistance would be greatly appreciated.

Thanks,
WP

Re: Building curl-loader on osx 10.5.8

[Robert I. <cor...@gm...>]

Hi Matt,

On Wed, Feb 17, 2010 at 2:39 AM, Matt Doar <md...@po...> wrote:

> curl-loader 0.51 fails to build due to a "cp -a" in the top-level
> Makefile. Seems needlessly Linux-specific. cp -R will do the same
> thing with the default values (POSIX?)
>
> And a number of the install -c -m 644 commands fail due to the source
> and target being the same file, e.g. in
> build/curl/include/curl/Makefile in the install-pkgincludeHEADERS
> target
> I hacked around this by removing the command
>
> make -C $(CURL_BUILD) install;
>
> from the top level Makefile, since I only wanted a local install
> anyway. But then the header files such as bits/types.h weren't found.
> Oh well!
>
> ~Matt
>


Just save you time.
curl-loader is a linux-specific tool. It adds tens of thousand ip-addresses,
when required, using netlink facility.

Since this is a testing tool, the assumption is that you find a rather
not-expensive PC-HW, install linux, like debian for free, install necessary
packages and you have a serious testing and stress loading facility.

You may wish to read the FAQs:
http://curl-loader.sourceforge.net/doc/faq.html

-- 
Truly,
Robert Iakobashvili, Ph.D.
......................................................................
www.ghotit.com
Assistive technology that understands you
......................................................................

Building curl-loader on osx 10.5.8

[Matt D. <md...@po...>]

curl-loader 0.51 fails to build due to a "cp -a" in the top-level
Makefile. Seems needlessly Linux-specific. cp -R will do the same
thing with the default values (POSIX?)

And a number of the install -c -m 644 commands fail due to the source
and target being the same file, e.g. in
build/curl/include/curl/Makefile in the install-pkgincludeHEADERS
target
I hacked around this by removing the command

make -C $(CURL_BUILD) install;

from the top level Makefile, since I only wanted a local install
anyway. But then the header files such as bits/types.h weren't found.
Oh well!

~Matt

Re: SMTP usage ANNOUNCE: curl and libcurl 7.20.0

[Aleksandar L. <al-...@no...>]

On Mon 15.02.2010 11:31, Robert Iakobashvili wrote:
>On Mon, Feb 15, 2010 at 11:21 AM, Aleksandar Lazic <al-...@no...>wrote:
>
>> >Do you know about some good tools to load test mail servers?
>>
>> I use normaly the script from courier suite
>>
>> courier-0.64.0/courier/perftest1.in
>>
>> or postfix smtpstone
>>
>> postfix-2.7.0/src/smtpstone/smtp-source.c
>
>Thanks!

welcome.

I forgotten the doc link http://www.postfix.org/smtp-source.1.html

Cheers

Aleks

Re: SMTP usage ANNOUNCE: curl and libcurl 7.20.0

[Robert I. <cor...@gm...>]

On Mon, Feb 15, 2010 at 11:21 AM, Aleksandar Lazic <al-...@no...>wrote:

>
> >Do you know about some good tools to load test mail servers?
>
> I use normaly the script from courier suite
>
> courier-0.64.0/courier/perftest1.in
>
> or postfix smtpstone
>
> postfix-2.7.0/src/smtpstone/smtp-source.c
>
> Hth
>
> Aleks
>

Thanks!


-- 
Truly,
Robert Iakobashvili, Ph.D.
......................................................................
www.ghotit.com
Assistive technology that understands you
......................................................................

Re: SMTP usage ANNOUNCE: curl and libcurl 7.20.0

[Aleksandar L. <al-...@no...>]

Hi Robert,

On Mon 15.02.2010 07:36, Robert Iakobashvili wrote:
>Hi Aleks,
>
>On Sat, Feb 13, 2010 at 3:31 PM, Aleksandar Lazic <al-...@no...>wrote:
>
>> >Since SMTP support comes to libcurl (please see below), we have a
>> >real option to add such testing capabilities to curl-loader.
>>
>> >Are there people with the list who are interested in SMTP testing?
>>
>> I don't think that this will be a benefit for curl-loader, imho.
>
>Well, once I was in need to test, that my e-mailing works properly, and
>was short in tools. At some threshold the server was rejecting
>connections.
>
>Do you know about some good tools to load test mail servers?

I use normaly the script from courier suite

courier-0.64.0/courier/perftest1.in

or postfix smtpstone

postfix-2.7.0/src/smtpstone/smtp-source.c

Hth

Aleks

Re: SMTP usage ANNOUNCE: curl and libcurl 7.20.0

[Robert I. <cor...@gm...>]

Hi Aleks,

On Sat, Feb 13, 2010 at 3:31 PM, Aleksandar Lazic <al-...@no...>wrote:

>
> >Since SMTP support comes to libcurl (please see below), we have a real
> >option to add such testing capabilities to curl-loader.
>
> >Are there people with the list who are interested in SMTP testing?
>
> I don't think that this will be a benefit for curl-loader, imho.
>
> jm2c
>
> Cheers
>
> Aleks
>

Well, once I was in need to test, that my e-mailing works properly,
and was short in tools. At some threshold the server was rejecting
connections.

Do you know about some good tools to load test mail servers?

-- 
Truly,
Robert Iakobashvili, Ph.D.
......................................................................
www.ghotit.com
Assistive technology that understands you
......................................................................

Re: SMTP usage ANNOUNCE: curl and libcurl 7.20.0

[Aleksandar L. <al-...@no...>]

Dear Robert,

On Don 11.02.2010 23:14, Robert Iakobashvili wrote:
>Ladies and Gentlemen,
>
>Since SMTP support comes to libcurl (please see below), we have a real
>option to add such testing capabilites to curl-loader.
>
>Sounds like upgrade to a new version of libcurl and some testing will
>be enough.
>
>Are there people with the list who are insterested in SMTP testing?

I don't think that this will be a benefit for curl-loader, imho.

jm2c

Cheers

Aleks

>Have a good weekend.
>
>Shabbat Shalom,
>Robert Iakobashvili, Ph.D.
>......................................................................
>www.ghotit.com
>Assistive technology that understands you
>......................................................................
>
>
>From: Daniel Stenberg <da...@ha...>
>Date: Thu, Feb 11, 2010 at 8:13 PM
>Subject: SMTP usage (was RE: ANNOUNCE: curl and libcurl 7.20.0)
>To: libcurl development <cur...@co...>
>
>
>On Thu, 11 Feb 2010, Zhang, Jack wrote:
>
>curl --mail-from jac...@cr... --mail-rcpt
>> jac...@cr...  -v smtp://snyc12d12006
>>
>
>...
>
>How can I pass DATA part information, and let curl command finish sending
>> process without interaction from keyboard?
>>
>
>Use the -T option to provide a file or -T - to get the data from stdin.
>
>Also: I've been informed that there's probably a bug in how libcurl acts
>after the full DATA section has been sent as in it doesn't properly await a
>250 response, but I've not yet had the time to investigate or fix.
>

>SOLARIS 10 is the OS for Data Centers - provides features such as DTrace,
>Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW
>http://p.sf.net/sfu/solaris-dev2dev
>_______________________________________________
>curl-loader-devel mailing list
>cur...@li...
>https://lists.sourceforge.net/lists/listinfo/curl-loader-devel

SMTP usage ANNOUNCE: curl and libcurl 7.20.0

[Robert I. <cor...@gm...>]

Ladies and Gentlemen,

Since SMTP support comes to libcurl (please see below), we have a real
option
to add such testing capabilites to curl-loader.

Sounds like upgrade to a new version of libcurl and some testing will be
enough.

Are there people with the list who are insterested in SMTP testing?

Have a good weekend.

Shabbat Shalom,
Robert Iakobashvili, Ph.D.
......................................................................
www.ghotit.com
Assistive technology that understands you
......................................................................


---------- Forwarded message ----------
From: Daniel Stenberg <da...@ha...>
Date: Thu, Feb 11, 2010 at 8:13 PM
Subject: SMTP usage (was RE: ANNOUNCE: curl and libcurl 7.20.0)
To: libcurl development <cur...@co...>


On Thu, 11 Feb 2010, Zhang, Jack wrote:

curl --mail-from jac...@cr... --mail-rcpt
> jac...@cr...  -v smtp://snyc12d12006
>

...

How can I pass DATA part information, and let curl command finish sending
> process without interaction from keyboard?
>

Use the -T option to provide a file or -T - to get the data from stdin.

Also: I've been informed that there's probably a bug in how libcurl acts
after the full DATA section has been sent as in it doesn't properly await a
250 response, but I've not yet had the time to investigate or fix.

-- 

 / daniel.haxx.se
-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-library
Etiquette:  http://curl.haxx.se/mail/etiquette.html

Re: Protocol https not supported or disabled in libcurl

[Robert I. <cor...@gm...>]

Hi,

On Fri, Jan 29, 2010 at 5:40 AM, Seetha manognya <sma...@gm...>wrote:
>
> >How it was built?
> What do you mean by how it was built?


How the curl-loader has been built?
Describe the commands.


>
> >What happens, if you use the same URLs in browser?
> The add exception page is shown and once that's done, i can access the
> https page.
>

This may be the crucial point.
The very recent versions of libcurl are enforcing faliure upon exeptions, if
not
specifically alloweed via API.

You choices are:
1. ensure your certificate, etc are valid and no-exception is required by
browser;
2. downgrade the curl package to some lower version that may require other
changes
    like not using asynchronous DNS lookups by disabling that in Makefile;
3. using libcurl C-API to explicitly allow such exceptions in loader.c file
via API




>
> >The addresses you are using are supposed to be routable.
> >NETMASK=16
> >IP_ADDR_MIN= 192.168.1.1
> >IP_ADDR_MAX= 192.168.1.255
>
> >This is up to you ensure that.
>
> >To begin with start with the address you your computer,
> >like if it is routable to outside world and has IP A.B.C.D
>
> >use:
> >IP_ADDR_MIN= A.B.C.D
> >IP_ADDR_MAX= A.B.C.D
>
>
> I am inside a corporate lan space so i guess thats why 192.168.0.0/16doesnt work right? since that is not a routable address.
> But if i am connecting to http://204.236.255.202:8080/xxx.jsp and i set
> the
> IP_ADDR_MIN= 204.236.255.202
> IP_ADDR_MAX= 204.236.255.202
>
> it still doesnt work.


Use command ping with -I option to bind to a certain address
and check it versus some external address, like
$ping -I <my-local-address> <an-external-address>

 Working for a corporate means that you have some admins.
This is not a curl-loader issue. There are too many reasons, why
an address is not passing.


> --
> Truly,
> Robert Iakobashvili, Ph.D.
> ......................................................................
> www.ghotit.com
> Assistive technology that understands you
> ......................................................................
>

Re: Protocol https not supported or disabled in libcurl

[Seetha m. <sma...@gm...>]

Hi Robert

QUESTION/ SUGGESTION/ PATCH:

>>1) I am trying to test a https page but the log file says:
>>ERR Protocol https not supported or disabled in libcurl

>How it was built?
What do you mean by how it was built? the https page? i added port 443 in
the glassfish admin page and added a default certification.
Thats all. I did not build anything. Then i changed the address from
http://localhost:8080/jsp_pages/index.jsp to
htttps://localhost/jsp_pages/index.jsp and
it works well in the browser.

>What happens, if you use the same URLs in browser?
The add exception page is shown and once that's done, i can access the https
page.



>>2) Also i am only able to connect to the pages hosted in localhost. when i
change the URL to >http://ip-address:8080/something.html , with glassfish
>>running in that server, i am not able to >connect to the page. Any idea
why this might be the case? Even normal web pages like >www.google.com or
any >>other pages cannot be connected to , except those in localhost.

>The addresses you are using are supposed to be routable.
>NETMASK=16
>IP_ADDR_MIN= 192.168.1.1
>IP_ADDR_MAX= 192.168.1.255

>This is up to you ensure that.

>To begin with start with the address you your computer,
>like if it is routable to outside world and has IP A.B.C.D

>use:
>IP_ADDR_MIN= A.B.C.D
>IP_ADDR_MAX= A.B.C.D


I am inside a corporate lan space so i guess thats why 192.168.0.0/16 doesnt
work right? since that is not a routable address.
But if i am connecting to http://204.236.255.202:8080/xxx.jsp and i set the
IP_ADDR_MIN= 204.236.255.202
 IP_ADDR_MAX= 204.236.255.202

it still doesnt work.

Re: Protocol https not supported or disabled in libcurl

[Robert I. <cor...@gm...>]

Hi Seetha,

CURL-LOADER VERSION: 0.50, September 21, 2009

HW DETAILS: CPU/S and memory are must:

LINUX DISTRIBUTION and KERNEL (uname -r): 2.6.28-17-generic

GCC VERSION (gcc -v): gcc version 4.3.3 (Ubuntu 4.3.3-5ubuntu4)

COMPILATION AND MAKING OPTIONS (if defaults changed): defaults used

COMMAND-LINE:  curl-loader -f 10K.conf -e -v -u -d -u

CONFIGURATION-FILE (The most common source of problems):
Place the file inline here:

########### GENERAL SECTION ################################
BATCH_NAME= 10K
CLIENTS_NUM_MAX=10
CLIENTS_NUM_START=2
CLIENTS_RAMPUP_INC=1000
INTERFACE   =eth0
NETMASK=16
IP_ADDR_MIN= 192.168.1.1
IP_ADDR_MAX= 192.168.1.255
CYCLES_NUM= 1
URLS_NUM= 1

########### URL SECTION ####################################

URL=https://127.0.0.1:443/jsp_pages/index/jsp
# tried with URL=https://127.0.0.1/jsp_pages/index/jsp as well
#URL=http://localhost/ACE-INSTALL.html
URL_SHORT_NAME="local-index"
REQUEST_TYPE=GET
TIMER_URL_COMPLETION = 5000      # In msec. When positive, Now it is
enforced by cancelling url fetch on timeout
TIMER_AFTER_URL_SLEEP =20

DOES THE PROBLEM AFFECT:
       COMPILATION? No
       LINKING? No
       EXECUTION? No
       OTHER (please specify)?
Have you run $make cleanall  prior to $make ?
no . but this needs to be done everytime before you run a test? cause i am
having no problems testing for a http page.

DESCRIPTION:


QUESTION/ SUGGESTION/ PATCH:
>1) I am trying to test a https page but the log file says:
>ERR Protocol https not supported or disabled in libcurl

How it was built?

What happens, if you use the same URLs in browser?



>2) Also i am only able to connect to the pages hosted in localhost. when i
change the URL to >http://ip-address:8080/something.html , with glassfish
running in that server, i am not able to >connect to the page. Any idea why
this might be the case? Even normal web pages like >www.google.com or any
other pages cannot be connected to , except those in localhost.

The addresses you are using are supposed to be routable.
NETMASK=16
IP_ADDR_MIN= 192.168.1.1
IP_ADDR_MAX= 192.168.1.255

This is up to you ensure that.

To begin with start with the address you your computer,
like if it is routable to outside world and has IP A.B.C.D

use:
IP_ADDR_MIN= A.B.C.D
IP_ADDR_MAX= A.B.C.D


-- 
Truly,
Robert Iakobashvili, Ph.D.
......................................................................
www.ghotit.com
Assistive technology that understands you
......................................................................

Re: Protocol https not supported or disabled in libcurl

[Robert I. <cor...@gm...>]

Hi Seetha,

On Wed, Jan 27, 2010 at 10:24 AM, Seetha manognya <sma...@gm...>wrote:

>
> <https://owa.i2r.a-star.edu.sg/exchange/smjandhyala/Sent%20Items/No%20Subject.EML/#>
> Hi
>
> 1) I am trying to test a https page but the log file says:
>
> ERR Protocol https not supported or disabled in libcurl
>
> when i look at the curl-config --protocols it says it supports HTTPS. How
> do i solve this problem.?
>
> 2) Also i am only able to connect to the pages hosted in localhost. when i
> change the URL to http://ip-address:8080/something.html , with glassfish
> running in that server, i am not able to connect to the page. Any idea why
> this might be the case? Even normal web pages like www.google.com or any
> other pages cannot be connected to , except those in localhost.
>
> Thanks
> Seetha
>

HTTPS is definitely supported.

In order to understand what are you doing, please,
fill the PROBLEM-REPORTING-FORM, which is located within curl-loader
tarball.


-- 
Truly,
Robert Iakobashvili, Ph.D.
......................................................................
www.ghotit.com
Assistive technology that understands you
......................................................................

Protocol https not supported or disabled in libcurl

[Seetha m. <sma...@gm...>]

<https://owa.i2r.a-star.edu.sg/exchange/smjandhyala/Sent%20Items/No%20Subject.EML/#>
Hi

1) I am trying to test a https page but the log file says:

ERR Protocol https not supported or disabled in libcurl

when i look at the curl-config --protocols it says it supports HTTPS. How do
i solve this problem.?

2) Also i am only able to connect to the pages hosted in localhost. when i
change the URL to http://ip-address:8080/something.html , with glassfish
running in that server, i am not able to connect to the page. Any idea why
this might be the case? Even normal web pages like www.google.com or any
other pages cannot be connected to , except those in localhost.

Thanks
Seetha

Re: NTLM AUTH

[Robert I. <cor...@gm...>]

Hi Adam,

On Fri, Jan 22, 2010 at 3:58 AM, Adam Black <ad...@as...> wrote:

>  I am having no joy trying to authenticate to an explicit proxy. A PCAP
> shows the proxy is returning a 407 response but Curl Loader then disconnects
> the session.
>
> I have set these to options in my configs file and used commands to run it.
>
> PROXY_AUTH_METHOD=NTLM
>
> PROXY_AUTH_CREDENTIALS=Username:password
>
> curl-loader -f filename -x 10.11.12.50:8080
>

curl-loader is based on the stack of lubcurl.
You can look at bugs/issues of curl project related to NTLM.
To the best of my knowledge, there are issues, bugs and limitations
in that area.

You can try to upgrade to the most recent version of curl-loader-0.51,
which has the latest released version of curl.

Sincerely,
Robert Iakobashvili, Ph.D.
......................................................................
www.ghotit.com
Assistive technology that understands you
......................................................................

NTLM AUTH

[Adam B. <ad...@as...>]

Hi Everyone

 

I am having no joy trying to authenticate to an explicit proxy. A PCAP
shows the proxy is returning a 407 response but Curl Loader then
disconnects the session.

I have set these to options in my configs file and used commands to run
it.

 

PROXY_AUTH_METHOD=NTLM

PROXY_AUTH_CREDENTIALS=Username:password

 

curl-loader -f filename -x 10.11.12.50:8080

 

Any assistance would be greatly appreciated.

 

Adam

Re: segmentation fault

[Robert I. <cor...@gm...>]

Hi Brocha,

On Thu, Jan 21, 2010 at 9:54 AM, Brocha Strous <br...@ca...>wrote:

>
> I am trying to run a simple POST request which has 6 variables that need
> to be replaced from the input file.
>

Got it.


>
> > 2. which example config file was taken as initial;
> >
> I used post-form-tokens-fr-file.conf and random_file_records.conf as
> examples.
>

Good.

Please, pay attention, that you cannot make a POST without getting
the form, therefore, the first is GET as in the example is required:

# GET-part
URL= http://10.30.6.42:8888/vax/root/Admin
URL_SHORT_NAME="Login-GET"
REQUEST_TYPE=GET
TIMER_URL_COMPLETION = 4000
TIMER_AFTER_URL_SLEEP =0

# POST-part
URL=""
URL_SHORT_NAME="Login-POST"
URL_USE_CURRENT= 1
REQUEST_TYPE=POST
FORM_USAGE_TYPE= RECORDS_FROM_FILE
FORM_STRING= username=%s&password=%s     #means credentials from file
FORM_RECORDS_FILE= ./conf-examples/credentials.cred # Path relative to
curl-loader location


> URL=http://localhost/load/main.php
> URL_SHORT_NAME="play-event"
> REQUEST_TYPE=POST
> FORM_USAGE_TYPE= RECORDS_FROM_FILE
> FORM_STRING=
>
> ws_name=PlayEvent&ws_action=Create&descriptor-media_id=%s&credentials-session_id=%s&credentials-consumer_id=%s&credentials-device_id=%s&descriptor-consumer_id=%s&descriptor-media_kind=track&descriptor-device_id=%s&timestamp=1&descriptor-playing_source_type=stream&descriptor-complete_play=1&descriptor-duration=0
> FORM_RECORDS_FILE= ./conf/streamMedia.input
> TIMER_URL_COMPLETION = 5000
> TIMER_AFTER_URL_SLEEP = 2000
>
> Could it be that there is some limitation on the length of the post
> string that i am exceeding? (My string is a bit long) Or maybe the
> length of each individual data input value?
>

It might be the case, however:

1. Please, make the first Get;
2. Make a capture using some sniffer like wireshark and see in the capture,
   if you are getting the POST-form by Get and that it contains all the
required fields to add.

   You might be consulted at this point by somebody with experience in HTTP,
HTML, etc.

3. Start with 2-3 initial parameters, you may not receive OK, but some
response you may get.


-- 
Truly,
Robert Iakobashvili, Ph.D.
......................................................................
www.ghotit.com
Assistive technology that understands you
......................................................................

Re: segmentation fault

[Brocha S. <br...@ca...>]

>
> Normally, people, are running it with some verbosity options.
>
>
>

Adding the -v switch produces the following output:

found form_str 
ws_name=PlayEvent&ws_action=Create&descriptor-media_id=%s&credentials-session_id=%s&credentials-consumer_id=%s&credentials-device_id=%s&descriptor-consumer_id=%s&descriptor-media_kind=track&descriptor-device_id=%s&timestamp=1&descriptor-playing_source_type=stream&descriptor-complete_play=1&descriptor-duration=0
load_form_records_file - processing form records file string 
"12375647,200a9faa5c561bb39c240b4b249b6c9c,1408,1239244735,1408,1239244735,foo
The configuration has been post-validated successfully.

add_secondary_ip_addrs - setting secondary IP 192.168.11.104
rtnl_talk(): RTNETLINK answers: File exists
add_secondary_ip_addrs - note: probably, the IP-address 
"192.168.11.104/24" already exists.
main - added IP-addresses to the loading network interface.

RUNNING LOAD

Segmentation fault


> Please, explain:
> 1. what you are willing to do;

I am trying to run a simple POST request which has 6 variables that need 
to be replaced from the input file.


> 2. which example config file was taken as initial;
>
I used post-form-tokens-fr-file.conf and random_file_records.conf as 
examples. (I tried doing the configuration without the random and with 
and it didn't help). The simplest form of the configuration i tried 
which is exactly like post-form-tokens-fr-file.conf except with 
different data and different post string is:

URL=http://localhost/load/main.php
URL_SHORT_NAME="play-event"
REQUEST_TYPE=POST
FORM_USAGE_TYPE= RECORDS_FROM_FILE
FORM_STRING= 
ws_name=PlayEvent&ws_action=Create&descriptor-media_id=%s&credentials-session_id=%s&credentials-consumer_id=%s&credentials-device_id=%s&descriptor-consumer_id=%s&descriptor-media_kind=track&descriptor-device_id=%s&timestamp=1&descriptor-playing_source_type=stream&descriptor-complete_play=1&descriptor-duration=0
FORM_RECORDS_FILE= ./conf/streamMedia.input
TIMER_URL_COMPLETION = 5000
TIMER_AFTER_URL_SLEEP = 2000

Could it be that there is some limitation on the length of the post 
string that i am exceeding? (My string is a bit long) Or maybe the 
length of each individual data input value?

Thanks,
Brocha



> My feeling, that you missed some example files.
>
>
>     DOES THE PROBLEM AFFECT:
>
>              EXECUTION
>
>
>     DESCRIPTION:
>
>
>     When running this test i get a segmentation fault. there are no
>     errors,
>     explanations etc. (I have tried it without the trailing comma in the
>     input file, with adding other lines in the input file, with increasing
>     cycles.)
>
> Unless it will be clear, what you are doing ...
>
> -- 
> Truly,
> Robert Iakobashvili, Ph.D.
> ......................................................................
> www.ghotit.com <http://www.ghotit.com>
> Assistive technology that understands you
> ......................................................................
> ------------------------------------------------------------------------
>
> ------------------------------------------------------------------------------
> Throughout its 18-year history, RSA Conference consistently attracts the
> world's best and brightest in the field, creating opportunities for Conference
> attendees to learn about information security's most important issues through
> interactions with peers, luminaries and emerging and established companies.
> http://p.sf.net/sfu/rsaconf-dev2dev
> ------------------------------------------------------------------------
>
> _______________________________________________
> curl-loader-devel mailing list
> cur...@li...
> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel
>   

Re: curl-loader

[Robert I. <cor...@gm...>]

Hi Val,

On Thu, Jan 21, 2010 at 1:09 AM, Val <cyb...@gm...> wrote:

> Hi, long time ago you were trying to simulate browser... I would be
> interested in the solution you found, if you found one?
>
> Best regards,
> Valerian
>

To simulate a browser we need to detect all images at a page and open
N-connections to download them independently.
People can detect images on a page themselves and write URLs.
Using probabilities, they can arrange, that with a certain probability
images and
content will be downloaded in parallel, well simulating browser's load (not
behavior).

We have started developing a system for in-depth context analyses of
web-pages, containing a sort of scripting lang and a virtual machine.

Michael did initial development, which is here:
http://curl-loader.svn.sourceforge.net/viewvc/curl-loader/trunk/curl-loader/script/

If somebody is willing to continue, Michael can explain beyond the written
info.

Best wishes to you!

Robert Iakobashvili, Ph.D.
......................................................................
www.ghotit.com
Assistive technology that understands you
......................................................................

Re: segmentation fault

[Robert I. <cor...@gm...>]

Hi,

Thanks for the PRF.

On Wed, Jan 20, 2010 at 3:23 PM, Brocha Strous <br...@ca...>wrote:

> COMMAND-LINE:
>
> ./curl-loader  -f conf/streamMedia.conf
>

Normally, people, are running it with some verbosity options.

>
>
> CONFIGURATION-FILE (The most common source of problems):
>
> ########### GENERAL SECTION ################################
>
> BATCH_NAME= stream-media
> CLIENTS_NUM_MAX=1 # Same as CLIENTS_NUM
> INTERFACE   =eth0
> NETMASK=255.255.255.0
> IP_ADDR_MIN= 192.168.11.104
> IP_ADDR_MAX= 192.168.11.104
> CYCLES_NUM= 1
> URLS_NUM= 1
>
> ########### URL SECTION ####################################
>
> URL=http://localhost/load/main.php
> URL_SHORT_NAME="play-event"
> REQUEST_TYPE=POST
> FORM_USAGE_TYPE= RECORDS_FROM_FILE
> FORM_STRING=
>
> "ws_name=PlayEvent&ws_action=Create&descriptor-media_id=%s&credentials-session_id=%s&credentials-consumer_id=%s&credentials-device_id=%s&descriptor-consumer_id=%s&descriptor-media_kind=track&descriptor-device_id=%s&timestamp=1&descriptor-playing_source_type=stream&descriptor-complete_play=1&descriptor-duration=0"
> FORM_RECORDS_FILE_MAX_NUM=1
> FORM_RECORDS_FILE= ./conf/streamMedia.input
> TIMER_URL_COMPLETION = 5000
> TIMER_AFTER_URL_SLEEP = 2000
>
> The contents of streamMedia.input is:
>
> 12375647,200a9faa5c561bb39c240b4b249b6c9c,1408,1239244735,1408,1239244735,
>

Please, explain:
1. what you are willing to do;
2. which example config file was taken as initial;

My feeling, that you missed some example files.


> DOES THE PROBLEM AFFECT:
>
>          EXECUTION
>
>
> DESCRIPTION:
>
>
> When running this test i get a segmentation fault. there are no errors,
> explanations etc. (I have tried it without the trailing comma in the
> input file, with adding other lines in the input file, with increasing
> cycles.)
>
> Unless it will be clear, what you are doing ...

-- 
Truly,
Robert Iakobashvili, Ph.D.
......................................................................
www.ghotit.com
Assistive technology that understands you
......................................................................

segmentation fault

[Brocha S. <br...@ca...>]

CURL-LOADER VERSION: 0.50, September 21, 2009

HW DETAILS: CPU/S and memory are must:

Intel(R) Core(TM)2 Duo CPU     T9600  @ 2.80GHz
Mem:   3056880k total

LINUX DISTRIBUTION and KERNEL (uname -r):

2.6.31-16-generic

GCC VERSION (gcc -v):

gcc version 4.4.1 (Ubuntu 4.4.1-4ubuntu8)


COMPILATION AND MAKING OPTIONS (if defaults changed):

defaults

COMMAND-LINE:

./curl-loader  -f conf/streamMedia.conf


CONFIGURATION-FILE (The most common source of problems):

########### GENERAL SECTION ################################

BATCH_NAME= stream-media
CLIENTS_NUM_MAX=1 # Same as CLIENTS_NUM
INTERFACE   =eth0
NETMASK=255.255.255.0
IP_ADDR_MIN= 192.168.11.104
IP_ADDR_MAX= 192.168.11.104
CYCLES_NUM= 1
URLS_NUM= 1

########### URL SECTION ####################################

URL=http://localhost/load/main.php
URL_SHORT_NAME="play-event"
REQUEST_TYPE=POST
FORM_USAGE_TYPE= RECORDS_FROM_FILE
FORM_STRING= 
"ws_name=PlayEvent&ws_action=Create&descriptor-media_id=%s&credentials-session_id=%s&credentials-consumer_id=%s&credentials-device_id=%s&descriptor-consumer_id=%s&descriptor-media_kind=track&descriptor-device_id=%s&timestamp=1&descriptor-playing_source_type=stream&descriptor-complete_play=1&descriptor-duration=0"
FORM_RECORDS_FILE_MAX_NUM=1
FORM_RECORDS_FILE= ./conf/streamMedia.input
TIMER_URL_COMPLETION = 5000
TIMER_AFTER_URL_SLEEP = 2000

The contents of streamMedia.input is:

12375647,200a9faa5c561bb39c240b4b249b6c9c,1408,1239244735,1408,1239244735,

DOES THE PROBLEM AFFECT:

          EXECUTION


DESCRIPTION:


When running this test i get a segmentation fault. there are no errors, 
explanations etc. (I have tried it without the trailing comma in the 
input file, with adding other lines in the input file, with increasing 
cycles.)

Thanks,
Brocha

Re: how to set IP values correctly

[Robert I. <cor...@gm...>]

Hi Brocha,

On Tue, Jan 19, 2010 at 1:00 PM, Brocha Strous <br...@ca...>wrote:

> I see it going to the first URL but not the second one.
>
> And in the statistics it doesn't report the 200OK:
>
> Please, don't top-post.

1. Try more cycles, like 100 or -1
2. If any issues, please, submit another request with another subject since
your issue is different.
3. Please, explain what you are intended to do, and which example is taken
as the base for your
configuration file.



-- 
Truly,
Robert Iakobashvili, Ph.D.
......................................................................
www.ghotit.com
Assistive technology that understands you
......................................................................

Re: how to set IP values correctly

[Brocha S. <br...@ca...>]

I see it going to the first URL but not the second one.

And in the statistics it doesn't report the 200OK:

::::::::::::::
stream-media.ctx
::::::::::::::
1 
,cycles:1,state:-1,b-in:704,b-out:388,req:1,1xx:0,2xx:1,3xx:0,4xx:0,5xx:0,err:
1,T-err:0
::::::::::::::
stream-media.log
::::::::::::::
# 1177944446 Tue Jan 19 12:52:09 2010
# msec_offset cycle_no url_no client_no (ip) indic info
2 0 0 1 !! ERR Couldn't bind to '192.168.2.108'
1721 0 0 1 !! OK 200
root@brocha-t400:/home/brocha/software/curl-loader-0.50# more 
stream-media.*::::::::::::::
stream-media.ctx
::::::::::::::
1 
,cycles:1,state:-1,b-in:704,b-out:388,req:1,1xx:0,2xx:1,3xx:0,4xx:0,5xx:0,err:
1,T-err:0
::::::::::::::
stream-media.log
::::::::::::::
# 1177944446 Tue Jan 19 12:52:09 2010
# msec_offset cycle_no url_no client_no (ip) indic info
2 0 0 1 !! ERR Couldn't bind to '192.168.2.108'
1721 0 0 1 !! OK 200
::::::::::::::
stream-media.ops
::::::::::::::
 Operations:         Success         Failed            Timed ou
t
URL0:media-art       0      0               0      0               0      0
      
URL1:media           0      0               0      0               0      0
      
 Operations:         Success         Failed            Timed ou
t
URL0:media-art       0      0               1      1               0      0
      
URL1:media           0      0               0      0               0      0
      
::::::::::::::
stream-media.txt
::::::::::::::
RunTime(sec),Appl,Clients,Req,1xx,2xx,3xx,4xx,5xx,Err,T-Err,D,D-2xx,Ti,To
0, H/F   , 1, 1, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 388
0, H/F/S , 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
*, *, *, *, *, *, *, *, *, *, *, *, *, *
RunTime(sec),Appl,Clients,Req,1xx,2xx,3xx,4xx,5xx,Err,T-Err,D,D-2xx,Ti,To
1, H/F   , 0, 1, 0, 1, 0, 0, 0, 1, 0, 1721, 1721, 704, 388
1, H/F/S , 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0



Robert Iakobashvili wrote:
> Hi Brocha,
>
> On Tue, Jan 19, 2010 at 12:49 PM, Robert Iakobashvili 
> <cor...@gm... <mailto:cor...@gm...>> wrote:
>
>     Hi Brocha,
>
>     On Tue, Jan 19, 2010 at 12:24 PM, Brocha Strous
>     <br...@ca... <mailto:br...@ca...>> wrote:
>
>         I have tried it with the 255.255.255.0 netmask too and it
>         didn't work. I
>         have also tried  it with all the different interfaces listed
>         in the
>         ifconfig and the corresponding IP and netmask and none of
>         those worked
>         either.
>         I am running as root.
>
>         Thanks,
>         Brocha
>
>      
>     Interesting...
>     In any case, 255.255.255.0 netmask is the correct one for your
>     addresses.
>     What happens, if you try, e.g. 192.168.2.108 as the IP-address?
>      
>     Sincerely,
>     Robert
>
>
>  
> Looking at your log file:
>
> # 1172523270 Tue Jan 19 11:21:48 2010
> # msec_offset cycle_no url_no client_no (ip) indic info
> *2 0 0 1 !! ERR Couldn't bind to '192.168.11.104' - This might be OK 
> since the address exists.
> 1180 0 0 1 !! OK 200 - And this is the response from server.*
>  
> Run the same with -v and you'll see even more details in your logfile.
> Make a capture by wireshark, and you'll see the traffic going.
> Since you CYCLES_NUM= 1 - it makes exactly a single cycle.
> * *
>
> -- 
> Truly,
> Robert Iakobashvili, Ph.D.
> ......................................................................
> www.ghotit.com <http://www.ghotit.com>
> Assistive technology that understands you
> ......................................................................
> ------------------------------------------------------------------------
>
> ------------------------------------------------------------------------------
> Throughout its 18-year history, RSA Conference consistently attracts the
> world's best and brightest in the field, creating opportunities for Conference
> attendees to learn about information security's most important issues through
> interactions with peers, luminaries and emerging and established companies.
> http://p.sf.net/sfu/rsaconf-dev2dev
> ------------------------------------------------------------------------
>
> _______________________________________________
> curl-loader-devel mailing list
> cur...@li...
> https://lists.sourceforge.net/lists/listinfo/curl-loader-devel
>   

Re: how to set IP values correctly

[Robert I. <cor...@gm...>]

Hi Brocha,

On Tue, Jan 19, 2010 at 12:49 PM, Robert Iakobashvili
<cor...@gm...>wrote:

> Hi Brocha,
>
>  On Tue, Jan 19, 2010 at 12:24 PM, Brocha Strous <br...@ca...>wrote:
>
>> I have tried it with the 255.255.255.0 netmask too and it didn't work. I
>> have also tried  it with all the different interfaces listed in the
>> ifconfig and the corresponding IP and netmask and none of those worked
>> either.
>> I am running as root.
>>
>> Thanks,
>> Brocha
>
>
> Interesting...
> In any case, 255.255.255.0 netmask is the correct one for your addresses.
> What happens, if you try, e.g. 192.168.2.108 as the IP-address?
>
> Sincerely,
> Robert
>


Looking at your log file:

# 1172523270 Tue Jan 19 11:21:48 2010
# msec_offset cycle_no url_no client_no (ip) indic info
*2 0 0 1 !! ERR Couldn't bind to '192.168.11.104' - This might be OK since
the address exists.
1180 0 0 1 !! OK 200 - And this is the response from server.*

Run the same with -v and you'll see even more details in your logfile.
Make a capture by wireshark, and you'll see the traffic going.
Since you CYCLES_NUM= 1 - it makes exactly a single cycle.
*

*--
Truly,
Robert Iakobashvili, Ph.D.
......................................................................
www.ghotit.com
Assistive technology that understands you
......................................................................