httpunit-develop — General discussion

[Httpunit-develop] Cookies

[Perry D. <pd...@Bl...>]

Thanks Jason,
	I found out that this package works and that I needed to download
the Java Cryptography Extensions as well.  So now my HTTPS works, but I am
having trouble with cookies.  Does HttpUnit handle cookies, and if so, how?

Perry

-----Original Message-----
From: htt...@li...
[mailto:htt...@li...]On Behalf Of Jason
Schuchert
Sent: Saturday, September 02, 2000 3:06 PM
To: 'htt...@li...'
Subject: RE: [Httpunit-develop] https


I don't know httpunit yet so I can only speak in general terms but I believe
that all available jdk's do not support the https protocol with java.net.URL
without the addition/installation of the jsse (java secure sockets
extension) available at javasoft.com.

There are docs available as part of that download that will explain how to
get it up and running.

good luck! :)

-jason

> -----Original Message-----
> From: Perry Doell [mailto:pd...@Bl...]
> Sent: Friday, September 01, 2000 5:18 PM
> To: 'htt...@li...'
> Subject: [Httpunit-develop] https
> 
> 
> 	Has anyone tried HttpUnit with the https protocol?  
> When I try this,
> I get the following:
> 
> java.net.MalformedURLException: unknown protocol: https
>         at
> com.meterware.httpunit.GetMethodWebRequest.getURL(GetMethodWeb
> Request.java:4
> 9)
>         at
> com.meterware.httpunit.WebConversation.getResponse(WebConversa
> tion.java:51)
>         at BlackHogTest.testLogon(BlackHogTest.java:43)
> 
> 
> I am a little new with Java, so perhaps there is an obvious, 
> very basic
> thing I am doing wrong here.  Any suggestions?
> 
> Perry
> 
> _______________________________________________
> Httpunit-develop mailing list
> Htt...@li...
> http://lists.sourceforge.net/mailman/listinfo/httpunit-develop
> 
_______________________________________________
Httpunit-develop mailing list
Htt...@li...
http://lists.sourceforge.net/mailman/listinfo/httpunit-develop

RE: [Httpunit-develop] https

[Jason S. <JSc...@le...>]

I don't know httpunit yet so I can only speak in general terms but I believe
that all available jdk's do not support the https protocol with java.net.URL
without the addition/installation of the jsse (java secure sockets
extension) available at javasoft.com.

There are docs available as part of that download that will explain how to
get it up and running.

good luck! :)

-jason

> -----Original Message-----
> From: Perry Doell [mailto:pd...@Bl...]
> Sent: Friday, September 01, 2000 5:18 PM
> To: 'htt...@li...'
> Subject: [Httpunit-develop] https
> 
> 
> 	Has anyone tried HttpUnit with the https protocol?  
> When I try this,
> I get the following:
> 
> java.net.MalformedURLException: unknown protocol: https
>         at
> com.meterware.httpunit.GetMethodWebRequest.getURL(GetMethodWeb
> Request.java:4
> 9)
>         at
> com.meterware.httpunit.WebConversation.getResponse(WebConversa
> tion.java:51)
>         at BlackHogTest.testLogon(BlackHogTest.java:43)
> 
> 
> I am a little new with Java, so perhaps there is an obvious, 
> very basic
> thing I am doing wrong here.  Any suggestions?
> 
> Perry
> 
> _______________________________________________
> Httpunit-develop mailing list
> Htt...@li...
> http://lists.sourceforge.net/mailman/listinfo/httpunit-develop
> 

[Httpunit-develop] https

[Perry D. <pd...@Bl...>]

	Has anyone tried HttpUnit with the https protocol?  When I try this,
I get the following:

java.net.MalformedURLException: unknown protocol: https
        at
com.meterware.httpunit.GetMethodWebRequest.getURL(GetMethodWebRequest.java:4
9)
        at
com.meterware.httpunit.WebConversation.getResponse(WebConversation.java:51)
        at BlackHogTest.testLogon(BlackHogTest.java:43)


I am a little new with Java, so perhaps there is an obvious, very basic
thing I am doing wrong here.  Any suggestions?

Perry

[Httpunit-develop] [Announce] HttpUnit 1.0 now available

[Russell G. <rus...@ac...>]

Version 1.0 of HttpUnit is now available at <http://httpunit.sourceforge.net/>.

HttpUnit is a Java API for accessing web sites without a browser, and is ideally suited for automated unit testing of web sites when combined with a Java unit test framework such as JUnit, or for simply accessing web sites as part of a distributed application. 

HttpUnit emulates the relevant portions of browser behavior, including form submission, basic http authentication, cookies and automatic page redirection, and allows Java test code to examine returned pages as text, an XML DOM, or containers of forms, tables, and links.

------------------------------------------------------------------------
Russell Gold                     | "... society is tradition and order
rus...@ac...    (preferred)  | and reverence, not a series of cheap
rus...@ne...              | bargains between selfish interests."
rg...@th...       |   - Poul Anderson, "Iron"

Re: [Httpunit-develop] Re: Authentication problem with servlets & searching the mailinglist

[Russell G. <rus...@ac...>]

At 2:25 AM -0400 8/25/00, armin roehrl wrote:
>Hey, sorry for flooding you with mails today.
>At http://www.rgagnon.com/howto.html I found the solution
>under Java Howto-IO/net ("Identify yourself using HTTP Authentication")
>
>The problem I seem to have is that HttpUnit doesn't manage
>that it is one session, i.e. after "logging" in, when I fire
>off the next request I have to pass the password again.
>I can do that, but is that a misundertanding on my side?

Can you describe exactly what you are trying?  I think that your best bet is going to be to use the latest version from the cvs repository, which supports defining a header in WebConversation. You can give it the authentication response encoded as in the above article, and it will send it every time. 

------------------------------------------------------------------------
Russell Gold                     | "... society is tradition and order
rus...@ac...    (preferred)  | and reverence, not a series of cheap
rus...@ne...              | bargains between selfish interests."
rg...@th...       |   - Poul Anderson, "Iron"

Re: [Httpunit-develop] Re: Authentication problem with servlets & searching the mailinglist

[Russell G. <rus...@ac...>]

At 2:25 AM -0400 8/25/00, armin roehrl wrote:
>Hey, sorry for flooding you with mails today.
>At http://www.rgagnon.com/howto.html I found the solution
>under Java Howto-IO/net ("Identify yourself using HTTP Authentication")
>
>The problem I seem to have is that HttpUnit doesn't manage
>that it is one session, i.e. after "logging" in, when I fire
>off the next request I have to pass the password again.
>I can do that, but is that a misundertanding on my side?

The problem is that HttpUnit does not yet support HTTP Authentication. Now that you have pointed out the how-to, I will look into it; however, since I don't need it on my current project (and don't have access to a server that uses it), it may not get a high priority. If you would like to propose a patch to support it and a test to verify it, I can add it.

------------------------------------------------------------------------
Russell Gold                     | "... society is tradition and order
rus...@ac...    (preferred)  | and reverence, not a series of cheap
rus...@ne...              | bargains between selfish interests."
rg...@th...       |   - Poul Anderson, "Iron"

[Httpunit-develop] Re: Authentication problem with servlets & searching the mailinglist

[armin r. <ar...@ap...>]

Hey, sorry for flooding you with mails today.
At http://www.rgagnon.com/howto.html I found the solution
under Java Howto-IO/net ("Identify yourself using HTTP Authentication")

The problem I seem to have is that HttpUnit doesn't manage
that it is one session, i.e. after "logging" in, when I fire
off the next request I have to pass the password again.
I can do that, but is that a misundertanding on my side?

Thank you & I promise this is the last mail from me for today.
	Armin


On Thu, 24 Aug 2000, armin roehrl wrote:

> Dear All,
> 
> this is probably a standard problem, but I couldn't
> examine the past mailings to this list, as the link at
> http://lists.sourceforge.net/mailman/listinfo/httpunit-develop
> seems to be wrong. (To see the collection of prior.... 
> http://www.geocrawler.com/redir-sf.php3?list=/httpunit-devel )
> 
> I got a servlet where I need to pass identification directly
> to it. Calling  
> request = new GetMethodWebRequest(
> "http://username:pas...@ma...:8080/directory" );  
> does not work.
> 
> Calling lynx with auth parameters works
> lynx -source -auth=username:password
> 'http://mapc51.epfl.ch:8080/directory'
> 
> I'm sure it's sth. trivial that I'm doing wrong.
> 
> Thanks a lot for your help.
> Armin
> P.S.: I copied that mail to you Russel, as I'm not sure
> the mailinglist is working right now. Maybe there's sth. 
> wrong at my end or the net (locally) is very slow today.
> 
> 

[Httpunit-develop] Authentication problem with servlets & searching the mailinglist

[armin r. <ar...@ap...>]

Dear All,

this is probably a standard problem, but I couldn't
examine the past mailings to this list, as the link at
http://lists.sourceforge.net/mailman/listinfo/httpunit-develop
seems to be wrong. (To see the collection of prior.... 
http://www.geocrawler.com/redir-sf.php3?list=/httpunit-devel )

I got a servlet where I need to pass identification directly
to it. Calling  
request = new GetMethodWebRequest(
"http://username:pas...@ma...:8080/directory" );  
does not work.

Calling lynx with auth parameters works
lynx -source -auth=username:password
'http://mapc51.epfl.ch:8080/directory'

I'm sure it's sth. trivial that I'm doing wrong.

Thanks a lot for your help.
Armin
P.S.: I copied that mail to you Russel, as I'm not sure
the mailinglist is working right now. Maybe there's sth. 
wrong at my end or the net (locally) is very slow today.

RE: [Httpunit-develop] Suggestions, Comments and Questions

[<Jan...@ed...>]

 
Item 1.
 	I mean the second type.
This is important when you want to fake a cookie value.
Item 5.
 	Thanks, I try it.
Item 6.
 	WAP and WML is a big thing now in Europe.
 	There are a lot of sites covering this subject.
 	Here is one:
  	http://www.oasis-open.org/cover/wap-wml.html

                --Jan O.



-----Original Message-----
From: Russell Gold
To: Jan Öhrström; 'htt...@li...'
Sent: 8/10/00 6:12 PM
Subject: Re: [Httpunit-develop] Suggestions, Comments and Questions

At 11:27 AM -0400 8/10/00, Jan Öhrström (BCS) wrote:
>I've been using the HttpUnit now for a couple of weeks and like very
much. 
>I have some suggestions, comments and questions....
>
>1. Need a way to set additional cookies. Maybe an addCokkies method
could be implemented? Maybe there is another simpler & smarter way to do
this?

Do you mean cookies from the servlet?  Or other cookies in the
environment? The first should already be there; the second sounds like
it ought to be added to WebConversation.

>2. Need a way to set the User-Agent, e.g. to simulate different
browsers

Should be added to WebConversation

>3. Setting used languages and other browser specific stuff would also
be neat

Ditto

>4. Is there an easy way to handle Javascript popup:s?

JavaScript is tough. I haven't even considered it, as my current
projects don't use it.

>5. Having a problem to find links that are "included" inside Forms
using getLinks(). Maybe this a wrong way to do this?

I usually look for links inside table cells. I don't even know that it
is meaningful to consider a link to be inside a form...

But the archive now includes code to find a link based on its text, or
the alt text of its image.  You could use the archive version or wait
for the next release.

>6. I 'm also using HttpUnit for testing WML/WAP. It would be very handy
if it could also parse WML (non compiled)

I know nothing about WML, but patches are welcome. The trick would be to
find a way to integrate this. Can you point me to some documentation?
 
>
>I've started to introduce HttpUnit to my whole project and soon all
will be hooked...

Terrific!


As a general rule, I add things when I need them for the projects I'm
working on, and I encourage others to do the same. If I don't
immediately need something, I cannot always tell what a useful
implementation would be. Test cases or examples would be helpful if you
want me to do the implementation.

------------------------------------------------------------------------
Russell Gold                     | "... society is tradition and order
rus...@ac...    (preferred)  | and reverence, not a series of cheap
rus...@ne...              | bargains between selfish interests."
rg...@th...       |   - Poul Anderson, "Iron"

Re: [Httpunit-develop] Suggestions, Comments and Questions

[Russell G. <rus...@ac...>]

At 11:27 AM -0400 8/10/00, Jan Öhrström (BCS) wrote:
>I've been using the HttpUnit now for a couple of weeks and like very much. 
>I have some suggestions, comments and questions....
>
>1. Need a way to set additional cookies. Maybe an addCokkies method could be implemented? Maybe there is another simpler & smarter way to do this?

Do you mean cookies from the servlet?  Or other cookies in the environment? The first should already be there; the second sounds like it ought to be added to WebConversation.

>2. Need a way to set the User-Agent, e.g. to simulate different browsers

Should be added to WebConversation

>3. Setting used languages and other browser specific stuff would also be neat

Ditto

>4. Is there an easy way to handle Javascript popup:s?

JavaScript is tough. I haven't even considered it, as my current projects don't use it.

>5. Having a problem to find links that are "included" inside Forms using getLinks(). Maybe this a wrong way to do this?

I usually look for links inside table cells. I don't even know that it is meaningful to consider a link to be inside a form...

But the archive now includes code to find a link based on its text, or the alt text of its image.  You could use the archive version or wait for the next release.

>6. I 'm also using HttpUnit for testing WML/WAP. It would be very handy if it could also parse WML (non compiled)

I know nothing about WML, but patches are welcome. The trick would be to find a way to integrate this. Can you point me to some documentation?
 
>
>I've started to introduce HttpUnit to my whole project and soon all will be hooked...

Terrific!


As a general rule, I add things when I need them for the projects I'm working on, and I encourage others to do the same. If I don't immediately need something, I cannot always tell what a useful implementation would be. Test cases or examples would be helpful if you want me to do the implementation.

------------------------------------------------------------------------
Russell Gold                     | "... society is tradition and order
rus...@ac...    (preferred)  | and reverence, not a series of cheap
rus...@ne...              | bargains between selfish interests."
rg...@th...       |   - Poul Anderson, "Iron"

RE: [Httpunit-develop] HttpUnit 0.9.5 not encoding aware?

[Russell G. <rus...@ac...>]

At 12:04 AM -0400 8/10/00, Brian Hill wrote:
>>>We have some servlets which return data in UTF-8.
>>>I'm pretty sure HttpUnit is just assuming the platform encoding.
>
>>send me a test case and a patch I will incorporate them.
>
>I'm not sure I can do this easily.  HttpUnit should imitate Netscape and IE.
>They follow the convention of posting in the same encoding as they receive
>(where the encoding they receive in is specified in the HTTP headers, or if
>no encoding is specified in the header, then as specified in the document,
>although Netscape does this wrong (allows the document to override the
>header)).

Can you point me top some documentation on how this is supposed to work?  Including headers?

>
>Post-in-same-encoding-as-received means a coupling has to be introduced
>between the WebResponse of one hit and the WebRequest of the next.  I'll
>have to think about whether that can be introduced as simply a patch to the
>existing design.
>
>Running HttpUnit with -Dfile.encoding=UTF8 is a workaround for my situation.

Can you send me a test that demonstrates the problem? That is, a servlet or CGI along with some minimal client code that only works if you use this parameter?


------------------------------------------------------------------------
Russell Gold                     | "... society is tradition and order
rus...@ac...    (preferred)  | and reverence, not a series of cheap
rus...@ne...              | bargains between selfish interests."
rg...@th...       |   - Poul Anderson, "Iron"

[Httpunit-develop] Suggestions, Comments and Questions

[<Jan...@ed...>]

I've been using the HttpUnit now for a couple of weeks and like very much. 
I have some suggestions, comments and questions....

1. Need a way to set additional cookies. Maybe an addCokkies method could be implemented? Maybe there is another simpler & smarter way to do this?
2. Need a way to set the User-Agent, e.g. to simulate different browsers
3. Setting used languages and other browser specific stuff would also be neat
4. Is there an easy way to handle Javascript popup:s?
5. Having a problem to find links that are "included" inside Forms using getLinks(). Maybe this a wrong way to do this?
6. I 'm also using HttpUnit for testing WML/WAP. It would be very handy if it could also parse WML (non compiled) 

I've started to introduce HttpUnit to my whole project and soon all will be hooked...


                                      --Jan O.

RE: [Httpunit-develop] HttpUnit 0.9.5 not encoding aware?

[Brian H. <bh...@di...>]

>>We have some servlets which return data in UTF-8.
>>I'm pretty sure HttpUnit is just assuming the platform encoding.

>send me a test case and a patch I will incorporate them.

I'm not sure I can do this easily.  HttpUnit should imitate Netscape and IE.
They follow the convention of posting in the same encoding as they receive
(where the encoding they receive in is specified in the HTTP headers, or if
no encoding is specified in the header, then as specified in the document,
although Netscape does this wrong (allows the document to override the
header)).

Post-in-same-encoding-as-received means a coupling has to be introduced
between the WebResponse of one hit and the WebRequest of the next.  I'll
have to think about whether that can be introduced as simply a patch to the
existing design.

Running HttpUnit with -Dfile.encoding=UTF8 is a workaround for my situation.
--Brian

Re: [Httpunit-develop] HttpUnit 0.9.5 not encoding aware?

[Russell G. <rus...@ac...>]

At 1:41 PM -0400 8/8/00, Brian Hill wrote:
>We have some servlets which return data in UTF-8.  I am getting gibberish
>when I receive the response using HttpUnit.  I'm pretty sure HttpUnit is
>just assuming the platform encoding.  --Brian

You are right - if you would like to send me a test case and a patch, I will incorporate them.

------------------------------------------------------------------------
Russell Gold                     | "... society is tradition and order
rus...@ac...    (preferred)  | and reverence, not a series of cheap
rus...@ne...              | bargains between selfish interests."
rg...@th...       |   - Poul Anderson, "Iron"

[Httpunit-develop] HttpUnit 0.9.5 not encoding aware?

[Brian H. <bh...@di...>]

We have some servlets which return data in UTF-8.  I am getting gibberish
when I receive the response using HttpUnit.  I'm pretty sure HttpUnit is
just assuming the platform encoding.  --Brian

[Httpunit-develop] HttpUnit 0.95

[Russell G. <rus...@ac...>]

There is a new release of HttpUnit now available at 
<http:/httpunit.sourceforge.net>. This version makes a lot of testing tasks 
easier, obviating much of the need to use the DOM.   In particular:

     1. Nested tables are now supported (examples to follow) by using 
WebTable.getTableCell
     2. table columns and rows used only for formatting may now be ignored 
using WebTable.purgeEmptyCells
     3. It is now easy to find a table in a page based on the text in its 
first non-blank column and row,
        using WebResponse.getTableStartingWith
     4. All form controls should now be supported
     5. There is a preliminary cookbook available


In addition, it is now possible to browse the javadoc and cookbook from the 
web site.

[Httpunit-develop] HttpUnit 0.9.1 released

[Russell G. <rus...@ac...>]

The latest release, containing several bug-fixes, is now available from the 
project home page, <http://httpunit.sourceforge.net>

The release notes are as follows:

============
HttpUnit release notes

Known issues:
     1. There is no way to access nested tables.

29-Jun-00 0.9.1
Additions:
     1. The PostMethodWebRequest class is now public.
     2. Row and column spans are now handled
     3. Formatting inside table cells is ignored in computing the text 
value of a cell

19-Jun-00 0.9
Additions:
     1. The parser may be tested during the build by issuing the command: 
'ant test -Dclasspath="%classpath%"'
     2. WebResponse now can return an array of the top-level tables in the 
HTML response.
        Each table may now be asked for its size and the contents of each 
of its cells.

5-Jun-00   0.8.2
Additions:
     WebResponse now has a getDOM method which permits examination of the 
DOM equivalent of the response.

1-Jun-00   0.8.1
Problems corrected:
     Default parameter values are ignored
     Parameter values without explicit types were being ignored, rather 
than defaulting to TEXT
Additions:
     ExampleTest now demonstrates the use of httpunit and JUnit to test 
servlets
     NearWords demonstrates the use of httpunit to access web site 
functionality

03-May-00  0.8
Initial public release
============

[Httpunit-develop] httpunit 0.9

[Russell G. <rus...@ac...>]

I have just release version 0.9 of httpunit, which is accessible at the web site: <http://httpunit.sourceforge.net>.  This release includes some support for testing html tables. See the release notes for details.

------------------------------------------------------------------------
Russell Gold                     | "... society is tradition and order
rus...@ac...    (preferred)  | and reverence, not a series of cheap
rus...@ne...              | bargains between selfish interests."
rus...@ao...                 |   - Poul Anderson, "Iron"