simpletest-support — Help, advice, bugs and workarounds.

[Simpletest-support] Feature Request: make more assertion tests available in WebTestCase

[Culley H. <cu...@fl...>]

It looks like WebTestCase is a decendant of SimpleTestCase which has 
assertTrue.  You can get a lot done with assertTrue but why not have 
things like assertEqual and assertNotNull available in WebTestCase?

It might also be interesting to be able to extract data from the 
patterns matched:

$this->assertWantedPattern('/Order Number:\s(\d+)-(\d+)/', $matches);

where $matches would be loaded with data matched in the sub-patterns 
(preg_match style).  I haven't needed this but I could see how it might 
be useful.

culley

[Simpletest-support] webform test not following redirect

[Culley H. <cu...@fl...>]

I am once again hitting the problem of a webtest not following the 
redirect after form submission.  Here is a working example:

         $this->get('http://mudhut.org/test_form.php');
         $this->assertField('blah', '');
         $this->setField('blah', 'jabberwokky');
         $this->clickSubmit('Submit Query');
         $this->showSource();
         $this->assertWantedPattern('/jabberwokky/');

All test_form.php is doing is:

<?php
if (array_key_exists('blah', $_POST)) {
     header("Location: results.php?blah={$_POST['blah']}");
     exit;
}
?>

And results.php:

<?php
print_r($_GET);
?>

Re: [Simpletest-support] Command Line testing?

[Marcus B. <ma...@la...>]

Hi...

Thomas Purdy wrote:
> I was wondering if beta 4 of simpletest has a command line interface.  I 
> saw that one has been written but is it just in beta5?  Thanks

Yes. Nothing really changed with this from Beta4 to Beta5. There is also 
a ShellTestCase for testing scripts that run on the command line, but 
that is decidedly experimental and needs cleaning up with the newer 
streams interface.

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

[Simpletest-support] Command Line testing?

[Thomas P. <tp...@in...>]

I was wondering if beta 4 of simpletest has a command line interface.  I
saw that one has been written but is it just in beta5?  Thanks
 
Thomas Purdy
 

Re: [Simpletest-support] should TextReporter show passes?

[Jason S. <jsw...@ya...>]

--- Marcus Baker <ma...@la...> wrote:
> Hi...
> 
> Jason Sweat wrote:
> > to be consistent with the HtmlReporter, should the TextReport show a pass
> count
> > as well?
> > 
> > If no one objects, I will commit it sometime in the next couple of days.
> 
> I was trying to be compatible with JUnit originally, but I agree it is 
> rather confusing. Go ahead.

Done

__________________________________
Do you Yahoo!?
Yahoo! Small Business $15K Web Design Giveaway 
http://promotions.yahoo.com/design_giveaway/

[Simpletest-support] clickLink() for anchors around images

[Jason S. <jsw...@ya...>]

Here is the problem:

<a 
href="/framework/frameset.jsp?centerName=Personal+Center&amp;mainUrl=%2Fpersonal%2Findex.jsp%3FmenuId%3D4001"
target="_top"  title="Personal Center" ><img  src="/images/menu-hdpers.gif" 
alt="Personal Center" ></a>

Here is what I want to do:
$this->clickLink('Personal Center');

Here is what is working now:
$this->clickLink(
    '<img  src="/images/menu-hdpers.gif"  alt="Personal Center" >');

So here is my thought: can "clickLink"s also be indexed by the alt/title
attributes of any images inside of the anchor tag?


__________________________________
Do you Yahoo!?
Yahoo! Small Business $15K Web Design Giveaway 
http://promotions.yahoo.com/design_giveaway/

[Simpletest-support] should TextReporter show passes?

[Jason S. <jsw...@ya...>]

to be consistent with the HtmlReporter, should the TextReport show a pass count
as well?

If no one objects, I will commit it sometime in the next couple of days.


example:

OK
Test cases run: 1/1, Passes: 13, Failures: 0, Exceptions: 0


$ cvs diff reporter.php
Index: reporter.php
===================================================================
RCS file: /cvsroot/simpletest/simpletest/reporter.php,v
retrieving revision 1.23
diff -c -r1.23 reporter.php
*** reporter.php        6 Apr 2004 03:29:04 -0000       1.23
--- reporter.php        6 Apr 2004 15:04:36 -0000
***************
*** 182,187 ****
--- 182,188 ----
              }
              print "Test cases run: " . $this->getTestCaseProgress() .
                      "/" . $this->getTestCaseCount() .
+                     ", Passes: " . $this->getPassCount() .
                      ", Failures: " . $this->getFailCount() .
                      ", Exceptions: " . $this->getExceptionCount() . "\n";


__________________________________
Do you Yahoo!?
Yahoo! Small Business $15K Web Design Giveaway 
http://promotions.yahoo.com/design_giveaway/

[Simpletest-support] web test SSL support

[Jason S. <jsw...@ya...>]

Just a quick note to everyone that I checked into CVS a version of the
WebTestCase class that supports SSL connections.  For this to work, you will
need php 4.3.0 or greater, and openssl compiled in.

To use, just put https as the url scheme:

class TestSsl extends WebTestCase
{
	function TestSsl($name='') {
		$this->WebTestCase($name);
	}
	function TestFetch() {
		$this->assertTrue($this->get('https://www.some.secure.site/'));
	}
}

Please let me know if you experience any issues with it.

Regards,

Jason

__________________________________
Do you Yahoo!?
Yahoo! Small Business $15K Web Design Giveaway 
http://promotions.yahoo.com/design_giveaway/

Re: [Simpletest-support] webtest baby steps

[Marcus B. <ma...@la...>]

Hi...

Jason Sweat wrote:
> --- Marcus Baker <ma...@la...> wrote:
> That worked for http: but https: did not work on the php 4.3.0 system I was
> testing on.  Will look at it on php 5.0.0RC1 shortly.

It probably won't. I just read the bit in the PHP manual where it said 
stick "tls:" at the start of the host in the socket request :/. I have 
never tested it. I have wrapped everything in a class called 
SimpleSecureSocket in the socket.php file. Basically if you can get this 
class working, with CURL or something, then you are doing better than me :).

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

Re: [Simpletest-support] webtest baby steps

[Jason S. <jsw...@ya...>]

--- Marcus Baker <ma...@la...> wrote:
> Jason Sweat wrote:
> > require_once(LIB_SIMPLETEST . 'web_tester.php');
> > require_once(LIB_SIMPLETEST . 'reporter.php');
> 
> Can you change this to just SIMPLE_TEST as this is the constant it uses 
> internally to find it's files.
> 

That worked for http: but https: did not work on the php 4.3.0 system I was
testing on.  Will look at it on php 5.0.0RC1 shortly.


__________________________________
Do you Yahoo!?
Yahoo! Finance Tax Center - File online. File on time.
http://taxes.yahoo.com/filing.html

Re: [Simpletest-support] webtest baby steps

[Marcus B. <ma...@la...>]

Hi...

Some additional info. If I take off the https and make it http, it 
fetches a page.

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

[Simpletest-support] Re: SimpleTest

[Marcus B. <ma...@la...>]

Hi...

Dave Montgomery wrote:
 > Thanks for writing SimpleTest and making it freely available. It's very
 > helpful, well thought out, easy to use, and kicks some serious ass all
 > around.

Well thanks very much from myself, Harry and Jason.

  >I can hardly wait for the next release (HTTP auth will be very
 > helpful).

It's out.

 > Dave Montgomery

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

Re: [Simpletest-support] webtest baby steps

[Marcus B. <ma...@la...>]

Jason Sweat wrote:
> require_once(LIB_SIMPLETEST . 'web_tester.php');
> require_once(LIB_SIMPLETEST . 'reporter.php');

Can you change this to just SIMPLE_TEST as this is the constant it uses 
internally to find it's files.

> 
> Fatal error: Call to undefined function: getcontent() in
> /home/sweatje/public_html/simpletest/web_tester.php on line 45

With the change of constant I get (in a browser)...

testalcoadirect
Fail: testhomepage->True assertion got False

simplebrowser

1/1 test cases complete: 0 passes, 1 fails and 0 exceptions.
> 
> Something easy I am missing??  I could fetch the site with other tools to get
> the source code, but I thought I would just try to do it all inside of php.

It should work - must be the constant.

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

[Simpletest-support] webtest baby steps

[Jason S. <jsw...@ya...>]

define('LIB_SIMPLETEST','../simpletest/');
define('AD', 'https://www.alcoadirect.com/');

require_once(LIB_SIMPLETEST . 'web_tester.php');
require_once(LIB_SIMPLETEST . 'reporter.php');

class TestAlcoaDirect extends WebTestCase
{
	function TestAlcoaDirect($psName='') {
		$this->WebTestCase($psName);
	}
	function testHomepage() {
		$this->assertTrue($this->get(AD));
		$this->dump(get_class($browser =& $this->GetBrowser()));
		$this->showSource();
	}
}

$test = &new TestAlcoaDirect();

if (TextReporter::inCli()) {
	exit ($test->run(new TextReporter()) ? 0 : 1);
}
$test->run(new HtmlReporter());


Script Output:

testalcoadirect

simplebrowser

Fatal error: Call to undefined function: getcontent() in
/home/sweatje/public_html/simpletest/web_tester.php on line 45

Something easy I am missing??  I could fetch the site with other tools to get
the source code, but I thought I would just try to do it all inside of php.

__________________________________
Do you Yahoo!?
Yahoo! Finance Tax Center - File online. File on time.
http://taxes.yahoo.com/filing.html

Re: [Simpletest-support] Beta5 release

[Jason S. <jsw...@ya...>]

--- Culley Harrelson <cu...@fa...> wrote:
> 
> On Mar 31, 2004, at 6:22 AM, Marcus Baker wrote:
> 
> >
> > Anyone know how it's encoded? SimleTest could accept encoded URLs 
> > pretty easily and I wouldn't have to change the parsing.
> >
> > Culley: Does the URL work on a web browser? I keep finding that 
> > browsers do things that the standard doesn't, for example short form 
> > redirects.
> >
> 
> Firefox (win, mac) will do the encoding and handle it but IE, Safari, 
> wget and curl will not.  Once you encode it manually IE (win, mac), 
> Safari, wget and curl will also will handle it. w3m just ignores the 
> user name:password and prompts you.
> h
> %40 = @
> 
> culley

IIRC, on of IE's "security patches" recently was to disallow the encoding of @
because of "url cloaking" i.e. http://www.microsoft.com:?looks/like/a/pag...@ba.../do/nasty/things

__________________________________
Do you Yahoo!?
Yahoo! Finance Tax Center - File online. File on time.
http://taxes.yahoo.com/filing.html

Re: [Simpletest-support] Beta5 release

[Culley H. <cu...@fa...>]

On Mar 31, 2004, at 6:22 AM, Marcus Baker wrote:

>
> Anyone know how it's encoded? SimleTest could accept encoded URLs 
> pretty easily and I wouldn't have to change the parsing.
>
> Culley: Does the URL work on a web browser? I keep finding that 
> browsers do things that the standard doesn't, for example short form 
> redirects.
>

Firefox (win, mac) will do the encoding and handle it but IE, Safari, 
wget and curl will not.  Once you encode it manually IE (win, mac), 
Safari, wget and curl will also will handle it. w3m just ignores the 
user name:password and prompts you.

%40 = @

culley

Re: [Simpletest-support] Beta5 release

[Jason S. <jsw...@ya...>]

--- Marcus Baker <ma...@la...> wrote:
> Jason Sweat wrote:
> > I can't run the boundary test suite because I am behind a firewall which
> > requires a proxy server for port 80 outbound.  Is there a way to configure
> it
> > such that I can seamlessly use a proxy with these tests?
> 
> Ouch. I have a kind of private rule that if two people ask for a feature 
> I should put it in. A couple of days ago someone else asked for proxy 
> support as well.
> 
> I want to get a version 1.0 out and I need frames myself. If more people 
> want proxy support I could drop frames support or delay the relese by a 
> week.

Perhaps this request actually belongs outside of SimpleTest.  Wondering if I
need to setup a Transparent Proxy?

http://en.tldp.org/HOWTO/TransparentProxy.html

__________________________________
Do you Yahoo!?
Yahoo! Finance Tax Center - File online. File on time.
http://taxes.yahoo.com/filing.html

Re: [Simpletest-support] Beta5 release

[Marcus B. <ma...@la...>]

Hi...

Jason Sweat wrote:
>If the character corresponding to an octet is
>    reserved in a scheme, the octet must be encoded. 

Anyone know how it's encoded? SimleTest could accept encoded URLs pretty 
easily and I wouldn't have to change the parsing.

Culley: Does the URL work on a web browser? I keep finding that browsers 
do things that the standard doesn't, for example short form redirects.

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

Re: [Simpletest-support] Beta5 release

[Marcus B. <ma...@la...>]

Hi...

Jason Sweat wrote:
> I can't run the boundary test suite because I am behind a firewall which
> requires a proxy server for port 80 outbound.  Is there a way to configure it
> such that I can seamlessly use a proxy with these tests?

Ouch. I have a kind of private rule that if two people ask for a feature 
I should put it in. A couple of days ago someone else asked for proxy 
support as well.

I want to get a version 1.0 out and I need frames myself. If more people 
want proxy support I could drop frames support or delay the relese by a 
week.

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

Re: [Simpletest-support] Beta5 release

[Jason S. <jsw...@ya...>]

--- Marcus Baker <ma...@la...> wrote:> 
> The other main fixes are with PHP5. I haven't been able to get XML 
> support working properly, so this side of things may not work at all. 
> Sorry, but I just couldn't test it. Also completely untested is SSL 
> support so please don't play with matches and definitely don't use these 
> features. I haven't tested this one Windows either as that box got wiped 
> so that I could place PHP5 on Linux. Please someone tell me if there are 
> any problems on this environment or any other.

I have run the unit_tests on my php5 system with no problems:

Unit tests
68/68 test cases complete: 1297 passes, 0 fails and 0 exceptions.

PHP Version 5.0.0RC1
System 	Linux prdweb 2.6.3-gentoo-r1 #1 Wed Mar 24 02:02:30 CST 2004 i686

I can't run the boundary test suite because I am behind a firewall which
requires a proxy server for port 80 outbound.  Is there a way to configure it
such that I can seamlessly use a proxy with these tests?

__________________________________
Do you Yahoo!?
Yahoo! Finance Tax Center - File online. File on time.
http://taxes.yahoo.com/filing.html

Re: [Simpletest-support] Beta5 release

[Jason S. <jsw...@ya...>]

--- Culley Harrelson <cu...@fa...> wrote:
> 
> On Mar 30, 2004, at 7:50 PM, Jason Sweat wrote:
> 
> > What you are constructing is not a valid URL.  From the RFC
> > (http://www.ietf.org/rfc/rfc1738.txt):
> 
> SimpleUrl allows you to embed the user name and password dsn style...

As does the RFC for any URL, however, if you are going to include tokens that
are part of the parsing structure in inappropriate spots, how will any system
have a hope of correctly interpreting what you want?  You need to URL encode
the "@" that is a part of your data, and not URL encode the @ that is part of
the URL.

__________________________________
Do you Yahoo!?
Yahoo! Finance Tax Center - File online. File on time.
http://taxes.yahoo.com/filing.html

Re: [Simpletest-support] Beta5 release

[Culley H. <cu...@fa...>]

On Mar 30, 2004, at 7:50 PM, Jason Sweat wrote:

> What you are constructing is not a valid URL.  From the RFC
> (http://www.ietf.org/rfc/rfc1738.txt):

SimpleUrl allows you to embed the user name and password dsn style...

culley

Re: [Simpletest-support] Beta5 release

[Jason S. <jsw...@ya...>]

--- Culley Harrelson <cu...@fa...> wrote:
> Something like:
> 
> $this->get('http://me@example.com:sec...@ad.../ 
> ');
> 
> Must be that extra @...

What you are constructing is not a valid URL.  From the RFC
(http://www.ietf.org/rfc/rfc1738.txt):
Reserved:

   Many URL schemes reserve certain characters for a special meaning:
   their appearance in the scheme-specific part of the URL has a
   designated semantics. If the character corresponding to an octet is
   reserved in a scheme, the octet must be encoded.  The characters ";",
   "/", "?", ":", "@", "=" and "&" are the characters which may be
   reserved for special meaning within a scheme. No other characters may
   be reserved within a scheme.
...
   Thus, only alphanumerics, the special characters "$-_.+!*'(),", and
   reserved characters used for their reserved purposes may be used
   unencoded within a URL.



__________________________________
Do you Yahoo!?
Yahoo! Finance Tax Center - File online. File on time.
http://taxes.yahoo.com/filing.html

Re: [Simpletest-support] Beta5 release

[Marcus B. <ma...@la...>]

Hi...

Culley Harrelson wrote:
> $this->get('http://me@example.com:sec...@ad.../ ');
> 
> Must be that extra @...

It is. I guess that's why I am still in beta ;).

I'll have a play with various web browsers to see how they deal with it. 
The problem is going to be URLs like...

http://me@example.com:se...@ad.../?a=...@ex...

...without wrecking the short form parsing. Looks like the SimpleUrl 
class is going to get more complicated. Thanks for pointing this out, 
anyway. This information is definitely valuable.

> 
> culley

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

Re: [Simpletest-support] Beta5 release

[Culley H. <cu...@fa...>]

On Mar 30, 2004, at 5:20 PM, Marcus Baker wrote:
>
> Fantastic! I have released it all but 30 seconds ago and you have  
> reduced it to a train wreck :).
>

Glad I could... help :)

> I am afraid I just didn't think of that one. Could you post a sample  
> URL with the mangled characters in. I am not exactly sure of the  
> parsing rules to cope with this (frankly I didn't even know it was  
> legal). I assume if you use the authenticate() method all is OK.
>

Something like:

$this->get('http://me@example.com:sec...@ad.../ 
');

Must be that extra @...

culley