simpletest-support — Help, advice, bugs and workarounds.

Re: [Simpletest-support] Call for features

[culley h. <cu...@fa...>]

On Wed, 10 Mar 2004 19:42:39 +0000, "Marcus Baker" <ma...@la...>
said:

> 
> I am actually working on this right now. I'll post a follow up when this 
> is in place so taht you can use the CVS version if needed.
> 


That would be great!

culley

Re: [Simpletest-support] ClickSubmit Not advancing to the next page

[culley h. <cu...@fa...>]

On Wed, 10 Mar 2004 23:41:37 +0000, "Marcus Baker" <ma...@la...>
said:

> 
> If it works in abrowser normally, but doesn't work in SimpleTest then it 
> is very much my problem :(. I cannot do anything about JavaScript, but I 
> would assume that the library would detect the lack of JavaScript 
> support and do something sensible. Can you disable JS in your browser 
> and try it visually?
> 
> 

It worked with javascript disabled.  Attached is a stripped down
reproduction.  The second test fails for me:

        $this->get("http://$server/x.php");
        $this->assertWantedPattern('/Payment/');
        $this->setField('payment_type', '1');
        $this->assertTrue($this->clickSubmit('Next'));

I am still not entirely convinced that this isn't user (me) error...

culley

Re: [Simpletest-support] ClickSubmit Not advancing to the next page

[Marcus B. <ma...@la...>]

Hi...

Culley Harrelson wrote:
> Yes I am redirecting.  I could just test the redirected page. in a 
> separate get...

That would be good. If you did down you can hack SimpleTest to print the 
headers as they come in. Possibly the redirect failed.

> I am sure it is something strange in my setup.

If it works in abrowser normally, but doesn't work in SimpleTest then it 
is very much my problem :(. I cannot do anything about JavaScript, but I 
would assume that the library would detect the lack of JavaScript 
support and do something sensible. Can you disable JS in your browser 
and try it visually?

> culley

Thanks for teh information so far.

yors, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

Re: [Simpletest-support] WEb testing with multiple functions

[Marcus B. <ma...@la...>]

Hi...

Thomas Purdy wrote:
 > I have a function that logs in to the website and verifies that it is
 > then passed to the welcome page.  Next I would like to write a function
 > that then checks the welcome page.  I have them both in the same class
 > php file.  The problem is that on the second function I can not find the
 > page.  What do I need to do to be able to not have all my code in one
 > big function?

class MyTest extends WebTestCase {
      function MyTest() {
          $this->WebTestCase();
      }
      function fetchLoginPage() {
          // Fetch the page here.
          // Submit to the next page.
      }
      function assessWelcomePage() {
          // Check the welcome page here.
      }
      function testLoginSequence() {
          $this->fetchLoginPage();
          $this->assessWelcomePage();
      }
}

Only methods that start with the string "test" are run automatically.
Other methods can be added to the class as you need.

 > Thomas
 >

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

Re: [Simpletest-support] ClickSubmit Not advancing to the next page

[Marcus B. <ma...@la...>]

Hi...

Thomas Purdy wrote:
> I made this simple function that I find really useful...

> function displayUrl() {
> 	echo ($this->_browser->getCurrentUrl()."<br>");
> }

Ok, I can take a hint :). I'll add a similar method to the next release. 
I'll be adding a WebTestCase::showHeaders() method as well.

yors, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

[Simpletest-support] WEb testing with multiple functions

[Thomas P. <tp...@in...>]

Hi,
 
I have a function that logs in to the website and verifies that it is
then passed to the welcome page.  Next I would like to write a function
that then checks the welcome page.  I have them both in the same class
php file.  The problem is that on the second function I can not find the
page.  What do I need to do to be able to not have all my code in one
big function?
 
Thomas

Re: [Simpletest-support] ClickSubmit Not advancing to the next page

[Culley H. <cu...@fa...>]

On Mar 10, 2004, at 11:47 AM, Marcus Baker wrote:

> Hi...
>
> Culley Harrelson wrote:
>> And this is failing.
>
> Try doing a $this->showSource() just after the submit. It is possible 
> some other error has occoured. Otherwise I can only progress this with 
> an isolated test of some kind. Is there anything special about the 
> submit? If memory serves you can do this...
>

Show source after submit does nothing.  Before submit, it does show the 
source.

> $this->assertTrue($this->clickSubmit);
>

This fails.

> ...just to confirm success. Are you redirecting after the submit?
>

Yes I am redirecting.  I could just test the redirected page. in a 
separate get...

>> Pattern [/should exist on next page after button is clicked/] not 
>> detected in [Boolean: false]
>
> False implies no content at all from the page. can you place the two 
> pages on the web so taht I can try it from my end?
>

Unfortunately I can't.  It is normally password protected and it is 
using a bunch of libraries that haven't made it into production yet.  I 
will keep working on this-- I am sure it is something strange in my 
setup.

One possible problem is there is an onclick even for the submit button:

<input name="save_changes" onclick="save_changes.disabled=true;" 
type="submit" value="Next">

This form was created with the phphtmllib form objects and this is 
added automatically.  It doesn't seem like this should cause a problem 
but maybe it does?  I haven't figured out how to disable this and 
haven't had the time to build a test that doesn't include it.

culley

RE: [Simpletest-support] ClickSubmit Not advancing to the next page

[Thomas P. <tp...@in...>]

Culley:

I made this simple function that I find really useful to make sure I am
on the correct page.  I hope my meager attempts help.  Just put it in
your web tester php .  Good luck.

Thomas


function displayUrl() {
	echo ($this->_browser->getCurrentUrl()."<br>");
}

-----Original Message-----
From: sim...@li...
[mailto:sim...@li...] On Behalf Of
Culley Harrelson
Sent: Wednesday, March 10, 2004 12:19 PM
To: simpletest-support
Subject: [Simpletest-support] ClickSubmit Not advancing to the next page

Hi,

I am doing some form testing and trying to do this:

         $this->clickSubmit('Next');
         $this->assertWantedPattern('/should exist on next page after 
button is clicked/');

And this is failing.  Shouldn't this work?  I am getting

Pattern [/should exist on next page after button is clicked/] not 
detected in [Boolean: false]

Mostly I just wanted to be assured that I should be able to 
assertWantedPattern on the results page after clickSubmit sends a post.

culley



-------------------------------------------------------
This SF.Net email is sponsored by: IBM Linux Tutorials
Free Linux tutorial presented by Daniel Robbins, President and CEO of
GenToo technologies. Learn everything from fundamentals to system
administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
_______________________________________________
Simpletest-support mailing list
Sim...@li...
https://lists.sourceforge.net/lists/listinfo/simpletest-support

Re: [Simpletest-support] Call for features

[Marcus B. <ma...@la...>]

Hi...

Culley Harrelson wrote:
> I just started testing with WebTestCase and ran into an immediate snag  
> with basic user authentication.  I see this is already on your todo  
> list...

I am actually working on this right now. I'll post a follow up when this 
is in place so taht you can use the CVS version if needed.

> culley

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

[Simpletest-support] ClickSubmit Not advancing to the next page

[Culley H. <cu...@fa...>]

Hi,

I am doing some form testing and trying to do this:

         $this->clickSubmit('Next');
         $this->assertWantedPattern('/should exist on next page after 
button is clicked/');

And this is failing.  Shouldn't this work?  I am getting

Pattern [/should exist on next page after button is clicked/] not 
detected in [Boolean: false]

Mostly I just wanted to be assured that I should be able to 
assertWantedPattern on the results page after clickSubmit sends a post.

culley

Re: [Simpletest-support] Call for features

[Culley H. <cu...@fa...>]

I just started testing with WebTestCase and ran into an immediate snag  
with basic user authentication.  I see this is already on your todo  
list...  I should be able test most things by turning off  
authentication on the development machine but it would be great not to  
have to modify my environment.

culley

On Mar 3, 2004, at 6:59 PM, Marcus Baker wrote:

> Hi.
>
> I am restarting development towards a version 1.0 and am keen to hear  
> what features people would like to see. I have the usual iteration  
> TODO list in the CVS tree here...
>
> http://cvs.sourceforge.net/viewcvs.py/simpletest/simpletest/TODO? 
> rev=1.192&view=auto
>
> yours, Marcus
> -- 
> Marcus Baker, ma...@la..., no...@ap...

RE: [Simpletest-support] Viewing Second page after a Submit

[Thomas P. <tp...@in...>]

Ok, I don't have the access to change the redirect page to have the full
URL. Do you have any suggestions for a newbie at php.

thomas


Hi...

Thomas Purdy wrote:
> I having been trying to use simple test to a system that is complex.
I 
> have simple test so that it will submit the form and it seems to be 
> authenticating the login just fine but the second page I get is 
> http:///welcome/welcome  without any data to go along with it.  If 
> anyone has any suggestions I could really use it.  Thank you
> 

I take it that it works normally. Are you issuing a redirect to get to 
the welcome page? If so try putting in a full URL. SimpleTest currently 
expects the location header to be fully qualified.

If that's not it, then I would need more information.

> Thomas
> 

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

Re: [Simpletest-support] Viewing Second page after a Submit

[Marcus B. <ma...@la...>]

Hi...

Thomas Purdy wrote:
> I having been trying to use simple test to a system that is complex.  I 
> have simple test so that it will submit the form and it seems to be 
> authenticating the login just fine but the second page I get is 
> http:///welcome/welcome  without any data to go along with it.  If 
> anyone has any suggestions I could really use it.  Thank you
> 

I take it that it works normally. Are you issuing a redirect to get to 
the welcome page? If so try putting in a full URL. SimpleTest currently 
expects the location header to be fully qualified.

If that's not it, then I would need more information.

> Thomas
> 

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

[Simpletest-support] Viewing Second page after a Submit

[Thomas P. <tp...@in...>]

I having been trying to use simple test to a system that is complex.  I
have simple test so that it will submit the form and it seems to be
authenticating the login just fine but the second page I get is
http:///welcome/welcome  without any data to go along with it.  If
anyone has any suggestions I could really use it.  Thank you
 
Thomas

Re: [Simpletest-support] Call for features

[Culley H. <cu...@fa...>]

perfect!

On Mar 4, 2004, at 4:22 PM, Marcus Baker wrote:

> $this->assertEqual(1, 2, __LINE__ . ' %s');

Re: [Simpletest-support] Call for features

[Marcus B. <ma...@la...>]

Hi...

Culley Harrelson wrote:
> I was going to suggest this too!  I have been doing:
> 
> $this->assertEqual(1, 2, __LINE__);

If you embed %s in the message you get the original. So...

$this->assertEqual(1, 2, __LINE__ . ' %s');

...will do the trick (I hope).

> culley

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

Re: [Simpletest-support] Call for features

[Culley H. <cu...@fa...>]

I was going to suggest this too!  I have been doing:

$this->assertEqual(1, 2, __LINE__);

But then you don't get the default message which is often helpful.   
Appending the user message to the default message (rather than  
replacing it) would solve this...

culley

On Mar 4, 2004, at 1:33 AM, Zbynek Winkler wrote:

> Hello,
>
> what about the line numbers of the failed tests that we've talked  
> about earlier?
>
> Zbynek
>
> Marcus Baker wrote:
>
>> Hi.
>>
>> I am restarting development towards a version 1.0 and am keen to hear  
>> what features people would like to see. I have the usual iteration  
>> TODO list in the CVS tree here...
>>
>> http://cvs.sourceforge.net/viewcvs.py/simpletest/simpletest/TODO? 
>> rev=1.192&view=auto
>>
>> yours, Marcus
>
>
>
> -- 
> http://zw.matfyz.cz/     http://robotika.cz/
> Faculty of Mathematics and Physics, Charles University, Prague, Czech  
> Republic
>
>
>
> -------------------------------------------------------
> This SF.Net email is sponsored by: IBM Linux Tutorials
> Free Linux tutorial presented by Daniel Robbins, President and CEO of
> GenToo technologies. Learn everything from fundamentals to system
> administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
> _______________________________________________
> Simpletest-support mailing list
> Sim...@li...
> https://lists.sourceforge.net/lists/listinfo/simpletest-support

Re: [Simpletest-support] Call for features

[Zbynek W. <zw...@us...>]

Hello,

what about the line numbers of the failed tests that we've talked about 
earlier?

Zbynek

Marcus Baker wrote:

> Hi.
>
> I am restarting development towards a version 1.0 and am keen to hear 
> what features people would like to see. I have the usual iteration 
> TODO list in the CVS tree here...
>
> http://cvs.sourceforge.net/viewcvs.py/simpletest/simpletest/TODO?rev=1.192&view=auto 
>
>
> yours, Marcus



-- 
http://zw.matfyz.cz/     http://robotika.cz/
Faculty of Mathematics and Physics, Charles University, Prague, Czech Republic

[Simpletest-support] Call for features

[Marcus B. <ma...@la...>]

Hi.

I am restarting development towards a version 1.0 and am keen to hear 
what features people would like to see. I have the usual iteration TODO 
list in the CVS tree here...

http://cvs.sourceforge.net/viewcvs.py/simpletest/simpletest/TODO?rev=1.192&view=auto

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

[Simpletest-support] [Fwd: Re: Testing FAQ, new tool entry.]

[Marcus B. <ma...@la...>]

Hi.

I was submitting SimpleTest to various test tool indexes and received 
this reply from Danny Fraught. If anybody wants to write a review, feel 
free.

yours, Marcus

Here is the reply...

Marcus Baker wrote:
 > I thought you might want to add this to your list under unit test 
tools...

Thanks I have you in the queue.  I had run across this tool after I
published the unit test tool survey for Open Testware Reviews, which is
when I built the unit test page for testingfaqs.org.

If you know anyone not on the core development team who would like to
review the tool for Open Testware Reviews, please let me know.  I'm
curious how it compares to phpAsserUnit and PhpUnit.

Also, if you're interested in Open Testware Reviews, let me know - test
tool developers get a 50% discount.  See
http://tejasconsulting.com/open-testware/.
-- 
Danny R. Faught
Tejas Software Consulting
http://tejasconsulting.com/


-- 
Marcus Baker, ma...@la..., no...@ap...

Re: [Simpletest-support] web test question

[Marcus B. <ma...@la...>]

Hi...

Jason Sweat wrote:
 > A thought just crossed my mind that SimpleTest may be the answer to 
another
 > problem I am having at work.

I have used a previous incarnation of SimpleTest to do web site
monitoring before. As far as e-mailing and the like goes, there is a
nearly finished tool called Midas. It makes sense that SimpleTest is
scriptable so that it can be used within such applications. Getting
SimpleTest to do this kind of stuff straight is certainly possible
though. EmailReporter anyone? Also there is an XML transport system in
there already. Just run the visual_test.php from the command line and
then remote_test.php from the browser. You have to edit remote_test.php
to set the document root which is why it is not run in the main test suite.

 > I was thinking that with a php-cli and simpletest I might be able to 
do the
 > same thing.  Off the top of my head I did not know if the web tester 
would
 > handle:
 > a) SSL connections

Not scheduled, but for testing outside the LAN this is essential. I
haven't read up on the Curl support because PHP5 is supposed to be
getting https support anyway. How easy is it to use? I am going to try
to squeeze in simple HTTP authentication into version 1.0 at least, as I
have a requirement for it at work.

 > b) session cookie passing

Already done.

 > c) some kind of AssertMaxTime() for the fetch

This has been implemented at the socket level, but not yet exposed
higher up. I will stick it onto the TODO. It all boils down to the
SimpleUserAgent class talking to the SimpleHttpRequest class.

 > d) frames (I was just fetching the frameset and ignoring it becuase I 
knew
 > where I wanted to go anyway)

This is scheduled for version 1.0 and I think I know how to do this now
the browser is a separate entity.

 >
 > Am I on the right track?

I hope so. I would like to think of SimpleTest as a toolkit that other
open source developers can turn into other tools. I think it is going to
have to go through a lot more evolution before that is realised, though :(.

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

[Simpletest-support] web test question

[Jason S. <jsw...@ya...>]

Marcus,

A thought just crossed my mind that SimpleTest may be the answer to another
problem I am having at work.  I am monitoring our extranet site for the time it
takes to query certain pages, and emailing myself if the time is greater than a
certain threshold.  I just hacked out a unix shell script using time, curl and
mailx as a first cut.

I was thinking that with a php-cli and simpletest I might be able to do the
same thing.  Off the top of my head I did not know if the web tester would
handle:
a) SSL connections
b) session cookie passing
c) some kind of AssertMaxTime() for the fetch
d) frames (I was just fetching the frameset and ignoring it becuase I knew
where I wanted to go anyway)

Am I on the right track?

__________________________________
Do you Yahoo!?
Yahoo! Mail SpamGuard - Read only the mail you want.
http://antispam.yahoo.com/tools

Re: [Simpletest-support] Beta4 released

[Marcus B. <ma...@la...>]

Hi...

Matt Griffin wrote:
> Is it simplest to use PHP assert to crash
> the testing if a key assertion fails?

That won't help. Simply returning from the test method will of course. I 
find I tend to write qute small test methods these days, usually not 
more than a dozen lines, so I don't tend to have this problem.

> Matt

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...

RE: [Simpletest-support] Beta4 released

[Matt G. <mgr...@ne...>]

Sweet, we'll begin testing it today.

I haven't noticed if there is a way to test if an assertion failed.  I'd
like to do come conditional testing to save myself overly long dumps.  For
instance, if the login fails, there is no point in proceeding since
everything afterwards will fail.  Is it simplest to use PHP assert to crash
the testing if a key assertion fails?

Thanks for your efforts,

Matt

[Simpletest-support] Beta4 released

[Marcus B. <ma...@la...>]

Hi.

SimpleTest1.0beta4 has been released.

This one was a real struggle as there was a lot of refactoring to get 
the web browser portion into one top level class. The feature set can be 
seen from the Sourceforge release notes, but the most significant 
changes are the error trapping now respects PHP ini file settings (and 
hopefully doesn't crash PHP5 boxes) and the web browser can be used 
independently.

As usual the documentation is a little behind. Having a separate web 
browser means that a UnitTestCase can be used when a WebTestCase is too 
course grained. For example...

class ConfirmingRandomPassword extends UnitTestCase {
     function ConfirmingRandomPassword() {
         $this->UnitTestCase();
     }
     function testAutoPasswordMatchesDatabaseEntry() {
         $browser = &new SimpleBrowser();
         $browser->get('http://portal.com/join.php');
         $browser->setField('name', 'Me');
         $browser->clickSubmit('Join');
         preg_match(
                 '/your password is (.*?)\s/',
                 $browser->getContent(),
                 $matches);
         $this->assertNotNull($matches[1]);

         $finder = &new LoginFinder();
         $login = &$finder->findByName('Me');
         $this->assertTrue($login);
         $this->assertIdentical($matches[1], $login->getPassword());
     }
}

Another possibility is when you want to test that multiple logins to a 
system are denied.

yours, Marcus
-- 
Marcus Baker, ma...@la..., no...@ap...