I've just created a really barebones checklist highlighting the key modules of VuFind and a few major tests:

 

http://www.vufind.org/wiki/testing_checklist

 

This is just intended as a seed for future development -- some bullets should probably be expanded with sub-steps, and there are a lot of unmentioned features that deserve testing.  I encourage anyone who's interested to take a look and add more notes.  I just wanted to get the ball rolling for now….

 

I also realize that it may be an act of insanity to think that a bullet list in a wiki will serve as anything like a comprehensive testing tool.  If anyone has advice on a better way to manage a list of test cases or tools to automate some of these tests, I'd love to hear it.  In the meantime, this seemed like a simple way to start capturing "gotchas" that we can keep an eye on as we prepare for releases.

 

- Demian

 

From: Ya'aqov Ziso [mailto:ziso@rowan.edu]
Sent: Thursday, September 24, 2009 4:30 PM
To: Demian Katz; vufind-general@lists.sourceforge.net
Subject: Re: confirmation of Trunk Stability

 

Demian, this is most thoughtful, and I appreciate all the effort that went and will go into this. I personally would like such model also because it doesn’t stiffle the creativity of anyone involved.

Please confirm my understanding of the model:  the checklist (on the wiki) will function as a best practices guide to implementors. Given the admin group’s tests, the local programmer(s) will run a set of tests (preferably on the test server) and install locally the trunk or not.

Ya’aqov




On 9/24/09 4:05 PM, "Demian Katz" <demian.katz@villanova.edu> wrote:

There is not currently a formal test that tells us when the trunk is stable -- QA in general is something we need to work on improving.
 
As a first step, we're trying to get the JIRA issue tracker into heavier use -- one of the first admin tasks will be to set up a series of milestones based on the known outstanding issues listed in JIRA.  When all the key issues are resolved, we should be ready to release.
 
This only addresses part of the problem, though -- known bugs and missing features.  It would be helpful to also have a series of standard regression tests to ensure that existing functionality has not been broken by new development.  Franck Borel has done some work to create unit tests to exercise low-level components of the code, but a lot more needs to be done to expand upon this initial work.  We need more unit tests, a framework for running all the unit tests, and a plan for testing at a higher level -- making sure the entire web application behaves correctly in both of its supported themes.  Perhaps a starting point would be to build a testing checklist in the Wiki so that we have a list of features to check periodically.
 
There's definitely more thinking to be done on this issue -- if anybody has experience with this (particularly tools for automated testing of web applications), I'd be happy to hear suggestions.
 
- Demian
 

From: Ya'aqov Ziso [mailto:ziso@rowan.edu]
Sent: Thursday, September 24, 2009 3:55 PM
To: Demian Katz; vufind-general@lists.sourceforge.net
Subject: confirmation of Trunk Stability

Hi Demian,

    Which testing/tests would put the trunk into a production level? is there a (standard) Q&A set of tests the administrators would consult?
Ya’aqov




On 9/24/09 2:58 PM, "Demian Katz" <demian.katz@villanova.edu> wrote:
The trunk is definitely not at a production level right now, though it's making significant progress in that direction.  It's functional enough that you might want to consider deploying it as a beta to get staff feedback on the new search behavior and to help us track down bugs, but I expect a few more weeks of cleanup before it's ready for prime time.

Next week, we're going to have an election to determine the VuFind administrators (I'll post more about that on Monday when the polls open).  That should give the project more defined leadership and accountability and should help get a functional trunk back in place in a more timely fashion... and in the meantime, I'm actively swatting bugs to keep things moving along.

Sorry for the protracted development process -- I think we've learned our lesson and will take great pains to avoid repeating this unstable trunk situation once we get things sorted out.  In the meantime, let me know if there's anything more specific I can do to help!

- Demian


> -----Original Message-----
> From: Philip Shafer [mailto:shafer@rowan.edu]
> Sent: Thursday, September 24, 2009 2:45 PM
> To: vufind-general@lists.sourceforge.net
> Subject: [VuFind-General] Trunk Stability
>
> We have been on RC1 for way to long at our institution and would like to
> move forward with our VUFind instance.  Is the SVF Trunk stable enough at
> this point to roll out a production instance?  We are looking for working
> versions with LDAP, tagging, and favorites.
>
> Thanks,
>
> Phil
>
> ------------------------------
>
> Philip Shafer
> Library System Services
> Rowan University Library
> 201 Mullica Hill Rd
> Glassboro, NJ  08028
> 856-256-4418
> 856-256-4924 Fax
>
>
>
> -----------------------------------------------------------------------
> -------
> Come build with us! The BlackBerry&reg; Developer Conference in SF, CA
> is the only developer event you need to attend this year. Jumpstart
> your
> developing skills, take BlackBerry mobile applications to market and
> stay
> ahead of the curve. Join us from November 9&#45;12, 2009. Register
> now&#33;
> http://p.sf.net/sfu/devconf
> _______________________________________________
> VuFind-General mailing list
> VuFind-General@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/vufind-general

------------------------------------------------------------------------------
Come build with us! The BlackBerry&reg; Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9&#45;12, 2009. Register now&#33;
http://p.sf.net/sfu/devconf
_______________________________________________
VuFind-General mailing list
VuFind-General@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/vufind-general