[Pasdoc-main] [pasdoc:feature-requests] #57 improve build time testing

[Michalis K. <ka...@us...>]

All done:)

AD 2 ("shipping of the reference files in the pasdoc package") - The correct tests output is now trivially kept inside our code repository (GIT on https://github.com/pasdoc/pasdoc , auto-synchronized with SVN repository on SourceForge). In `tests/testcases_output/`, documented in tests/README.md, see https://github.com/pasdoc/pasdoc/tree/master/tests .

It was more critical now, as SourceForge doesn't allow creating shells anymore, which was breaking our "upload_correct_tests_output.sh" script.

The new solution avoids any downloading/uploading on SourceForge servers. And no packing to tar.gz. We can also easily check changes by just `git diff`, and commit them with `git commit`. So, overall, we avoid maintaining some of our scripts, and hopefully the simplicity of the new solution is a win :)

AD 1 ("top level Makefile aware of (some of) the tests/Makefile targets.") - To run all the tests, just execute `make tests` now. This is a trivial shortcut to executing `run_all_tests.sh` inside the `tests/` subdirectory.

Note that it compares correctness using `git diff --exit-code testcases_output/` by default. If you have sources without the `.git` repository data, then define USE_DIFF_TO_COMPARE=true first, like:

```
export USE_DIFF_TO_COMPARE=true
make tests
```

AD 3 ("ensure non-zero return value if results are not as expected") - I believe this was solved by your recent patch that added `which` checks to the scripts :)



---

** [feature-requests:#57] improve build time testing**

**Status:** open
**Group:** 
**Created:** Fri May 16, 2014 10:38 AM UTC by Paul Gevers
**Last Updated:** Wed May 21, 2014 08:35 PM UTC
**Owner:** nobody


To improve build time testing (e.g. done in the (nearly finished) Debian package) it would be nice if the following features would be implemented:

- top level Makefile aware of (some of) the tests/Makefile targets.

- shipping of the reference files in the pasdoc package.

- ensure non-zero return value if results are not as expected. Currently the tests pass, even when pasdoc, xmllint and onsgmls are not on the path or installed.



---

Sent from sourceforge.net because pas...@li... is subscribed to https://sourceforge.net/p/pasdoc/feature-requests/

To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/pasdoc/admin/feature-requests/options.  Or, if this is a mailing list, you can unsubscribe from the mailing list.