#57 improve build time testing

open
nobody
None
5
2014-05-21
2014-05-16
Paul Gevers
No

To improve build time testing (e.g. done in the (nearly finished) Debian package) it would be nice if the following features would be implemented:

  • top level Makefile aware of (some of) the tests/Makefile targets.

  • shipping of the reference files in the pasdoc package.

  • ensure non-zero return value if results are not as expected. Currently the tests pass, even when pasdoc, xmllint and onsgmls are not on the path or installed.

Discussion

  • Agreed with all, especially the 2nd point ("reference files in the pasdoc package"). Long time ago, when I implemented these tests, I did not want to place reference files in SVN (as I didn't want to place so many auto-generated files in SVN or tar.gz sources), that is why tests are downloaded by special script scripts/download_correct_tests_output.sh . Now I think that just placing the reference files in SVN would make the process easier (you only download SVN).

    And integrating this with main Makefile would encourage to update the reference files always, and run checks more often.

    Compressed with gz, the reference files should not weight > 1 MB, looking at current sizes. So size is not a problem.

    I'll tackle this when I have time. Or, patches/commits are welcome :)