Has anyone run the MUMPS Validation routines (available on FreeM) against GT.M?
If so, are you willing to share this information? Have any enhancements been made to them?
If not, we will do that.
Terry
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
My 30Oct results from running MVTS v9.10 on GTM are at http://freem.vmth.ucdavis.edu/mvts/gtm/vsr001030.txt . I skipped over tests 12111-12150 because they required OPEN/USE/CLOSE arguments for secondary and tertiary I/O devices to test interactions between multiple jobs and I didn't quite understand how to respond to the setup questions in the absence of hardwired devices. Other skipped tests were skipped either because MVTS was programmed to skip past them on continuing after an aborted test or because I determined that the tests involved an unimplemented language feature that had already been tested.
Documentation and MUMPS source code for the test suite is at http://freem.vmth.ucdavis.edu. Beyond unzipping the package and converting the documentation into HTML the files there are essentially as received.
Let me know if you have test results from any MUMPS that you would like to share and I will attempt to combine them into a comparison table.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I have a new report on GTM from running MVTS v9.10. http://freem.vmth.ucdavis.edu/mvts/gtm/vsr001106. I found a way to run all of the tests that were formerly skipped. This involved setting up an error trap to force the test suite to continue stepping through the tests after an error and actually fixing some device handling errors in the MVTS itself.
Here are the overall numbers. As you can see, the number of errors outside of TP are very small compared to the total number of tests (63/3344 < 2%). Almost all of these involved commands and functions not yet implemented or extensions to pattern matching.
9) GRAND TOTAL OF THE TEST RESULTS (Part-77, -84, -90, -94, -94TP)
VALID TESTS:4318, WITHDRAWN OR SUPPRESSED TESTS: 93
=======================================================================
PASS (PASS+PASSO) FAILURE (FAIL+FAILO+ABORT+SKIP)
PART-77 2098 7
PART-84 200 0
PART-90 1046 56
PART-94(TP) 482 429
=======================================================================
TOTAL 3826 492
Now it remains to study the results and begin filing bug reports.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Has anyone run the MUMPS Validation routines (available on FreeM) against GT.M?
If so, are you willing to share this information? Have any enhancements been made to them?
If not, we will do that.
Terry
My 30Oct results from running MVTS v9.10 on GTM are at http://freem.vmth.ucdavis.edu/mvts/gtm/vsr001030.txt . I skipped over tests 12111-12150 because they required OPEN/USE/CLOSE arguments for secondary and tertiary I/O devices to test interactions between multiple jobs and I didn't quite understand how to respond to the setup questions in the absence of hardwired devices. Other skipped tests were skipped either because MVTS was programmed to skip past them on continuing after an aborted test or because I determined that the tests involved an unimplemented language feature that had already been tested.
Documentation and MUMPS source code for the test suite is at http://freem.vmth.ucdavis.edu. Beyond unzipping the package and converting the documentation into HTML the files there are essentially as received.
Let me know if you have test results from any MUMPS that you would like to share and I will attempt to combine them into a comparison table.
I have a new report on GTM from running MVTS v9.10. http://freem.vmth.ucdavis.edu/mvts/gtm/vsr001106. I found a way to run all of the tests that were formerly skipped. This involved setting up an error trap to force the test suite to continue stepping through the tests after an error and actually fixing some device handling errors in the MVTS itself.
Here are the overall numbers. As you can see, the number of errors outside of TP are very small compared to the total number of tests (63/3344 < 2%). Almost all of these involved commands and functions not yet implemented or extensions to pattern matching.
9) GRAND TOTAL OF THE TEST RESULTS (Part-77, -84, -90, -94, -94TP)
VALID TESTS:4318, WITHDRAWN OR SUPPRESSED TESTS: 93
=======================================================================
PASS (PASS+PASSO) FAILURE (FAIL+FAILO+ABORT+SKIP)
PART-77 2098 7
PART-84 200 0
PART-90 1046 56
PART-94(TP) 482 429
=======================================================================
TOTAL 3826 492
Now it remains to study the results and begin filing bug reports.
The URL I gave in the previous message is missing ".txt" at the end. The full results from my 07November run of MVTS v9.10 is at http://freem.vmth.ucdavis.edu/mvts/gtm/vsr001106.txt
I attempted to upload to the documents section of this project but found that the report was severely truncated.
Terry, how are you doing at running the test suite? I have found and fixed some problems with it since last time I wrote you.
(weird, but source forge rejected several versions of this message, complaining it is a duplicate of one I sent previously)