#445 RxMath functions do not honor precision on Windows

3.2.0
closed
Mark Miesfeld
5
2012-08-14
2007-10-16
Mark Miesfeld
No

On Windows the RxMath functions do not honor the precision argument, of the current setting of numeric digits.

This was reported on RexxLA by John Gallucci and confirmed by Alan Sampson. Alan provided a nice test program:

Rexx 'version' information:
REXX-ooRexx_3.1(MT) 6.00 17 Nov 2006

Call mathematical functions with default settings:

Numeric Digits: 9
Form : SCIENTIFIC
Fuzz : 0

Default: 0.707107
2: 0.707107
6: 0.707107
9: 0.707107
16: 0.707107

Call mathematical functions with numeric digits set to 6:

Numeric Digits: 6
Form : SCIENTIFIC
Fuzz : 0

Default: 0.707107
2: 0.707107
6: 0.707107
9: 0.707107
16: 0.707107

Discussion

  • Mark Miesfeld
    Mark Miesfeld
    2007-10-16

    Logged In: YES
    user_id=191588
    Originator: YES

    Committed revision 986.

     


Anonymous


Cancel   Add attachments