Menu
▾
▴
[Oorexx-bugs] [ oorexx-Bugs-3105650 ] format(1.2345678E-12, , 2) = 0.00000000000123
|
From: SourceForge.net <no...@so...> - 2010-11-09 00:41:27
|
Bugs item #3105650, was opened at 2010-11-08 16:41 Message generated for change (Tracker Item Submitted) made by douglorch You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=684730&aid=3105650&group_id=119701 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: External Functions Group: v4.0 Status: Open Resolution: None Priority: 5 Private: No Submitted By: Doug Lorch (douglorch) Assigned to: Nobody/Anonymous (nobody) Summary: format(1.2345678E-12,,2) = 0.00000000000123 Initial Comment: The format function returns the wrong result for very small numbers with enough digits. E.g., format( 1.234567E-11 ,,2) = 0.00 -- ok format( 1.2345678E-11 ,,2) = 0.00 -- ok format( 1.234567E-12 ,,2) = 0.00 -- ok format( 1.2345678E-12 ,,2) = 0.00000000000123 -- wrong format( 1.234567E-13 ,,2) = 0.000000000000123 -- wrong format( 1.2345678E-13 ,,2) = 0.000000000000123 -- wrong ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=684730&aid=3105650&group_id=119701 |