From: pito <pi...@vo...> - 2010-09-04 09:53:30
|
Leon, I did a lot of various tests I am not going to publish and to make the story short: 1. it seems the fs. routine presition itself is 7 digits which is good 2. it seems the f/ most notably with larger operands (eg. +/- 1e15) introduces errors so the result's precision drops to 6 digits or less 3. what is interesting the fs. conversion took seconds (atmega @25MHz)e.g.: \ marker -test1 : measure timer-start -1234567890. d>f fs. cr timer-stop prnt_elapsed_ms ." msec" ; > measure -1.2345674E9 1174 msec ok > \ marker -test1 : measure timer-start _-1 _pi f* _1e15 f* fs. cr timer-stop prnt_elapsed_ms ." msec" ; > measure -3.1415915E15 1709 msec ok > Pito Pito |