Menu

#28 LuaDouble.tojstring() precision loss

v3.0-beta1
open
nobody
None
5
2014-04-24
2014-04-24
TimeWalker
No

Last line of function is :
return Float.toString((float)v);

I expected it to be :
return Double.toString(v);

In its current form it leads to some surprising results.
Example :
local v1 = 354549.75
local v2 = 354549.76
return tostring(v1)==tostring(v2) says true and is "354549.75" !

Discussion


Log in to post a comment.