Menu

#6 Incorrect rounding for Exp function

1.0 - beta
open-postponed
nobody
Image (41)
2
2008-04-15
2008-01-17
pksv
No

The following function has incorrect rounding.
fwiExp_8u_C1RSfs
fwiExp_8u_C3RSfs
fwiExp_16s_C1RSfs
fwiExp_16s_C3RSfs
fwiExp_8u_C1IRSfs
fwiExp_8u_C3IRSfs
fwiExp_16s_C1IRSfs
fwiExp_16s_C3IRSfs

When test case with 0, the expected answer is 1.
If we do the scale of 1, the result is 0.5, round-to-even answer is 0.
Currently, these functions return 1 as the answer.

Discussion

  • pksv

    pksv - 2008-03-17
    • priority: 4 --> 2
     
  • pksv

    pksv - 2008-04-15
    • status: open --> open-postponed
     

Log in to post a comment.