[Pfspd-users@sf.net] PV rgb conversion

[Bram R. <bra...@ph...>]

Hi Harold,

Recently, you changed / generalized the RGB conversion of PV module 
'format_convert'.

Currently, only 8 bits input data is handled; however, we plan for the 
near future to handle up to 16 bit files wherein the 16 bits are retained 
in all calculations.
Calculation is done in fixed point.
Matrixes are specified in floating point.
In the conversion from float to fixed point, 16 bits after the "dot" are 
used.

This means for 16 bit data: 16 data + 16 after-dot = 32 bits
Thus, 32 bits are really required, there is no headroom.
Therefore, clipping will not work, as the to-be clipped data is wrapped 
around by the 32 bit C arithmetic.

Proposal: change the calculations to 8 bits after-dot precision to prepare 
for 16 bits input data.

Regards, Bram.

--
A.K. (Bram) Riemens
Principal Scientist, Systems & Algorithms, NXP Corporate Research
Office: WDC 3.41, Postbox WDC-03    <--- New address
High Tech Campus 31 (WDC), 5656 AE Eindhoven, The Netherlands
Tel: +31 40 27 43833, Fax: +31 40 27 44639
E-mail: bra...@ph...