Does not work properly. isIdentifierIgnorable only catches some of the characters < 32 and passes all above 127. When switch to ISOControl only catches < 32 and 128-159. Should remap all < 32 and > 127
At the moment the system is reasonably unicode capable(16 bit characters etc) except for the limitations forced on by the Pick model itself. The routines in the Character class are all unicode aware and should make the correct decisions when confronted with values outside the 7/8 bit ascii set.
If i just strip all characters with values larger than 127 then it wont work for unicode sets anymore.
Maybe this doesnt matter though, and people just expect ascii only?
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
The problem is unicode.
At the moment the system is reasonably unicode capable(16 bit characters etc) except for the limitations forced on by the Pick model itself. The routines in the Character class are all unicode aware and should make the correct decisions when confronted with values outside the 7/8 bit ascii set.
If i just strip all characters with values larger than 127 then it wont work for unicode sets anymore.
Maybe this doesnt matter though, and people just expect ascii only?