As promised I did some testing on utf-8 and Npp. Following is the body of a letter to the scintilla developer and to Don.
Happy Holidays to all!
Idris
=====================================================
I've done some testing. Since I don't quite understand the relationship between scintilla in Npp and the original (as used in Scite) I'm writing you both.
It seems that scintilla uses an old unicode or else has some severe utf-8 bugs. I think it's the former. On the Npp forum there have been a number of reports of Persian, Azeri-latin, and Mongolian cyrillic users being unable to input utf-8 characters in Npp/scintilla, but having no problems with other Windows editor-components. I installed some of these keyboards and was able to reproduce the errors for the afected characters. Today I made a keyboard layout for the Latin Extended Additional unicode block. Upon activating it I came across the same problem: many characters show up as ? marks, whereas in other editors they show up fine.
Instead of looking at this problem character-by-character, it seems that this is a general error that requires some work in scintilla's unicode support. The only thing these issues seem to have in common is that these characters seem to all belong to more recent versions of unicode.
If there is anything else I can do to help, please let me know.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Hi all,
As promised I did some testing on utf-8 and Npp. Following is the body of a letter to the scintilla developer and to Don.
Happy Holidays to all!
Idris
=====================================================
I've done some testing. Since I don't quite understand the relationship between scintilla in Npp and the original (as used in Scite) I'm writing you both.
It seems that scintilla uses an old unicode or else has some severe utf-8 bugs. I think it's the former. On the Npp forum there have been a number of reports of Persian, Azeri-latin, and Mongolian cyrillic users being unable to input utf-8 characters in Npp/scintilla, but having no problems with other Windows editor-components. I installed some of these keyboards and was able to reproduce the errors for the afected characters. Today I made a keyboard layout for the Latin Extended Additional unicode block. Upon activating it I came across the same problem: many characters show up as ? marks, whereas in other editors they show up fine.
Instead of looking at this problem character-by-character, it seems that this is a general error that requires some work in scintilla's unicode support. The only thing these issues seem to have in common is that these characters seem to all belong to more recent versions of unicode.
If there is anything else I can do to help, please let me know.