[pywin32-bugs] [ pywin32-Bugs-716708 ] pythonwin editor does strange things with non-english chars

[SourceForge.net <no...@so...>]

Bugs item #716708, was opened at 2003-04-07 14:43
Message generated for change (Comment added) made by kanich
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=551954&aid=716708&group_id=78018

Category: pythonwin
Group: None
Status: Open
Resolution: None
Priority: 5
Submitted By: Mark Hammond (mhammond)
Assigned to: Mark Hammond (mhammond)
Summary: pythonwin editor does strange things with non-english chars

Initial Comment:
Reported by a few people, but to repro:
* Paste "# ça ne va pas" into pywin (or any other
string with extended char)
* Move to the ç
* Press Backspace

Some other character appears.  This will be related to
pywin.idle not being mult-character aware.

----------------------------------------------------------------------

Comment By: Kanich Vladimir (kanich)
Date: 2004-01-22 09:33

Message:
Logged In: YES 
user_id=304670

I have same problem with encoding 'cp1250' (default encoding 
in sk/cz). Without changing __init__.py file (as recommended 
by hweber) the editor is swallowing the half of characters 
with char-code above 127. It seems that the used editor 
routine is byte-oriented and not UNICODE.
Setting the variable is_platform_unicode = 0 helps also for 
encoding 'cp1250'.

----------------------------------------------------------------------

Comment By: Henrik Weber (hweber)
Date: 2004-01-07 12:17

Message:
Logged In: YES 
user_id=121229

This behaviour can be worked around by switching off unicode 
support. The easiest way to do this is in the __init__.py file.

Replace the line beginning with is_platform_unicode by this:
is_platform_unicode = 0

With this pythonwin works normally at least with the german 
umlauts (I haven't tried the other ones).

----------------------------------------------------------------------

Comment By: Henrik Weber (hweber)
Date: 2004-01-07 12:16

Message:
Logged In: YES 
user_id=121229

This behaviour can be worked around by switching off unicode 
support. The easiest way to do this is in the __init__.py file.

Replace the line beginning with is_platform_unicode by this:
is_platform_unicode = 0

With this pythonwin works normally at least with the german 
umlauts (I haven't tried the other ones).

----------------------------------------------------------------------

Comment By: Gilles Lenfant (glenfant)
Date: 2003-11-28 15:53

Message:
Logged In: YES 
user_id=122383

Same strange charset behaviour when copying text (with non
ASCCI chars) from pythonwin to a regular text editor
(notepad or any other).

It seems that pythonwin copies utf-8 to the clipboard rather
than "natural" default encoding (cp1252 for western european
languages).


----------------------------------------------------------------------

Comment By: Oleg Noga (oleg_noga)
Date: 2003-08-18 16:08

Message:
Logged In: YES 
user_id=551440

So there are 3 bugs:
------------
First bug (this report, 716708):

Incorrect work of backspace. (Del works ok). I must press 
backspace two times to remove non-english character. This 
bug presents in every version of pythonwin from 1.46, and 
very probably, in the earlier versions.
------------

Second bug (see followup by anadelonbrin, 2003-05-09 10:38
):

Editor does not display characters after non-english.
Another reproduces: 
- open py file with non-english strings, encoded with system 
default encoding. Look at non-english strings in editor: editor 
does not display string ends! Now move cursor at the begin of 
string and move it with right arrow button. Cursor stucks at 
the end of string, and lefts there for click count that equals 
invisible characters count. Move cursor to the inwisible end of 
string. Now type english characters: qwertyu... Invisible end 
of string will apear, but newly typed characters (qwertyu...) 
still not visible. Save file. Look in notepad. Document data is 
ok.
  So this bug is how pythonwin displays strings in editor, it 
does not affect document data.

There was no bug like this in version 1.48, we still use it. But 
it present in earlier versions (1.50 ... 1.55).
--------------

Third bug (seems unreported yet): 

Can't type \xFE character in editor. It is "ю" (Cyrillic small "u") 
letter. Dot typed instead of this character. Interesting that 
dot in at the same keybord button as Cyrillic small "u" letter.  
Editor opens files with this character, displays them correctly, 
and removes and copies them ok.
This bug presents in every version of pythonwin from 1.46, 
and very probably, in the earlier versions.

----------------------------------------------------------------------

Comment By: Tony Meyer (anadelonbrin)
Date: 2003-05-09 09:38

Message:
Logged In: YES 
user_id=552329

As another example:

In IDLE (0.8):
>>> u = u'questa \xe8 bella'
>>> u
u'questa \xe8 bella'
>>> print u
questa è bella

In PythonWin (152):
>>> u = u'questa \xe8 bella'
>>> u
u'questa \xe8 bella'
>>> print u
questa è bell

(note that if you copy the result of the 'print u', or type 
something after it, the a appears.  *very* confusing!)

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=551954&aid=716708&group_id=78018