[Jython-bugs] [ jython-Bugs-439688 ] Syntax error for non-ascii characters

[<no...@so...>]

Bugs item #439688, was opened at 2001-07-09 05:05
You can respond by visiting: 
http://sourceforge.net/tracker/?func=detail&atid=112867&aid=439688&group_id=12867

Category: Core
Group: None
Status: Open
Resolution: None
Priority: 5
Submitted By: Finn Bock (bckfnn)
Assigned to: Finn Bock (bckfnn)
Summary: Syntax error for non-ascii characters

Initial Comment:
When entering a big O-Umlaut in a euro-centric windows 
command prompt this happens:

1) Java reads it as 0x99.
2) Jython (wrongly) puts it trough the default
   encoding which return unicode 0x2122.
3) This is passed to the javaCC parser which assumes
   it is only dealing with ascii and cuts away the
   top 8 bits.
4) The result is 0x22 (a double quote) which cause a 
   syntax error.


>>> "Ö"
Traceback (innermost last):
  (no code object) at line 0
  File "<console>", line 2
SyntaxError: Lexical error at line 2, column 0.  
Encountered: <EOF> after : ""
>>>

----------------------------------------------------------------------

You can respond by visiting: 
http://sourceforge.net/tracker/?func=detail&atid=112867&aid=439688&group_id=12867