Donate Share

iTerm.app

Tracker: Bugs

5 Can't type or paste non-ASCII characters in local terminal - ID: 1623392
Last Update: Comment added ( nobody )

Expected behavior:
Typing or pasting text with non-ASCII characters should work.

Actual behavior:
Text doesn't get inserted at all when containing non-ASCII characters.


Attempt to reproduce 1:
* Open new terminal with Cmd+N
* type option+e (acute accent dead key)
* -> a little acute accent compose thingy appears
* type "e"
* the little acute accent disappears. no "é" was inserted

Attempt to reproduce 2:
* Select and copy this text from your web browser, including the quotes:
"é"
* Open new terminal with Cmd+N
* Paste with cmd+V
* -> displays "" (quotes but no é character)


Note that I do see the characters fine if I, say, cat a file to the
terminal. But I can't type or paste them at the shell.

In a regular Terminal terminal I can type and paste these chars, though
they show on the terminal prompt as escapes (\303\251).

In vi, I do seem to be able to type them, but not in bash.

Mac OS X 10.4.8 / Intel, iTerm Build 0.9.4.1221.1

Language is English; no change whether I select UTF-8 or Latin-1 (MacRoman
or Windows) as encoding in session info, though UTF-8 should be correct.


Brion Vibber ( vibber ) - 2006-12-28 06:50

5

Closed

Out of Date

Nobody/Anonymous

screen emulation

None

Public


Comments ( 10 )

Date: 2009-03-09 00:41
Sender: nobody

xkxdx5 11833447 ttogpr [URL=http://webpaulo.com/pedro/fahrrad/] fahrrad
[/URL] <a href="http://webpaulo.com/pedro/fahrrad/"> fahrrad </a>
http://webpaulo.com/pedro/fahrrad/


Date: 2009-03-09 00:37
Sender: nobody

xkxdx5 11833447 ttogpr [URL=http://webpaulo.com/pedro/fahrrad/] fahrrad
[/URL] <a href="http://webpaulo.com/pedro/fahrrad/"> fahrrad </a>
http://webpaulo.com/pedro/fahrrad/


Date: 2007-01-08 13:35
Sender: vinc17


Instead of LC_ALL=en_US.UTF-8, you can probably use LC_CTYPE=en_US.UTF-8,
as only LC_CTYPE is important concerning the encoding.


Date: 2007-01-06 05:09
Sender: clytie


There _is_ no Vietnamese UTF-8 locale for OSX. The GUI supports Vietnamese
natively in UTF-8, but there is no vi_VN.UTF-8 locale in the system.

I am currently trying to create one. Meanwhile, I use:

export LC_ALL=en_US.UTF-8
export LANGUAGE=vi

as a workaround. :S


Date: 2007-01-04 16:05
Sender: vinc17


Your locales are probably wrong. Check the output of
locale
and
perl -e ""
(perl will tell you if setting locales fail, while most programs silently
ignore such errors.)


Date: 2007-01-04 05:00
Sender: clytie


Yes, it does vary. I can input UTF8 text fine in bash 3. Following the
"Internationalizing your Terminal" article's instructions, I also installed
a newer bash and coreutils via fink, so if you haven't done that, I think
you will find it will help.
It definitely depends on the routines handling the data. I can now input
UTF-8 text in bash, I can find UTF-8 filenames, and "find" displays them
correctly, but "ls" doesn't. I haven't tested translated manpages yet.
So I think as long as we follow this workaround, iTerm is basically doing
its job, and it comes down to the base software installed. I wonder where
we can get a newer "ls"?


Date: 2007-01-04 01:34
Sender: yfabianProject AdminAccepting Donations


Thanks for sharing the tips, Clytie. I mainly tested iTerm with Chinese
input methods. Results are similar to what you described. It largely
doesn't work in bash, but it does work with some other programs. So I don't
think iTerm is the culprit.


Date: 2007-01-01 04:04
Sender: nobody

Logged In: NO

(Note: I had to input this without logging in because yet again I couldn't
login to SF. It's an ongoing problem. :( )

Tom Gewecke (of Multilingual Mac [3] fame) has produced a workaround [4]
at the Apple Discussions fora:
___
Do these settings help for you in Terminal? Also make sure you have a font
selected which has all the characters.

* In the Terminal Inspector:
o In the Emulation section, turn off the Escape non-ASCII characters
option.
o In the Display section, choose Unicode (UTF-8) as the Character Set
Encoding.
* Add the following line to your .profile: export LC_CTYPE=en_US.UTF-8
* Add the following lines to your .inputrc:

set meta-flag on
set input-meta on
set output-meta on
set convert-meta off

* Apply changes by doing a source ~/.profile and a source ~/.inputrc.
___

They certainly work for me. I can now input Vietnamese UTF8 text in iTerm.
Do they work for you?

If this workaround on its own doesn't work for you, have a look at the
Internationalizing your Terminal article
http://www.rift.dk/news.php?item.7.6> and follow its instructions. I did
both, so I don't know if they work in combination, or whether Tom's
workaround is enough on its own.

Clytie


Date: 2006-12-31 04:36
Sender: clytie


Please see <http://www.rift.dk/news.php?item.7.6> which discusses the
issues in internationalizing the terminal on Mac OSX, including those
affecting iTerm. Even when following all the instructions on that page,
iTerm does not improve.

iTerm displays Vietnamese (UTF-8, Roman alphabet, combined diacritics, de
facto test case for Unicode support) correctly, but it does not input it at
all. Using my OSX Vietnamese keyboard layout, I can't input any of the
non-ASCII characters, even those requiring only one keypress. Even xterm
originally input the single-keypress characters.

Please see this article
(http://wiki.services.openoffice.org/wiki/X11Keymaps) for a workaround for
the character-input issue in xterm. I am now able to input Vietnamese with
no problems in xterm. Can we create or access different keymaps from iTerm?
If so, how?

This is a critical issue for users of non-English languages.

Clytie Siddall
Vietnamese Free-Software Translation Team


Date: 2006-12-31 04:35
Sender: clytie


Please see <http://www.rift.dk/news.php?item.7.6> which discusses the
issues in internationalizing the terminal on Mac OSX, including those
affecting iTerm. Even when following all the instructions on that page,
iTerm does not improve.

iTerm displays Vietnamese (UTF-8, Roman alphabet, combined diacritics, de
facto test case for Unicode support) correctly, but it does not input it at
all. Using my OSX Vietnamese keyboard layout, I can't input any of the
non-ASCII characters, even those requiring only one keypress. Even xterm
originally input the single-keypress characters.

Please see this article
(http://wiki.services.openoffice.org/wiki/X11Keymaps) for a workaround for
the character-input issue in xterm. I am now able to input Vietnamese with
no problems in xterm. Can we create or access different keymaps from iTerm?
If so, how?

This is a critical issue for users of non-English languages.

Clytie Siddall
Vietnamese Free-Software Translation Team


Attached File

No Files Currently Attached

Changes ( 3 )

Field Old Value Date By
status_id Open 2007-03-15 22:52 yfabian
resolution_id None 2007-03-15 22:52 yfabian
close_date - 2007-03-15 22:52 yfabian