Re: [Docutils-users] cjk support?

[David G. <go...@py...>]

Yao Heling wrote:
 > Congrats on this nice tool!

Thank you.

 > While I try to convert a rest file to latex, I encoutered the
 > following error:
...
 > root@debian:~# rest2latex b2.rst
 > 'latin-1' codec can't encode characters in position 1656-1657:
 > ordinal not in range(256)

You need to specify the output encoding you want.  The default output
encoding is UTF-8, which can support all of Unicode.  You must be
getting an output encoding setting of "latin-1" from somewhere,
perhaps from a config file.  (Latin-1 can only handle up to code
point 255.)  Try "--output=utf-8" or another suitable encoding.

 > I think it's not handling Chinese characters properly

Separately from the encoding issue, this is correct.  Docutils isn't
localized for any CJK languages yet (docutils.languages and
docutils.parsers.rst.languages packages).  More importantly, Docutils
doesn't know anything about double-width characters from CJK, CJK
whitespace, bullets, etc.  If you can help add such support for CJK,
I'd be happy for your contribution.

-- 
David Goodger    http://starship.python.net/~goodger
For hire: http://starship.python.net/~goodger/cv
Docutils: http://docutils.sourceforge.net/
(includes reStructuredText: http://docutils.sf.net/rst.html)