#130 UTF-8 handling and escaped characters in listing environment

[Oliver K. Smith]

Hi,

I am using dblatex 0.3.12 built with MacPorts.

The handling of Unicode characters does not seem correct to me.

The dblatex option

latex.encoding=utf8

should result in a UTF-8 .tex file with Unicode characters as is except within a listing environment. In that case, the Unicode characters need to be properly escaped. As far as I am concerned, they need no additional translation/mapping.

TEST #1

The following produces a .tex file as expected

% dblatex --type=tex -o mytest.tex mytest.xml

The following does NOT produce a .tex file as expected.

% dblatex -P latex.encoding=utf8 --type=tex -o mytest.tex mytest.xml

In the above, the escape characters in the listing are incorrect.

TEST #2

The following does NOT produce a .tex file and FAILS expected

% dblatex --type=tex -o mytest2.tex mytest2.xml

I recommend a more meaningful error message that includes the suggestion to use UTF-8 and xelatex.

The following should produce the expected .tex file but does NOT.

% dblatex -P latex.encoding=utf8 --type=tex -o mytest2.tex mytest2.xml

Again, the escape characters in the listing are incorrect.

TEST #3

The following does NOT produce a .tex file as FAILS expected.

% dblatex --type=tex -o mytest3.tex mytest3.xml

The missing characters could be optionally added to the mapping table and then the test would work.

The following does work correctly.

% dblatex -P latex.encoding=utf8 --type=tex -o mytest3.tex mytest3.xml

Please let me know if you need additional information.

Thanks.

[Sandro Santilli]

We have this problem with Japanese characters, see https://trac.osgeo.org/postgis/ticket/5439#comment:8