[Cdrtools-developers] Mangled file extension in mkisofs 3.02 with UTF-8 filenames.

[Thomas G. <os...@th...>]

Hello,

I've read through the release notes and the mailing list and I'm not 
sure if this already known and maybe part of the mentioned "HELIOS 
TODO", or a still unknown problem, so I decided to give you a heads-up.

I experience some file name weirdness with Unicode file names in 3.02 
(Last test with 3.02a06). The Unicode characters themselves are always 
right as far as I have seen, but the file extension is sometimes mangled.

With a compiled mkisofs from the latest 3.01 tree and the latest 3.02 
tree the 3.01 binary seems to work correct, the 3.02 binary shows the 
phenomenon.

With the this short test for example:

-----
ls -l
./mkisofs-301 --version
./mkisofs-302 --version
mkdir test
echo "FooBar" >./test/日本語.txt
echo "FooBar" >./test/日本語祭り.txt
echo "FooBar" >./test/くじけないで.txt
./mkisofs-301 -JR -udf -o 301.iso test
./mkisofs-302 -JR -udf -o 302.iso test

mkdir mnt_301
mkdir mnt_302
mount -o loop 301.iso mnt_301
mount -o loop 302.iso mnt_302
ls -l mnt_301
ls -l mnt_302
-----


I get the following results:

-----

# ls -l
total 996
-rwxr-xr-x 1 root root 502064 13. Dez 23:14 mkisofs-301
-rwxr-xr-x 1 root root 514808 13. Dez 23:14 mkisofs-302

# ./mkisofs-301 --version
mkisofs 3.01 (x86_64-unknown-linux-gnu) Copyright (C) 1993-1997 Eric 
Youngdale (C) 1997-2015 Joerg Schilling

# ./mkisofs-302 --version
mkisofs 3.02a06 (x86_64-unknown-linux-gnu) Copyright (C) 1993-1997 Eric 
Youngdale (C) 1997-2016 Joerg Schilling

# mkdir test
# echo "FooBar" >./test/日本語.txt
# echo "FooBar" >./test/日本語祭り.txt
# echo "FooBar" >./test/くじけないで.txt

# ./mkisofs-301 -JR -udf -o 301.iso test
Setting input-charset to 'UTF-8' from locale.
Using _____000.TXT;1 for  /くじけないで.txt (日本語祭り.txt)
Using _____001.TXT;1 for  /日本語祭り.txt (日本語.txt)
Total translation table size: 0
Total rockridge attributes bytes: 479
Total directory bytes: 0
Path table size(bytes): 10
Max brk space used 0
429 extents written (0 MB)

# ./mkisofs-302 -JR -udf -o 302.iso test
Setting input-charset to 'UTF-8' from locale.
Using _____000.TXT;1 for  /くじけないで.txt (日本語祭り.txt)
Using _____001.TXT;1 for  /日本語祭り.txt (日本語.txt)
Total translation table size: 0
Total rockridge attributes bytes: 479
Total directory bytes: 0
Path table size(bytes): 10
Max brk space used 0
429 extents written (0 MB)

# mkdir mnt_301
# mkdir mnt_302
# mount -o loop 301.iso mnt_301
mount: /dev/loop1 is write-protected, mounting read-only
# mount -o loop 302.iso mnt_302
mount: /dev/loop2 is write-protected, mounting read-only

# ls -l mnt_301
total 6
-r--r--r-- 1 root root 7 13. Dez 23:26 くじけないで.txt
-r--r--r-- 1 root root 7 13. Dez 23:26 日本語.txt
-r--r--r-- 1 root root 7 13. Dez 23:26 日本語祭り.txt

# ls -l mnt_302
total 6
-r--r--r-- 1 root root 7 13. Dez 23:26 くじけないで#5261.t_
-r--r--r-- 1 root root 7 13. Dez 23:26 日本語.txt
-r--r--r-- 1 root root 7 13. Dez 23:26 日本語祭り#1AA4.tx_

-----

When the problem occurs, the file always shows up in the mounted images 
as [correct part of name]#XXXX.[mangled extention].

Platform is ArchLinux.

uname -a
Linux starfury 4.8.12-2-ARCH #1 SMP PREEMPT Fri Dec 2 20:17:06 CET 2016 
x86_64 GNU/Linux


Kind regards,

Thomas