[Pcgen-team-code] [JIRA] Created: (CODE-609) [Data Converter] non-ASCII characters don't convert right

[JIRA (f. D. R. B. ) <ji...@pc...>]

[Data Converter] non-ASCII characters don't convert right
---------------------------------------------------------

                 Key: CODE-609
                 URL: http://jira.pcgen.org/browse/CODE-609
             Project: Code
          Issue Type: Bug
          Components: Needs Verification Review
            Reporter: David R. Bender
             Fix For: 6.0.x


SF ID: 2871620
Last Update: Settings changed ( karianna )
Details:

while working on converting our data I occasionally run across a non-ASCII character that does not survive the transition, usually it is converted to a question mark. Sometimes these are apostrophes or dashes that have been corrupted, those I just correct with an ASCII character. Other times these characters are things like the copyright symbol and letters with non-English pronunciation marks, these mostly appear in comments, COPYRIGHT or SOURCE tags. These I've left alone.

Tom says this is a bug, here are some specific instances:

In all the RSRD pcc files in the PCGen COPYRIGHT line the name Martin Fagerström get mangled

in: data/ d20ogl/seculargames/shadows_of_shinobi/shadows_of_shinobi.pcc
on line 18 there is the name: Giltônio Santos

OK I just noticed something very odd here with these two, in both cases the converter has spit out the correct character and the mangled character is in my local copy and is up to date, yet when I use SVN browse to see the same file I see the correct character online.

This may mean we are dealing with platform format issues, not sure.

IN: # data/d20ogl/malhavocpress/bookofeldritchmight/eldritch.pcc
my working copy shows © and the converted copy removes that first character
On SVN Browse I do not see this symbol but in both cases the copyright symbol is unchanged.


In: data/d20ogl/malhavocpress/bookofhallowedmight/hallowedmight_equip_potionsscrolls.lst
on line 4 there is a copyright symbol in a comment line, this shows as a copyright symbol in my working copy but converts to a ?
When I view this file in SVN Browse it shows as a ?

Hope this is enough clues to figure out what is happening.
Submitted:

Eddy Anthony ( eddyanthony ) - 2009-10-01 21:20:53 EDT 

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.pcgen.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira