[VuFind-Tech] searching CJK and other non-latin languages

[Tod O. <to...@uc...>]

VuFind tech,

How are people handling the indexing of non-latin scripts? I'm thinking specifically of the CJK writing systems, but also of Hebrew, Arabic, Cyrillic, and others.

A discussion about a year ago spoke of putting the vernacular into its own index, but I'm hoping for something more integrated into the regular indexes. Maybe bigrams for CJK data, but then it's unclear how to combine with latin indexes.

Is there a best practice among the VuFind sites?

-Tod


Tod Olson <to...@uc...>
Systems Librarian     
University of Chicago Library