Original v2 tables are in charset latin1;
Laravel defaults charset to utf8.
Changing this to latin1 and re-importing from v2 seems to have the show the text correctly.
However, this is probably not the best solution.
Options:
1. Import existing as latin1, new as utf8, and have to keep tract of which is which.
2. Import from raw utf text files. This would require building out part of the admin side which was planned for much later in development.
3. Save dealing with foreign languages till later
4. ???
Also need a database flag for RTL languages. Or a new db table just for language info.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Have built a basic importer to import directly from Unbound Bible zip files.
Wil need to reimport everything. But I will need a module exporter first, to create official modules for BSS V4. Also need to change the present migration script that imports text from V2 to only import English texts.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Looks like these might have to be re-imported
Also, searching with strings including UTF special characters, such as Señor causes breakage because it's not properly parsed out.
Need to change regexps to handle unicode:
preg_match_all('/%?[a-zA-Z0-9]+%?/', $parsing, $matches, PREG_SET_ORDER);
becomes:
preg_match_all('/%?[\p{L}]+%?/u', $parsing, $matches, PREG_SET_ORDER);
Original v2 tables are in charset latin1;
Laravel defaults charset to utf8.
Changing this to latin1 and re-importing from v2 seems to have the show the text correctly.
However, this is probably not the best solution.
Options:
1. Import existing as latin1, new as utf8, and have to keep tract of which is which.
2. Import from raw utf text files. This would require building out part of the admin side which was planned for much later in development.
3. Save dealing with foreign languages till later
4. ???
Also need a database flag for RTL languages. Or a new db table just for language info.
Have built a basic importer to import directly from Unbound Bible zip files.
Wil need to reimport everything. But I will need a module exporter first, to create official modules for BSS V4. Also need to change the present migration script that imports text from V2 to only import English texts.