In attempting to pre-process a text file, I receive the error, "Something wrong with the database: bun_r table KH Coder will exit now. How can I fix this error?
Thanks for your time!
You seem to have CSS turned off.
Please don't fill out this field.
Thank you for the post!
Did you try "Botchan" tutorial? If you can follow the tutorial without any errors, it seems that your KH Coder installation is working properly.
In that case, the data you tried could contain some incompatibilities. Please prepare a plain text file (.txt) as a "target file" for KH Coder. Not Word (.doc .docx) or PDF (.pdf). The encoding of the text file should be something like "Latin-1," "ISO 8859-1," "US-ASCII," or "Plain ASCII." And be sure that the text file doesn't include any tab characters or any other control characters other than "line feed." And you should delete "<" and ">" from your data unless you are using tags for KH Coder.
Hope it helps.
Thanks for your help.
I have had success with the Botchan file and smaller portions of my file that is creating the errors. I have attempted to create a clean ASCII text file but I must have missed some errant characters.
You can try "CLEAN" function of EXCEL / CALC to remove all control characters. Copy and paste the data to Excel / Calc, apply "CLEAN" function, then copy the data back to a text file.
About "<" and ">," use search or replace function of your favorite text editor to delete them all.
I am having the same issue as Kent, while I have had success with the Botchan file and smaller portions of my file, other parts are creating errors. I have removed every < and > besides the ones in \<h1> or \</h1>, using notepad++ I asked it to remove everything defined by the regex [\x00-\x09\x0B-\x1F\x7F] (which wikipedia tells me are the control characters expect for (in hex) 0A which is new line, and reading about the clean function is what it removes). Notepad++ tells me it is encoded as UTF-8 without BOM, which is the same as a smaller portion that works.
Is there some other character that that regex is not picking up that might be causing problems?
ETA: I also tried using the clean function, it is now ANSI, and then removing all < and > and still had this error.
1) Would you give us the EXACT error message you got? Dose it say "bun_r?" Isn't it bun-bun_r1? or bun-bun_r2?
2) Can you send me the data by e-mail?
1) The exact message is "Something wrong with the database:bun_r table KH Coder will exit now" .
2) I'll send an email. Thank you!
Thank you for the post and e-mail.
I see a lot of "\" (backslash) in your data.
Please delete them all and it will be OK.
Good luck with your research.
Koichi San konnichiwa !
KH coder is one of the best text mining tools I have come across. Thanks.
I had issues when I tried to run pre processing for Japanese text files. KH coder seems to work only for ANSI Encoded text files. Whereas if a text file is saved in ANSI the kanjis turn into question mark. How can I keep my Japanese text file in Unicode and run the preprocess without getting the following
Fatal error: Could not execute ChaSen.
Hello from Japan and thank you for the post!
Please try saving Japanese text files in Shift-JIS (SJIS) or EUC-JP (EUC) encoding. Currently, KH Coder can not hundle Unicode.
I have just started using the coder so, I am not very familiar with it but, I keep getting the same error.
"Fatal error: could not execute ChaSen"
A window appears with this message right after I try to run the Pre-Processing. I click on OK and the whole program shuts down.
Any suggestion on how to solve this?
Thank you very much for your time, and sorry for the bother.
Are you trying to analyze Japanese texts or English texts? If the text is in English, follow steps in page 5 of this tutorial:
If the text is in Japanese, please try the tutorial with "kokoro2.txt"
Anyway, you better check if you can analyze tutorial data or not. If you can, the problem is in your text maybe. And if you cannot, the problem is in the setup procedure of KH Coder or just in KH Coder itself.
Greetings, Mr Higuchi
Thank you very much for your reply. I am attempting to analyze a bilingual text that has both Japanese and English characters. Is it possible to do this kind of procedure with two languages at the same time?
Thank you very much for your attention, and sorry for the nuisance.
No, KH Coder is not ready for a bilingual text. Sorry. If you use ChaSen, all English words will be treated as "unknown" POS words.
But the error is not normal. Not expected. You should be able to process/analyze the data.
Although it is impossible to use the program to analyse two different languages at once, as briefly discussed in another thread, I have been able to process heavily multilingual data with KH Coder by:
1) removing all non-ASCII characters;
2) using the English "left3words" Tagger and simply treating foreign words as "foreign"/"unknown" with regard to part-of-speech, as prof. Higuchi just explained.
I have found that in that way, most tools in KH Coder will work as desired (for the English parts of the data only!).
You could use a similar procedure with a Japanese Tagger - minus the deletion of non-ASCII characters, of course - then interpret the complementary results of both analyses at once? I am not familiar with parsing Japanese data, but if you want to ignore English words altogether for that part of the analysis, you could set up an exhaustive list of words to temporarily ignore for that purpose ('Pre-Processing' --> 'Select Words to Analyze').
Sign up for the SourceForge newsletter: