From: HL <fre...@gm...> - 2013-02-28 20:10:13
|
Thanks Demian ... However a little further debugging from my part showed this ... After enabling log ------------------------------------------------------------------------------------------------------------------------------------------------------------------------ I get 2013-02-28T07:39:23-05:00 DEBUG (7): Search options: Array ( [rows] => 0 [start] => 0 [fl] => *,score [qf] => title_short^750 title_full_unstemmed^600 title_full^400 title^500 title_alt^200 title_new^100 series^50 series2^30 author^300 author_fuller^150 contents^10 topic_unstemmed^550 topic^500 geographic^300 genre^300 allfields_unstemmed^10 fulltext_unstemmed^10 allfields fulltext [qt] => dismax [q] => χαρτο [spellcheck] => true [spellcheck.q] => χαρτο [spellcheck.dictionary] => basicSpell ) 2013-02-28T07:39:23-05:00 DEBUG (7): POST http://localhost:8080/solr/biblio/select/?rows=0&start=0&fl=%2A%2Cscore&qf=title_short%5E750+title_full_unstemmed%5E600+title_full%5E400+title%5E500+title_alt%5E200+title_new%5E100+series%5E50+series2%5E30+author%5E300+author_fuller%5E150+contents%5E10+topic_unstemmed%5E550+topic%5E500+geographic%5E300+genre%5E300+allfields_unstemmed%5E10+fulltext_unstemmed%5E10+allfields+fulltext&qt=dismax&q=%CF%87%CE%B1%CF%81%CF%84%CE%BF&spellcheck=true&spellcheck.q=%CF%87%CE%B1%CF%81%CF%84%CE%BF&spellcheck.dictionary=basicSpell&wt=json&json.nl=arrarr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- The thing is that the solr spellchecker returns successfully good results wget - ing the above showed these results --------------------------------------------------------------------------------------------------------------------------------------------------------------- {"responseHeader":{"status":0,"QTime":5,"params":{"spellcheck":"true","fl":"*,score","start":"0","q":"χαρτο","spellcheck.q":"χαρτο","qf":"title_short^750 title_full_unstemmed^600 title_full^400 title^500 title_alt^200 title_new^100 series^50 series2^30 author^300 author_fuller^150 contents^10 topic_unstemmed^550 topic^500 geographic^300 genre^300 allfields_unstemmed^10 fulltext_unstemmed^10 allfields fulltext","spellcheck.dictionary":"basicSpell","json.nl":"arrarr","qt":"dismax","wt":"json","rows":"0"}},"response":{"numFound":0,"start":0,"maxScore":0.0,"docs":[]},"spellcheck":{"suggestions":[["χαρτο",{"numFound":20,"startOffset":0,"endOffset":5,"origFreq":0,"suggestion":[{"word":"χαρτ","freq":4},{"word":"χαρτι","freq":1},{"word":"χαρτιου","freq":1},{"word":"χαρτεσ","freq":2},{"word":"χαρτησ","freq":2},{"word":"χαρησ","freq":3},{"word":"χερτ","freq":3},{"word":"χαρ","freq":2},{"word":"μαρτη","freq":1},{"word":"χαρασ","freq":1},{"word":"μαρτιου","freq":3},{"word":"μαρτιοσ","freq":1},{"word":"τεταρτο","freq":1},{"word":"χαρταετοσ","freq":2},{"word":"σπαρτη","freq":2},{"word":"χαρακη","freq":1},{"word":"χαρακτεσ","freq":1},{"word":"χαριλαοσ","freq":1},{"word":"χαριτωμενο","freq":1},{"word":"χαρτοσημου","freq":1}]}],["correctlySpelled",false]]}} -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- So I suspected that a utf8 default apache server would be appropriate but unfortunately didn't get any results Querying the same with chrome returned a bunch of funny chars since there is no utf8 header ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- {"responseHeader":{"status":0,"QTime":7,"params":{"spellcheck":"true","fl":"*,score","start":"0","q":"χαÏτο","spellcheck.q":"χαÏτο","qf":"title_short^750 title_full_unstemmed^600 title_full^400 title^500 title_alt^200 title_new^100 series^50 series2^30 author^300 author_fuller^150 contents^10 topic_unstemmed^550 topic^500 geographic^300 genre^300 allfields_unstemmed^10 fulltext_unstemmed^10 allfields fulltext","spellcheck.dictionary":"basicSpell","json.nl":"arrarr","qt":"dismax","wt":"json","rows":"0"}},"response":{"numFound":0,"start":0,"maxScore":0.0,"docs":[]},"spellcheck":{"suggestions":[["χαÏτο",{"numFound":20,"startOffset":0,"endOffset":5,"origFreq":0,"suggestion":[{"word":"χαÏÏ„","freq":4},{"word":"χαÏτι","freq":1},{"word":"χαÏτιου","freq":1},{"word":"χαÏτεσ","freq":2},{"word":"χαÏτησ","freq":2},{"word":"χαÏησ","freq":3},{"word":"χεÏÏ„","freq":3},{"word":"χαÏ","freq":2},{"word":"μαÏτη","freq":1},{"word":"χαÏασ","freq":1},{"word":"μαÏτιου","freq":3},{"word":"μαÏτιοσ","freq":1},{"word":"τεταÏτο","freq":1},{"word":"χαÏταετοσ","freq":2},{"word":"σπαÏτη","freq":2},{"word":"χαÏακη","freq":1},{"word":"χαÏακτεσ","freq":1},{"word":"χαÏιλαοσ","freq":1},{"word":"χαÏιτωμενο","freq":1},{"word":"χαÏτοσημου","freq":1}]}],["correctlySpelled",false]]}} --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- so in other words, I am definitely getting results but when it comes to the vufind LAYER something is wrong there. Q. Am I missing someting in my configurations ??? Thanks Harry On 26/02/2013 05:55 μμ, Demian Katz wrote: > The Solr spell checker is supposed to make suggestions based on terms in your index. It is not dictionary-based, so it should not be language-specific. However, I don't know anything about its internals, so perhaps the similarity-checking is somehow based on the Latin alphabet. > > This might be a good question for the solr-user mailing list; you probably have a better chance of getting a helpful response there, since that's where many of the Solr developers can be reached: > > http://lucene.apache.org/solr/discussion.html > > Good luck! > > - Demian > ________________________________________ > From: HL [fre...@gm...] > Sent: Tuesday, February 26, 2013 9:24 AM > To: vuf...@li... > Subject: [VuFind-General] spellchecker > > Does spellchecker support other langs besides latin based languages ? > > My encoding is utf8. > I don't seem to get any spell recomendations when querying in non-english. > > Thanks > Harry > > > ------------------------------------------------------------------------------ > Everyone hates slow websites. So do we. > Make your web apps faster with AppDynamics > Download AppDynamics Lite for free today: > http://p.sf.net/sfu/appdyn_d2d_feb > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general |