Re: [Exist-open] Setting up a new Lucene tokenizer/analyzer

[Joe W. <jo...@gm...>]

Hi Efraim,

I notice that whereas eXist uses Lucene 2.9.2, the Hebrew analyzer's
default version is Lucene 3.0.2 - see the lib folder inside of:

https://github.com/synhershko/HebMorph/tree/master/java/lucene.hebrew

It also appears from the commit logs that there was some effort to
backport to "2.9", but again the lib folder contains 2.9.3 - close but
still newer than eXist's 2.9.2.

It might be worth finding out if this version is going to be
compatible with the 2.9.2 release of Lucene.

Another line of inquiry you might track is whether the extra steps
performed by Adam in the case of the Snowball analyzer might be
necessary (see http://markmail.org/message/gcepf56nkc5huck6); I think
Adam's steps render Mike's steps unnecessary but I'm not sure
(http://markmail.org/message/kmpetl2leq457t5i).

I anticipate using Hebrew for an upcoming side project, so I'm
following this with interest - and I would be happy to confirm tests
on sample texts.

Cheers,
Joe


On Sun, May 8, 2011 at 7:47 PM, Efraim Feinstein
<efr...@gm...> wrote:
> On 05/08/2011 02:48 PM, Wolfgang Meier wrote:
>>> I'm having some issues setting up a custom tokenizer/analyzer in eXist,
>>> and I wanted to know if I'm doing anything obviously wrong.
>> I can't see anything obviously wrong in the lucene index
>> configuration, but the tokenizer setting in conf.xml is for eXist's
>> old (now deprecated) full-text index and won't work with the lucene
>> tokenizer. Does it help if you reset that to the old setting? I don't
>> expect it does.
>
> Unfortunately, I spoke too soon on this one. When I reinstalled the db,
> I had forgotten to copy the analyzer into the classpath. When it's
> there, I still get the same NPE. I also get an additional error when
> trying to store a file in the database through the admin client:
> "Impossible to store a resource [path]: null"
>
> The resource appears anyway, and there's no exception in the logs.
>
> Thanks,
>
>
> --
> ---
> Efraim Feinstein
> Lead Developer
> Open Siddur Project
> http://opensiddur.net
> http://wiki.jewishliturgy.org
>
>
> ------------------------------------------------------------------------------
> WhatsUp Gold - Download Free Network Management Software
> The most intuitive, comprehensive, and cost-effective network
> management toolset available today.  Delivers lowest initial
> acquisition cost and overall TCO of any competing solution.
> http://p.sf.net/sfu/whatsupgold-sd
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>