Re: [Bigdata-developers] stop words in text search

[Jim B. <ba...@gm...>]

Hi Brad,

I see, I can look into providing my own implementation. I got the impression from the JavaDoc that I could provide config options to modify the behavior of some of the analyzers. I have been looking at these pages:

https://www.blazegraph.com/docs/api/com/bigdata/search/ConfigurableAnalyzerFactory.AnalyzerOptions.html#STOPWORDS_VALUE_NONE
https://www.blazegraph.com/docs/api/constant-values.html

I also tried to switch from the default analyzer to the TermCompletionAnalyzer, but haven’t been able to get the property value set correctly for “wordBoundary” in the config file.

Understanding how to translate option constants from the JavaDoc into correctly written config file properties has been a challenge. It would be really helpful to have more of those spelled out on the wiki.

Thanks!
Jim

> On Dec 8, 2015, at 9:54 PM, Brad Bebee <be...@sy...> wrote:
> 
> Jim,
> 
> I believe you could do this by overriding the Analyzer Factory Class [1] with your own implementation that does not filter stopwords [2].  Other may have more specific suggestions.
> 
> [1] https://www.blazegraph.com/docs/api/com/bigdata/search/FullTextIndex.Options.html#ANALYZER_FACTORY_CLASS
> 
> [2] https://www.blazegraph.com/docs/api/com/bigdata/search/IAnalyzerFactory.html
> 
> Thanks, --Brad
> 
> On Tue, Dec 8, 2015 at 9:12 PM, Jim Balhoff <ba...@gm...> wrote:
> Hi,
> 
> I was wondering if anyone could provide examples for how to set up the Blazegraph properties file to configure options for the full text search. I have looked through the various options in the JavaDoc, but I can’t quite figure out the right properties file syntax for ‘stopwords=none’. Here is what I am trying to do:
> 
> I have a term in the database with rdfs:label "skeletal element of eye region”. When users search for terms, I append a “*” to their input text by default. However this is failing when the label contains a stopword like “of”. So, searching with “skeletal element of” and “skeletal element*” do find the term as a match, but “skeletal element of*” does not. Can I disable stopwords entirely?
> 
> Thanks,
> Jim
> 
> 
> ------------------------------------------------------------------------------
> _______________________________________________
> Bigdata-developers mailing list
> Big...@li...
> https://lists.sourceforge.net/lists/listinfo/bigdata-developers
> 
> 
> 
> -- 
> _______________
> Brad Bebee
> CEO, Managing Partner
> SYSTAP, LLC
> e:  be...@sy...
> m: 202.642.7961
> f:  571.367.5000
> w:  www.blazegraph.com
> 
> Blazegraph™ is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs.  Mapgraph™ is our disruptive new technology to use GPUs to accelerate data-parallel graph analytics.
> 
> CONFIDENTIALITY NOTICE:  This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP, LLC.  Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments.
> 
>