clucene-developers — CLucene development-related discussion.

[CLucene-dev] clucene-core-2.3.3.4 build issue in ubuntu

[Saiful K. <sai...@gm...>]

Dear All,

I am new to CLucene and I want to build and install
clucene-core-2.3.3.4 in my Ubuntu-12.04LTS machine. I do need this IR
system for academic research purpose and over the next several years I
am looking forward to contribute to it.

However, at the very first step while trying to configure it I am
getting the following error. Please let me know if you need more
information. Humbly request your quick response.  -Thanks



Compiling as RelWithDebInfo
CMake Error at src/shared/cmake/MacroMustDefine.cmake:45 (MESSAGE):
  wcslen could not be found
Call Stack (most recent call first):
  src/shared/CMakeLists.txt:97 (CHECK_REQUIRED_FUNCTIONS)

Re: [CLucene-dev] BitSet::nextSetBit very inefficient for sparse bit sets

[Kostka B. <ko...@to...>]

OK, merged. I also merged my previous post – bugfix in ConstantScoreQuery


From: Itamar Syn-Hershko [mailto:it...@co...]
Sent: Thursday, December 13, 2012 8:43 AM
To: clu...@li...
Subject: Re: [CLucene-dev] BitSet::nextSetBit very inefficient for sparse bit sets

Feel free to merge it into master

On Wed, Dec 12, 2012 at 4:27 PM, Kostka Bořivoj <ko...@to...<mailto:ko...@to...>> wrote:
BitSet::nexSetBit is implemented very inefficient way for sparse bit sets. It searches for next bit set by per-bit iteration and bit shifting
See OPTIMIZED_BITSET branch for better solution. It is approximately 8 times faster. It could be still improved (probably 4 times faster) by
using uint32_t instead of current uint8_8 array, but it needs deeper changes.
Borek

------------------------------------------------------------------------------
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d
_______________________________________________
CLucene-developers mailing list
CLu...@li...<mailto:CLu...@li...>
https://lists.sourceforge.net/lists/listinfo/clucene-developers

Re: [CLucene-dev] BitSet::nextSetBit very inefficient for sparse bit sets

[Itamar Syn-H. <it...@co...>]

Feel free to merge it into master


On Wed, Dec 12, 2012 at 4:27 PM, Kostka Bořivoj <ko...@to...> wrote:

> BitSet::nexSetBit is implemented very inefficient way for sparse bit sets.
> It searches for next bit set by per-bit iteration and bit shifting
> See OPTIMIZED_BITSET branch for better solution. It is approximately 8
> times faster. It could be still improved (probably 4 times faster) by
> using uint32_t instead of current uint8_8 array, but it needs deeper
> changes.
> Borek
>
>
> ------------------------------------------------------------------------------
> LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
> Remotely access PCs and mobile devices and provide instant support
> Improve your efficiency, and focus on delivering more value-add services
> Discover what IT Professionals Know. Rescue delivers
> http://p.sf.net/sfu/logmein_12329d2d
> _______________________________________________
> CLucene-developers mailing list
> CLu...@li...
> https://lists.sourceforge.net/lists/listinfo/clucene-developers
>
>

[CLucene-dev] BitSet::nextSetBit very inefficient for sparse bit sets

[Kostka B. <ko...@to...>]

BitSet::nexSetBit is implemented very inefficient way for sparse bit sets. It searches for next bit set by per-bit iteration and bit shifting
See OPTIMIZED_BITSET branch for better solution. It is approximately 8 times faster. It could be still improved (probably 4 times faster) by 
using uint32_t instead of current uint8_8 array, but it needs deeper changes.
Borek

Re: [CLucene-dev] Getting link error

[Ji C. <ji...@te...>]

I think you did not add the "include" and "libs" correctly, dont just copy the files, you check here to specifier two libs and two folders include 


http://stackoverflow.com/questions/4789927/including-an-external-library-in-visual-studio-2010-project 


i hope you will get it 


----- Mail original -----

De: "Rajeev kumar Singh" <raj...@gm...> 
À: clu...@li... 
Envoyé: Vendredi 7 Décembre 2012 01:35:37 
Objet: [CLucene-dev] Getting link error 

Hello CLucene Developers, 


I am requesting you to help me in resolving this issue with CLucene. 


This is first time i am using CLucene. 


I have created a solution out of CLucene and copied the "include" and "lib" folder to my application (ASCII supported only) and i am accessing CLucene.h and the libraries to access the CLucene. 


When i am building (make or rebuild) my application folder i am getting this (pasted at end) error. 
I also created an independent solution like demo project and was able to access well but not sure why i am getting link error here. 
>From the error log it looks like that there is some issue with make file or the lib but after re-checking all i am not able find any issue. 




Please help. i might not have provided entire context but some at least so please let me know if you need some more info. 
I am using VS2008 





Error: 

xxxxxx.obj : error LNK2001: unresolved external symbol "public: virtual bool __thiscall lucene::store::RAMDirectory::list(class stlpd_std::vector<class stlpd_std::basic_string<char,class stlpd_std::char_traits<char>,class stlpd_std::allocator<char> >,class stlpd_std::allocator<class stlpd_std::basic_string<char,class stlpd_std::char_traits<char>,class stlpd_std::allocator<char> > > > *)const " (?list@RAMDirectory@store@lucene@@UBE_NPAV?$vector@V?$basic_string@DV?$char_traits@D@stlpd_std@@V?$allocator@D@2@@stlpd_std@@V?$allocator@V?$basic_string@DV?$char_traits@D@stlpd_std@@V?$allocator@D@2@@stlpd_std@@@2@@stlpd_std@@@Z) 
xxxxxx.obj : error LNK2001: unresolved external symbol "public: virtual class stlpd_std::basic_string<char,class stlpd_std::char_traits<char>,class stlpd_std::allocator<char> > __thiscall lucene::store::RAMDirectory::toString(void)const " (?toString@RAMDirectory@store@lucene@@UBE?AV?$basic_string@DV?$char_traits@D@stlpd_std@@V?$allocator@D@2@@stlpd_std@@XZ) 
xxxxxx.obj : error LNK2001: unresolved external symbol "public: virtual class stlpd_std::basic_string<char,class stlpd_std::char_traits<char>,class stlpd_std::allocator<char> > __thiscall lucene::store::Directory::getLockID(void)" (?getLockID@Directory@store@lucene@@UAE?AV?$basic_string@DV?$char_traits@D@stlpd_std@@V?$allocator@D@2@@stlpd_std@@XZ) 
xxxxxx.DLL : fatal error LNK1120: 3 unresolved externals 

-- 
Thanks, 
Rajeev. 

------------------------------------------------------------------------------ 
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial 
Remotely access PCs and mobile devices and provide instant support 
Improve your efficiency, and focus on delivering more value-add services 
Discover what IT Professionals Know. Rescue delivers 
http://p.sf.net/sfu/logmein_12329d2d 
_______________________________________________ 
CLucene-developers mailing list 
CLu...@li... 
https://lists.sourceforge.net/lists/listinfo/clucene-developers 

[CLucene-dev] Getting link error

[Rajeev k. S. <raj...@gm...>]

Hello CLucene Developers,

I am requesting you to help me in resolving this issue with CLucene.

This is first time i am using CLucene.

I have created a solution out of CLucene and copied the "include" and "lib"
folder to my application (ASCII supported only)  and i am accessing
CLucene.h and the libraries to access the CLucene.

When i am building (make or rebuild) my application folder i am getting
this (pasted at end) error.
I also created an independent solution like demo project and was able to
access well but not sure why i am getting link error here.
>From the error log it looks like that there is some issue with make file or
the lib but after re-checking all i am not able find any issue.


Please help. i might not have provided entire context but some at least so
please let me know if you need some more info.
I am using VS2008


Error:
xxxxxx.obj : error LNK2001: unresolved external symbol "public: virtual
bool __thiscall lucene::store::RAMDirectory::list(class
stlpd_std::vector<class stlpd_std::basic_string<char,class
stlpd_std::char_traits<char>,class stlpd_std::allocator<char> >,class
stlpd_std::allocator<class stlpd_std::basic_string<char,class
stlpd_std::char_traits<char>,class stlpd_std::allocator<char> > > > *)const
" (?list@RAMDirectory@store@lucene@@UBE_NPAV?$vector@V?$basic_string@DV
?$char_traits@D@stlpd_std@@V?$allocator@D@2@@stlpd_std@@V?$allocator@V
?$basic_string@DV?$char_traits@D@stlpd_std@@V?$allocator@D@2@@stlpd_std@@@2@
@stlpd_std@@@Z)
xxxxxx.obj : error LNK2001: unresolved external symbol "public: virtual
class stlpd_std::basic_string<char,class stlpd_std::char_traits<char>,class
stlpd_std::allocator<char> > __thiscall
lucene::store::RAMDirectory::toString(void)const " (?toString@RAMDirectory
@store@lucene@@UBE?AV?$basic_string@DV?$char_traits@D@stlpd_std@
@V?$allocator@D@2@@stlpd_std@@XZ)
xxxxxx.obj : error LNK2001: unresolved external symbol "public: virtual
class stlpd_std::basic_string<char,class stlpd_std::char_traits<char>,class
stlpd_std::allocator<char> > __thiscall
lucene::store::Directory::getLockID(void)" (?getLockID@Directory
@store@lucene@@UAE?AV?$basic_string@DV?$char_traits@D@stlpd_std@
@V?$allocator@D@2@@stlpd_std@@XZ)
xxxxxx.DLL : fatal error LNK1120: 3 unresolved externals

-- 
Thanks,
Rajeev.

[CLucene-dev] search key_words in log

[Ji C. <ji...@te...>]

hi all, 


I'm new here, i use clucene a week ago, and i worked on the demo and found that it searches document. 
Now i want to finish the work like this : i have a log.txt, i want to search the key words and return the sentences that include the key_words. 


Can anyone help me? 


Best Regards 

Re: [CLucene-dev] Contrib lib build

[Vitaly A. <vit...@gm...>]

I am sorry I found the problem - different Character Set

On Sun, Nov 25, 2012 at 3:09 PM, Vitaly Artemov <vit...@gm...>wrote:

> Hi all,
> I unable to build contrib library on Windows 7 64 bit.
> I created clucene-contribs-lib solution(Visual Studio 2010) using CMAKE UI.
> I added clucene-core.lib and clucene-shared.lib as additional dependencies.
> But then I try to build it I get multiple link errors:
> LanguageBasedAnalyzer.obj : error LNK2001: unresolved external symbol
> "public: virtual class lucene::analysis::TokenStream * __cdecl
> lucene::analysis::Analyzer::reusableTokenStream(char const *,class
> lucene::util::Reader *)" (?reusableTokenStream@Analyzer@analysis@lucene
> @@UEAAPEAVTokenStream@23@PEBDPEAVReader@util@3@@Z) ...
> ...
> ...
> C:\Tools\Clucene\clucene-core-2.3.3.4\windows_x64_contrib\Release\clucene-contribs-lib.dll
> : fatal error LNK1120: 34 unresolved externals
>
> It's seems that it for some reason clucene-contribs-lib can't find exports
> from clucene-core.lib.
>
> Thanks in advance, Vitaly
>

[CLucene-dev] Contrib lib build

[Vitaly A. <vit...@gm...>]

Hi all,
I unable to build contrib library on Windows 7 64 bit.
I created clucene-contribs-lib solution(Visual Studio 2010) using CMAKE UI.
I added clucene-core.lib and clucene-shared.lib as additional dependencies.
But then I try to build it I get multiple link errors:
LanguageBasedAnalyzer.obj : error LNK2001: unresolved external symbol
"public: virtual class lucene::analysis::TokenStream * __cdecl
lucene::analysis::Analyzer::reusableTokenStream(char const *,class
lucene::util::Reader *)" (?reusableTokenStream@Analyzer@analysis@lucene
@@UEAAPEAVTokenStream@23@PEBDPEAVReader@util@3@@Z) ...
...
...
C:\Tools\Clucene\clucene-core-2.3.3.4\windows_x64_contrib\Release\clucene-contribs-lib.dll
: fatal error LNK1120: 34 unresolved externals

It's seems that it for some reason clucene-contribs-lib can't find exports
from clucene-core.lib.

Thanks in advance, Vitaly

Re: [CLucene-dev] Creating CLucene Index in a Database; Support for Asian languages

[Vitaly A. <vit...@gm...>]

I checked CJKAnalyzer source and see only CJKTokenizer implementation in it.
Is it means that I need to create specific analyzer to use it with
CJKTokenizer?
Thanks, Vitaly


On Thu, Nov 22, 2012 at 1:13 PM, Freiholz Manuel <M.F...@ca...>wrote:

>  Hi,****
>
> ** **
>
> in my experience it’s the best way to create N-Grams for the Asian texts.
> I think basic CJKAnalyzers already do it this way.****
>
> ** **
>
> Manuel****
>
> ** **
>
> *Von:* Vitaly Artemov [mailto:vit...@gm...]
> *Gesendet:* Donnerstag, 22. November 2012 11:23
> *An:* clu...@li...
> *Betreff:* Re: [CLucene-dev] Creating CLucene Index in a Database;
> Support for Asian languages****
>
> ** **
>
> One more question about Asian languages:
> I know that in Asian languages word boundaries are difficult issue.
> How are you tokenize Asian texts?
> Thank you, Vitaly****
>
> On Thu, Nov 22, 2012 at 12:18 PM, Vitaly Artemov <vit...@gm...>
> wrote:****
>
> Thank you for your fast reply.
> Can you please explain why Filesystem store better than Database.
> We will use CLucene to index and search huge amount of data.
> Vitaly****
>
> ** **
>
> On Thu, Nov 22, 2012 at 11:40 AM, Itamar Syn-Hershko <it...@co...>
> wrote:****
>
> inline****
>
> ** **
>
> On Thu, Nov 22, 2012 at 11:15 AM, Vitaly Artemov <vit...@gm...>
> wrote:****
>
>
> Hello all,
> I starting to evaluate Clucene engine for using in our product.
> I have 2 questions.
>
> 1. Is It planned to add support(or it already exists) for creating index in
> the Database instead of memory or filesystem?
>     I read that java Lucene has it by providing JdbcDirectory interface.**
> **
>
> ** **
>
> Don't do that. Use the filesystem, it is much better for every aspect.****
>
>  ****
>
>
> 2. I read in the FAQ that:
>  "CLucene is not limited to English, nor any other language. To index text
> properly, you need to use an Analyzer appropriate for the language of the
> text you are indexing. CLucene's default Analyzers work well for English.
> There are a    number of other Analyzers in "CLucene Sandbox", including
> those for Chinese, Japanese, and Korean."
>    But "CLucene Sandbox" link is not works for some reason. Can you specify
> link to Analyzers list?****
>
>  ** **
>
> Take a look at CJKAnalyzer****
>
>  ****
>
>
> Thanks in advance, Vitaly****
>
>
>
> ------------------------------------------------------------------------------
> Monitor your physical, virtual and cloud infrastructure from a single
> web console. Get in-depth insight into apps, servers, databases, vmware,
> SAP, cloud infrastructure, etc. Download 30-day Free Trial.
> Pricing starts from $795 for 25 servers or applications!
> http://p.sf.net/sfu/zoho_dev2dev_nov
> _______________________________________________
> CLucene-developers mailing list
> CLu...@li...
> https://lists.sourceforge.net/lists/listinfo/clucene-developers****
>
>  ** **
>
>
>
> ------------------------------------------------------------------------------
> Monitor your physical, virtual and cloud infrastructure from a single
> web console. Get in-depth insight into apps, servers, databases, vmware,
> SAP, cloud infrastructure, etc. Download 30-day Free Trial.
> Pricing starts from $795 for 25 servers or applications!
> http://p.sf.net/sfu/zoho_dev2dev_nov
> _______________________________________________
> CLucene-developers mailing list
> CLu...@li...
> https://lists.sourceforge.net/lists/listinfo/clucene-developers****
>
> ** **
>
> ** **
>
>
> ------------------------------------------------------------------------------
> Monitor your physical, virtual and cloud infrastructure from a single
> web console. Get in-depth insight into apps, servers, databases, vmware,
> SAP, cloud infrastructure, etc. Download 30-day Free Trial.
> Pricing starts from $795 for 25 servers or applications!
> http://p.sf.net/sfu/zoho_dev2dev_nov
> _______________________________________________
> CLucene-developers mailing list
> CLu...@li...
> https://lists.sourceforge.net/lists/listinfo/clucene-developers
>
>

Re: [CLucene-dev] Creating CLucene Index in a Database; Support for Asian languages

[Freiholz M. <M.F...@ca...>]

Hi,

in my experience it's the best way to create N-Grams for the Asian texts. I think basic CJKAnalyzers already do it this way.

Manuel

Von: Vitaly Artemov [mailto:vit...@gm...]
Gesendet: Donnerstag, 22. November 2012 11:23
An: clu...@li...
Betreff: Re: [CLucene-dev] Creating CLucene Index in a Database; Support for Asian languages

One more question about Asian languages:
I know that in Asian languages word boundaries are difficult issue.
How are you tokenize Asian texts?
Thank you, Vitaly
On Thu, Nov 22, 2012 at 12:18 PM, Vitaly Artemov <vit...@gm...<mailto:vit...@gm...>> wrote:
Thank you for your fast reply.
Can you please explain why Filesystem store better than Database.
We will use CLucene to index and search huge amount of data.
Vitaly

On Thu, Nov 22, 2012 at 11:40 AM, Itamar Syn-Hershko <it...@co...<mailto:it...@co...>> wrote:
inline

On Thu, Nov 22, 2012 at 11:15 AM, Vitaly Artemov <vit...@gm...<mailto:vit...@gm...>> wrote:

Hello all,
I starting to evaluate Clucene engine for using in our product.
I have 2 questions.

1. Is It planned to add support(or it already exists) for creating index in
the Database instead of memory or filesystem?
    I read that java Lucene has it by providing JdbcDirectory interface.

Don't do that. Use the filesystem, it is much better for every aspect.


2. I read in the FAQ that:
 "CLucene is not limited to English, nor any other language. To index text
properly, you need to use an Analyzer appropriate for the language of the
text you are indexing. CLucene's default Analyzers work well for English.
There are a    number of other Analyzers in "CLucene Sandbox", including
those for Chinese, Japanese, and Korean."
   But "CLucene Sandbox" link is not works for some reason. Can you specify
link to Analyzers list?

Take a look at CJKAnalyzer


Thanks in advance, Vitaly

------------------------------------------------------------------------------
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
_______________________________________________
CLucene-developers mailing list
CLu...@li...<mailto:CLu...@li...>
https://lists.sourceforge.net/lists/listinfo/clucene-developers


------------------------------------------------------------------------------
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
_______________________________________________
CLucene-developers mailing list
CLu...@li...<mailto:CLu...@li...>
https://lists.sourceforge.net/lists/listinfo/clucene-developers

Re: [CLucene-dev] Creating CLucene Index in a Database; Support for Asian languages

[Vitaly A. <vit...@gm...>]

One more question about Asian languages:
I know that in Asian languages word boundaries are difficult issue.
How are you tokenize Asian texts?
Thank you, Vitaly

On Thu, Nov 22, 2012 at 12:18 PM, Vitaly Artemov <vit...@gm...>wrote:

> Thank you for your fast reply.
> Can you please explain why Filesystem store better than Database.
> We will use CLucene to index and search huge amount of data.
> Vitaly
>
>
> On Thu, Nov 22, 2012 at 11:40 AM, Itamar Syn-Hershko <it...@co...>wrote:
>
>> inline
>>
>>
>> On Thu, Nov 22, 2012 at 11:15 AM, Vitaly Artemov <vit...@gm...
>> > wrote:
>>
>>>
>>> Hello all,
>>> I starting to evaluate Clucene engine for using in our product.
>>> I have 2 questions.
>>>
>>> 1. Is It planned to add support(or it already exists) for creating index
>>> in
>>> the Database instead of memory or filesystem?
>>>     I read that java Lucene has it by providing JdbcDirectory interface.
>>>
>>
>> Don't do that. Use the filesystem, it is much better for every aspect.
>>
>>
>>>
>>> 2. I read in the FAQ that:
>>>  "CLucene is not limited to English, nor any other language. To index
>>> text
>>> properly, you need to use an Analyzer appropriate for the language of the
>>> text you are indexing. CLucene's default Analyzers work well for English.
>>> There are a    number of other Analyzers in "CLucene Sandbox", including
>>> those for Chinese, Japanese, and Korean."
>>>    But "CLucene Sandbox" link is not works for some reason. Can you
>>> specify
>>> link to Analyzers list?
>>>
>>
>> Take a look at CJKAnalyzer
>>
>>
>>>
>>> Thanks in advance, Vitaly
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> Monitor your physical, virtual and cloud infrastructure from a single
>>> web console. Get in-depth insight into apps, servers, databases, vmware,
>>> SAP, cloud infrastructure, etc. Download 30-day Free Trial.
>>> Pricing starts from $795 for 25 servers or applications!
>>> http://p.sf.net/sfu/zoho_dev2dev_nov
>>> _______________________________________________
>>> CLucene-developers mailing list
>>> CLu...@li...
>>> https://lists.sourceforge.net/lists/listinfo/clucene-developers
>>>
>>>
>>
>>
>> ------------------------------------------------------------------------------
>> Monitor your physical, virtual and cloud infrastructure from a single
>> web console. Get in-depth insight into apps, servers, databases, vmware,
>> SAP, cloud infrastructure, etc. Download 30-day Free Trial.
>> Pricing starts from $795 for 25 servers or applications!
>> http://p.sf.net/sfu/zoho_dev2dev_nov
>> _______________________________________________
>> CLucene-developers mailing list
>> CLu...@li...
>> https://lists.sourceforge.net/lists/listinfo/clucene-developers
>>
>>
>

Re: [CLucene-dev] Creating CLucene Index in a Database; Support for Asian languages

[Vitaly A. <vit...@gm...>]

Thank you for your fast reply.
Can you please explain why Filesystem store better than Database.
We will use CLucene to index and search huge amount of data.
Vitaly

On Thu, Nov 22, 2012 at 11:40 AM, Itamar Syn-Hershko <it...@co...>wrote:

> inline
>
>
> On Thu, Nov 22, 2012 at 11:15 AM, Vitaly Artemov <vit...@gm...>wrote:
>
>>
>> Hello all,
>> I starting to evaluate Clucene engine for using in our product.
>> I have 2 questions.
>>
>> 1. Is It planned to add support(or it already exists) for creating index
>> in
>> the Database instead of memory or filesystem?
>>     I read that java Lucene has it by providing JdbcDirectory interface.
>>
>
> Don't do that. Use the filesystem, it is much better for every aspect.
>
>
>>
>> 2. I read in the FAQ that:
>>  "CLucene is not limited to English, nor any other language. To index text
>> properly, you need to use an Analyzer appropriate for the language of the
>> text you are indexing. CLucene's default Analyzers work well for English.
>> There are a    number of other Analyzers in "CLucene Sandbox", including
>> those for Chinese, Japanese, and Korean."
>>    But "CLucene Sandbox" link is not works for some reason. Can you
>> specify
>> link to Analyzers list?
>>
>
> Take a look at CJKAnalyzer
>
>
>>
>> Thanks in advance, Vitaly
>>
>>
>> ------------------------------------------------------------------------------
>> Monitor your physical, virtual and cloud infrastructure from a single
>> web console. Get in-depth insight into apps, servers, databases, vmware,
>> SAP, cloud infrastructure, etc. Download 30-day Free Trial.
>> Pricing starts from $795 for 25 servers or applications!
>> http://p.sf.net/sfu/zoho_dev2dev_nov
>> _______________________________________________
>> CLucene-developers mailing list
>> CLu...@li...
>> https://lists.sourceforge.net/lists/listinfo/clucene-developers
>>
>>
>
>
> ------------------------------------------------------------------------------
> Monitor your physical, virtual and cloud infrastructure from a single
> web console. Get in-depth insight into apps, servers, databases, vmware,
> SAP, cloud infrastructure, etc. Download 30-day Free Trial.
> Pricing starts from $795 for 25 servers or applications!
> http://p.sf.net/sfu/zoho_dev2dev_nov
> _______________________________________________
> CLucene-developers mailing list
> CLu...@li...
> https://lists.sourceforge.net/lists/listinfo/clucene-developers
>
>

Re: [CLucene-dev] Creating CLucene Index in a Database; Support for Asian languages

[Itamar Syn-H. <it...@co...>]

inline


On Thu, Nov 22, 2012 at 11:15 AM, Vitaly Artemov <vit...@gm...>wrote:

>
> Hello all,
> I starting to evaluate Clucene engine for using in our product.
> I have 2 questions.
>
> 1. Is It planned to add support(or it already exists) for creating index in
> the Database instead of memory or filesystem?
>     I read that java Lucene has it by providing JdbcDirectory interface.
>

Don't do that. Use the filesystem, it is much better for every aspect.


>
> 2. I read in the FAQ that:
>  "CLucene is not limited to English, nor any other language. To index text
> properly, you need to use an Analyzer appropriate for the language of the
> text you are indexing. CLucene's default Analyzers work well for English.
> There are a    number of other Analyzers in "CLucene Sandbox", including
> those for Chinese, Japanese, and Korean."
>    But "CLucene Sandbox" link is not works for some reason. Can you specify
> link to Analyzers list?
>

Take a look at CJKAnalyzer


>
> Thanks in advance, Vitaly
>
>
> ------------------------------------------------------------------------------
> Monitor your physical, virtual and cloud infrastructure from a single
> web console. Get in-depth insight into apps, servers, databases, vmware,
> SAP, cloud infrastructure, etc. Download 30-day Free Trial.
> Pricing starts from $795 for 25 servers or applications!
> http://p.sf.net/sfu/zoho_dev2dev_nov
> _______________________________________________
> CLucene-developers mailing list
> CLu...@li...
> https://lists.sourceforge.net/lists/listinfo/clucene-developers
>
>

[CLucene-dev] Creating CLucene Index in a Database; Support for Asian languages

[Vitaly A. <vit...@gm...>]

Hello all,
I starting to evaluate Clucene engine for using in our product.
I have 2 questions.

1. Is It planned to add support(or it already exists) for creating index in
the Database instead of memory or filesystem?
    I read that java Lucene has it by providing JdbcDirectory interface.

2. I read in the FAQ that:
 "CLucene is not limited to English, nor any other language. To index text
properly, you need to use an Analyzer appropriate for the language of the
text you are indexing. CLucene's default Analyzers work well for English.
There are a    number of other Analyzers in "CLucene Sandbox", including
those for Chinese, Japanese, and Korean."
   But "CLucene Sandbox" link is not works for some reason. Can you specify
link to Analyzers list?

Thanks in advance, Vitaly

[CLucene-dev] Bug in ConstantScorer

[Kostka B. <ko...@to...>]

Hi,

ConstantScorer destructor deletes bits returned by filter->bits() method (called in constructor)
without checking if filter->shouldDeleteBitSet() returns true.

This causes double deletion of bits in case the filter is derived from AbstractCachingFilter.

Proposed fix (in constantscorequery.cpp) attached

Re: [CLucene-dev] problem building clucene-php

[Veit J. <nun...@go...>]

Hi Paul,

the Misc.h is part of the sublibrary clucene-shared. Looking into the
CMakeLists.txt of this sublibrary, I discovered that the install
command for adding the headers ist missing. I guess, somehing similar
as in the CMakeLists.txt of the core (lines 224--233) has to be added
to the CMakeLists.txt of shared. But I cannot try it in the moment.
Maybe tomorrow.

Best regards,

Veit

[CLucene-dev] problem building clucene-php

[Paul G. | P. I. <pa...@pa...>]

LS,



We are trying to build/compile clucene for php (
http://pecl.php.net/package/clucene ) on a centos server ( 64bit ). For
this we had first installed the clucene-core and clucene-core-devel
packages. But no luck all errors. So we decided to build clucene ourselves.



This went ok, but the compiling of clucene for php again failed.  I think
it has to do that there is no /usr/local/include/CLucene/util/Misc.h, as
the error below states  “’Misc’ has not been declared”.



Can anybody help us out and see what is going wrong or how we can build the
clucene including this Misc.h?



The way we build clucene was



                Download tar.gz, unpacked

                Cd clucence

mkdir build && cd build

cmake ..

make

make install



Then we went to clucene-0.0.9 ( pecl package )



                Phpize

                ./configure

                Make    ( here it went wrong see errors below )



/var/tmp/clucene/clucene.cpp:56: warning: deprecated conversion from string
constant to âchar*â

/var/tmp/clucene/clucene.cpp: In function âvoid
zim_IndexSearcher___construct(int, zval*, zval**, zval*, int)â:

/var/tmp/clucene/clucene.cpp:219: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:220: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:226: warning: deprecated conversion from
string constant to âchar*â

/var/tmp/clucene/clucene.cpp:227: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:227: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:233: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:233: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:241: error: âMiscâ has not been declared

/var/tmp/clucene/clucene.cpp: In function âvoid
zim_IndexSearcher_search(int, zval*, zval**, zval*, int)â:

/var/tmp/clucene/clucene.cpp:256: warning: deprecated conversion from
string constant to âchar*â

/var/tmp/clucene/clucene.cpp:261: warning: deprecated conversion from
string constant to âchar*â

/var/tmp/clucene/clucene.cpp:266: error: âMiscâ has not been declared

/var/tmp/clucene/clucene.cpp: In function âvoid
zim_IndexSearcher_close(int, zval*, zval**, zval*, int)â:

/var/tmp/clucene/clucene.cpp:286: warning: deprecated conversion from
string constant to âchar*â

/var/tmp/clucene/clucene.cpp: In function âvoid zim_Hits___construct(int,
zval*, zval**, zval*, int)â:

/var/tmp/clucene/clucene.cpp:310: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:311: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:313: warning: deprecated conversion from
string constant to âchar*â

/var/tmp/clucene/clucene.cpp:314: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:314: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:320: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:320: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp: In function âvoid zim_Hits_length(int, zval*,
zval**, zval*, int)â:

/var/tmp/clucene/clucene.cpp:331: warning: deprecated conversion from
string constant to âchar*â

/var/tmp/clucene/clucene.cpp:332: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:332: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp: In function âvoid zim_Hits_get(int, zval*,
zval**, zval*, int)â:

/var/tmp/clucene/clucene.cpp:366: warning: deprecated conversion from
string constant to âchar*â

/var/tmp/clucene/clucene.cpp:367: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:367: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:375: warning: deprecated conversion from
string constant to âchar*â

/var/tmp/clucene/clucene.cpp:380: error: âMiscâ has not been declared

/var/tmp/clucene/clucene.cpp:382: error: âMiscâ has not been declared

/var/tmp/clucene/clucene.cpp: In function âvoid zim_Hits_id(int, zval*,
zval**, zval*, int)â:

/var/tmp/clucene/clucene.cpp:414: warning: deprecated conversion from
string constant to âchar*â

/var/tmp/clucene/clucene.cpp:415: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:415: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:424: warning: deprecated conversion from
string constant to âchar*â

/var/tmp/clucene/clucene.cpp: In function âvoid zim_Hits_score(int, zval*,
zval**, zval*, int)â:

/var/tmp/clucene/clucene.cpp:449: warning: deprecated conversion from
string constant to âchar*â

/var/tmp/clucene/clucene.cpp:450: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:450: warning: âvoid
php_set_error_handling(zend_error_handling_t, zend_class_entry*)â is
deprecated (declared at /usr/include/php/main/php.h:292)

/var/tmp/clucene/clucene.cpp:459: warning: deprecated conversion from
string constant to âchar*â

make: *** [clucene.lo] Error 1





Regards,



Paul Groeneweg

Re: [CLucene-dev] bit out of range

[Ahmed <ci7...@gm...>]

<html style="direction: ltr;">
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
    <style type="text/css">body p { margin-bottom: 0cm; margin-top: 0pt; } </style>
  </head>
  <body style="direction: ltr;"
    bidimailui-detected-decoding-type="latin-charset" bgcolor="#FFFFFF"
    text="#000000">
    <div class="moz-cite-prefix">Yes, i'm using a filter<br>
      <br>
      Le 08/10/2012 06:48, Veit Jahns a &eacute;crit&nbsp;:<br>
    </div>
    <blockquote
cite="mid:CALGR=ePG...@ma..."
      type="cite">
      <pre wrap="">Hi Ahmed!

2012/10/5 Ahmed <a class="moz-txt-link-rfc2396E" href="mailto:ci7...@gm...">&lt;ci7...@gm...&gt;</a>:
</pre>
      <blockquote type="cite">
        <pre wrap="">Hi
Sometimes when i search in my index i get this exception "bit out of range",
what does it mean?
</pre>
      </blockquote>
      <pre wrap="">
Its the index out of boundaries error from the BitSet class. Do you use filters
for searching?

Best regards

Veit

------------------------------------------------------------------------------
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
<a class="moz-txt-link-freetext" href="http://p.sf.net/sfu/newrelic-dev2dev">http://p.sf.net/sfu/newrelic-dev2dev</a>
_______________________________________________
CLucene-developers mailing list
<a class="moz-txt-link-abbreviated" href="mailto:CLu...@li...">CLu...@li...</a>
<a class="moz-txt-link-freetext" href="https://lists.sourceforge.net/lists/listinfo/clucene-developers">https://lists.sourceforge.net/lists/listinfo/clucene-developers</a>
</pre>
    </blockquote>
    <br>
  </body>
</html>

Re: [CLucene-dev] bit out of range

[Veit J. <nun...@go...>]

Hi Ahmed!

2012/10/5 Ahmed <ci7...@gm...>:
> Hi
> Sometimes when i search in my index i get this exception "bit out of range",
> what does it mean?

Its the index out of boundaries error from the BitSet class. Do you use filters
for searching?

Best regards

Veit

[CLucene-dev] bit out of range

[Ahmed <ci7...@gm...>]

<html style="direction: ltr;">
  <head>

    <meta http-equiv="content-type" content="text/html; charset=ISO-8859-1">
    <style type="text/css">body p { margin-bottom: 0cm; margin-top: 0pt; } </style>
  </head>
  <body style="direction: ltr;"
    bidimailui-detected-decoding-type="latin-charset" bgcolor="#FFFFFF"
    text="#000000">
    Hi<br>
    Sometimes when i search in my index i get this exception "bit out of
    range", what does it mean?<br>
    thank you<br>
  </body>
</html>

Re: [CLucene-dev] TODO List?

[Veit J. <nun...@go...>]

Hi Atul!

2012/8/15 Atul Kulkarni <atu...@gm...>:
> Hi All,
>
> I recently stumbled upon CLucene and am wondering if this is actively
> developed anymore?

CLucene is still active---more or less... For myself, I'm very busy
with other projects distracting me from working on CLucene.

> Also, is there a TODO list that I can look at to pickup a
> bug or something like a bug tracker to help me pickup something simple to
> start with?

Firstly, there are some open tickets provided from users:

http://sourceforge.net/tracker/?group_id=80013&atid=558446

Secondly, we also started to update CLucene to the one of the latest
Lucene version. This port was supposed to be based on Lucene++, which
is also a Lucene port. But it makes a heavy use of shared pointer. And
we once wanted to make this the new CLucene, but reduce the usage of
shared pointer and make it as fast as possible.

Lucene++ is hosted at GitHub:
https://github.com/luceneplusplus/LucenePlusPlus. Some tests and
improvements are already done by Sergey. Can be found an Github also:
https://github.com/drigh/LucenePlusPlus/

>From my point of view, it would be better to start with Lucene++.

If you are intersted, you are invited to work on one of the issues.
And I think I can spent some time to support, at least for answering
your questions.

Best regards,

Veit

[CLucene-dev] TODO List?

[Atul K. <atu...@gm...>]

Hi All,

I recently stumbled upon CLucene and am wondering if this is actively
developed anymore? Also, is there a TODO list that I can look at to pickup
a bug or something like a bug tracker to help me pickup something simple to
start with?

-- 
Regards,
Atul Kulkarni

Re: [CLucene-dev] Ordering results

[Veit J. <nun...@go...>]

Hi Mike,

_search() is overloaded. There is also an implementation that takes a
pointer to a Sort object as argument. I would look there, if these
classes fits your need. But this depends also how do you put the dates
in your index. As ISO 8601 or similar?

Best regards,

Veit

[CLucene-dev] Ordering results

[Mike A. <mi...@au...>]

I am doing a query and want to sort all the matched data by one of the
fields (date).

Whats the best way of doing this ?


The search will potentially match a lot of rows - so for performance I've
subclassed HitCollector and am adding all the returned documentIDs to a
list of integers if that makes any difference :


 reader = IndexReader::open(...);
 q = QueryParser::parse(...);
 s = new IndexSearcher(reader);
 s->_search(q, NULL, &hc);





class myHitCollector : public HitCollector {

private :
       list<int32_t> hitList;

public:
        int hitListCount;

        myHitCollector() : HitCollector() {
                clear();
                hitListCount=0;
        }

        void clear() {
                hitList.clear();
        }

        void push(int32_t doc) {
                hitList.push_back(doc);
                hitListCount++;
        }

        int  pop() {
                int32_t doc=hitList.front();
                hitList.pop_front();
                hitListCount--;
                return doc;
        }

        void collect(const int32_t doc, const float_t score) {
                push(doc);
        }
};



again - is this the best way ?


Any help much appreciated!