#2 Does Egothor support term-partition?

v2.x
closed
Leo Galambos
5
2010-07-13
2010-07-08
edshea
No

AFAIK, Lucene only supports to partition index by document.
But I'm searching a tool that could partition index by term, would Egothor make it?
If not, could you reccommend a tool?

Thanks in advance.

Discussion

  • Leo Galambos
    Leo Galambos
    2010-07-08

    • labels: --> egothor core
    • milestone: --> v2.x
    • assigned_to: nobody --> leog
     
  • Leo Galambos
    Leo Galambos
    2010-07-08

    The feature is not yet implemented.

    Note:
    If org.egothor.core.query.Rider class was not implemented for a single barrel, you could have the feature. On the other hand, I cannot see a practical use -- what are you trying to implement?

     
  • edshea
    edshea
    2010-07-09

    @leog, for research...Since Lucene doesnot support term-partition, so I'm searching such a tool.
    But what do you mean about "If org.egothor.core.query.Rider class was not implemented for a single barrel, you could have the feature", I donot understand(I havenot used egothor before).
    Thanks for your reply.

     
  • edshea
    edshea
    2010-07-09

    Sorry, I didn't notice your first sentence.
    Thanks.

     
  • Leo Galambos
    Leo Galambos
    2010-07-09

    Egothor is able to read inverted lists of a single barrel. If you reimplement the Rider class, then you could read inverted lists of many barrels - this is necessary feature for term-partition.

    The modification is simple, but nobody wrote the respective code...

     
  • edshea
    edshea
    2010-07-09

    We aim to implement a distributed search engine.
    Indices are distrubuted on many machines(the machines may belong to different clusters, so we are limited by the low bandwidth between clusters).We can locate the machines by using hash on the query terms.

     
  • Leo Galambos
    Leo Galambos
    2010-07-13

    IMHO you would rather consider column-oriented (distributed) database. Unfortunately, I am not aware of any robust OSS product in this category.

     
  • Leo Galambos
    Leo Galambos
    2010-07-13

    • status: open --> closed