Re: [bailey-developers] lattice master

[Yonik S. <yo...@ap...>]

On Thu, Feb 28, 2008 at 5:45 PM, Doug Cutting <cu...@ap...> wrote:
> Yonik Seeley wrote:
>  > Are you thinking of storage outside of Lucene stored fields too then?
>
>  I think we'll have to maintain logs outside of Lucene.  Beyond that, I
>  don't see that we'd need to use more than stored fields.  Do you?

It depends on the documents I guess... if they are big, putting them
in the index can be a burden because they get copied on every segment
merge, and loading the other stored fields takes longer.

There are also two levels of "Document"... things like PDF, Word, etc,
also need to be parsed and have fields extracted make a lucene-style
Document.  I assume that's out of scope for this project though.

-Yonik