Menu
▾
▴
Re: [CLucene-dev] 0.9.10 making 75,000 index files, 10x disk space of 0.8.11
|
From: Ben v. K. <bva...@gm...> - 2005-12-15 17:39:15
|
From the looks of the segments file, only one segment is being used... all the others in the directory shouldn't be there... So we have to find out why they are not being deleted. I'm just checking in some changes to indexwriter.* and clconfig.h relating to _CL_DEBUG_INFO. I have just modified the info streams to be more usable. Can you try and use this and see what kind of information you get. Define the _CL_DEBUG_INFO on ~line 179 of clconfig.h. If you see something like '... Will re-try later', then it is having trouble deleting old segments. ben On 12/12/05, Bryan White <br...@ar...> wrote: > Ben van Klinken wrote: > > I'm sure that the index sizes should be the same. It seems as though > > the old segments arent being deleted. Have a look at the deletable > > file, it normally contains the segments which should be deleted but > > for some reason couldnt be - i suspect that this will have a list of > > all the segments except the latest one. Also look at the segments > > file, it contains the currently used segments. Since you optimized the > > index, there should only be one segment name in this. Can you verify > > these two points for me? > > deletable contains 4 bytes, all zero. > segments: > 0000000 ff ff ff ff 00 00 00 00 00 01 26 e7 00 0b 84 ee > 0000020 00 00 00 01 05 5f 67 36 69 35 00 0a 5e 08 > > In the shorter run the deletable file is the same. > segments: > 0000000 ff ff ff ff 00 00 00 00 00 00 0f 74 00 00 9a 79 > 0000020 00 00 00 01 04 5f 75 69 67 00 00 8b 06 > > -- > Bryan White > > > ------------------------------------------------------- > This SF.net email is sponsored by: Splunk Inc. Do you grep through log fi= les > for problems? Stop! Download the new AJAX search engine that makes > searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! > http://ads.osdn.com/?ad_id=3D7637&alloc_id=3D16865&op=3Dclick > _______________________________________________ > CLucene-developers mailing list > CLu...@li... > https://lists.sourceforge.net/lists/listinfo/clucene-developers > |
