Re: [Moosefs-users] MFS Access very slow during chunk deletions

[WK <wk...@bn...>]

4 chunk servers all using Cent5.x/EXT3.   The cluster in question is 
being used for IMAP so they are mostly small files with a goal of 3.

That cluster had been in productions for a few months and we never saw 
more than 400-500 deletions per minute and even that was rare, so it was 
really weird to see it go to 10,000+
We had been playing with increasing the trashlifetime a few weeks ago so 
that may have had something to do with it and of course with IMAP there 
is a huge number of deleted files as people clean out folders and move 
things around.

We have the CHUNKS_DEL_LIMIT set to 20 now and are back to 400-500 
deletions a minute.

-bill


The whole thing was very bizarre,

On 7/19/2011 6:09 AM, Mike wrote:
> What filesystem are the chunk servers using?
>
> >  We had a small 7 million file cluster that had chunkservers with only
> > 1GB or RAM, all of sudden start doing 10K+ deletions a minute. That
> > bogged down the entire cluster making it unusuable and even sent two
> > chunkservers into swap.