Re: [Moosefs-users] MFS Access very slow during chunk deletions

[WK <wk...@bn...>]

On 6/27/2011 8:52 AM, Ólafur Ósvaldsson wrote:
> Hi,
> Our system had just over 4.5 million chunks untill one week ago when a good deal of the data was deleted (on purpose).
>
> Today the trash time expired and it seems that our master is deleting all the unused chunks which is quite normal except each server of 10 is doing up to 5.5k chunk deletions pr. minute and all systems accessing the MFS partitions are very slow and that started at the same time as the chunk deletions.

OK, despite having previously set our CHUNKS_DEL_LIMIT to 20 a few days 
ago and restarting mfsmaster we are once again seeing 10K+ chunk 
deletions a second and it is impacting the cluster (though not as badly 
this time as we have more memory in our chunkservers).

How do we limit this?

CHUNKS_DEL_LIMIT seems to work under normal loads, but the system seems 
to ignore it at times.

-bill