Re: [MooseFS-Users] CHUNKS_SOFT_DEL_LIMIT and CHUNKS_HARD_DEL_LIMIT on moosefs ce

[Steve W. <st...@pu...>]

Perhaps you could have a cron job that would run every day at 8 a.m. and 
another one at 11 p.m.  The 8 a.m. cron job would create a symbolic link 
from /etc/mfs/mfsmaster.cfg to /etc/mfs/mfsmaster-day.cfg and then send 
a signal to the mfsmaster to reload its configuration.  And similarly, 
the 11 p.m. cron job would create a symbolic link from 
/etc/mfs/mfsmaster.cfg to /etc/mfs/mfsmaster-night.cfg and send a reload 
signal to mfsmaster. The two different config files would, of course, 
have the two different settings that you want, one for the daytime hours 
and another for the nighttime hours.

Steve

On 04/06/2015 08:01 AM, Eduardo Kellenberger wrote:
> Hi, thanks for your answer.
>
> The number of erasure is variable, I neesito is that from 8am to 11pm files are not deleted, or the least amount is removed to prevent overloading of chunckserver and between 11pm and 8am deletion rise.
>
> This I could control with version 1.6 but with the 2 EC no.
>
>
> best regard,
>
> Eduardo Kellenberger
>
>
>
>
>
> El Jueves 02 abril 2015 10:33:34 Aleksander Wieliczko escribió:
>> Hello
>> First of all I would like to explain what these parameters mean and how
>> does it work:
>>
>> CHUNKS_SOFT_DEL_LIMIT - Soft maximum number of chunks being
>> simultaneously deleted on one chunkserver (default is 10)
>> CHUNKS_HARD_DEL_LIMIT - Hard maximum number of chunks being
>> simultaneously deleted on one chunkserver (default is 25)
>>
>> MooseFS mainly uses the soft delete limit. If the system is able to
>> remove all "to delete" chunks in one loop run, deletion limit will not
>> be changed.
>> But if the number of chunks to delete increase after a loop run,
>> deletion limit will be increased by factor of 1.5 but never to a value
>> higher than CHUNKS_HARD_DEL_LIMIT.
>>
>> This mechanism was implemented to prevent MooseFS cluster from freezing
>> because of too many delete operations.
>> So if you have small number of delete operations in your system hard
>> limit will never be reached.
>>
>> How many files are you deleting in your system?