Re: [Moosefs-users] Large scale deletions

[Thomas S H. <tha...@gm...>]

Sure thing, I will give it a try, I have not yet spent much time looking at
chunk loops, but it looks like I can refine a lot of the backend processes
with it, I will have to play around with it!

2011/3/2 Michal Borychowski <mic...@ge...>

> Hi!
>
>
>
> Thomas, you can try to set CHUNKS_DEL_LIMIT option in mfsmaster.cfg to 10
> and see if it helps you for the moment. It depends if you delete lots of
> files once or you delete them “continuously”.
>
>
>
>
>
> Regards
>
> Michal
>
>
>
> *From:* Thomas S Hatch [mailto:tha...@gm...]
> *Sent:* Tuesday, March 01, 2011 12:46 AM
> *To:* moosefs-users
> *Subject:* [Moosefs-users] Large scale deletions
>
>
>
> I have run into a problem with Moosefs when I delete a LOT of files at
> once, in my environment we add hundreds of thousands of files, process them
> into smaller encoded files, and then delete the originals, when we delete
> the originals the deletion process can lock up our writes, and dramatically
> slows down our moosefs.
>
>
>
> Is there a way to make large scale deletions behave a little more nicely?
>
>
>
> -Thomas  S Hatch
>