From: Ólafur Ó. <osv...@ne...> - 2011-09-22 10:00:20
|
We have the exact same problem, chunk deletions have caused problems in the past and we have DEL_LIMIT set at 5, but mfsmaster increases it to 40-50 right away and sometimes goes to 70/s This is also the case for chunk replications, it does not seem to honor the mfsmaster.cfg settings, although that does not get logged. /Oli On 22.9.2011, at 05:03, wk...@bn... wrote: > Ok, we deleted a couple hundred thousand files from a large Maildir > folder set. > > We have had problems with deletions overwhelming the cluster in the > past, so we have a DEL_LIMIT set to 20 (which we will probably lower) > > But when the expiretime hit, the server became lethargic. in checking > the logs I see this > > Sep 21 21:10:31 mfs1master mfsmaster[2373]: DEL_LIMIT temporary > increased to: 26/s > Sep 21 21:15:30 mfs1master mfsmaster[2373]: DEL_LIMIT temporary > increased to: 33/s > Sep 21 21:55:24 mfs1master mfsmaster[2373]: DEL_LIMIT decreased back to: > 26/s > > OK, WHY IS DOING THIS! I told it no more than 20 > > I do NOT want this, it kills my server and we've learned the hard way it > can really screw up VM images (they go read-only) if the deletions > overwhelm the cluster. > > > -bill > > > > ------------------------------------------------------------------------------ > All the data continuously generated in your IT infrastructure contains a > definitive record of customers, application performance, security > threats, fraudulent activity and more. Splunk takes this data and makes > sense of it. Business sense. IT sense. Common sense. > http://p.sf.net/sfu/splunk-d2dcopy1 > _______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users -- Ólafur Osvaldsson System Administrator Nethonnun ehf. e-mail: osv...@ne... phone: +354 517 3400 |