From: Thomas S H. <tha...@gm...> - 2010-12-09 19:56:10
|
I am wondering, I have a large moosefs setup right now with over 140T, but we built the chunkservers out one at a time and the file load is very different on all the servers, I have some servers using %45 of thier disk space and some using above %90. This of course happened because we were running on a few servers, added a lot of files and then added more servers, I am just curious, as I have been unable to find this in the docs anywhere, but is it possible to tell the mfsmaster to start moving chunks around for a more even distribution of files in this case? Or should it just even out over time? -Tom Hatch |
From: Laurent W. <lw...@hy...> - 2010-12-10 09:43:33
|
On Thu, 9 Dec 2010 12:56:09 -0700 Thomas S Hatch <tha...@gm...> wrote: > I am wondering, I have a large moosefs setup right now with over 140T, but > we built the chunkservers out one at a time and the file load is very > different on all the servers, I have some servers using %45 of thier disk > space and some using above %90. > > This of course happened because we were running on a few servers, added a > lot of files and then added more servers, I am just curious, as I have been > unable to find this in the docs anywhere, but is it possible to tell the > mfsmaster to start moving chunks around for a more even distribution of > files in this case? Or should it just even out over time? > > -Tom Hatch That's pretty strange, mfs balances by default data load. If your fs is 80% full, your say 3 chunkservers should be about 80% full each. try restarting the mfschunkserver service on a lightly loaded chunkserver ? There's no way afaik to tell mfsmaster to balance. It does this by default. HTH, -- Laurent Wandrebeck HYGEOS, Earth Observation Department / Observation de la Terre Euratechnologies 165 Avenue de Bretagne 59000 Lille, France tel: +33 3 20 08 24 98 http://www.hygeos.com GPG fingerprint/Empreinte GPG: F5CA 37A4 6D03 A90C 7A1D 2A62 54E6 EF2C D17C F64C |
From: Michał B. <mic...@ge...> - 2010-12-10 10:14:26
|
But please remember that this process takes quite a long time (it may be 2-3 weeks). Performance is the most important thing for the system, not rebalancing. Regards Michał -----Original Message----- From: Laurent Wandrebeck [mailto:lw...@hy...] Sent: Friday, December 10, 2010 10:43 AM To: moo...@li... Subject: Re: [Moosefs-users] Balance chunks On Thu, 9 Dec 2010 12:56:09 -0700 Thomas S Hatch <tha...@gm...> wrote: > I am wondering, I have a large moosefs setup right now with over 140T, > but we built the chunkservers out one at a time and the file load is > very different on all the servers, I have some servers using %45 of > thier disk space and some using above %90. > > This of course happened because we were running on a few servers, > added a lot of files and then added more servers, I am just curious, > as I have been unable to find this in the docs anywhere, but is it > possible to tell the mfsmaster to start moving chunks around for a > more even distribution of files in this case? Or should it just even out over time? > > -Tom Hatch That's pretty strange, mfs balances by default data load. If your fs is 80% full, your say 3 chunkservers should be about 80% full each. try restarting the mfschunkserver service on a lightly loaded chunkserver ? There's no way afaik to tell mfsmaster to balance. It does this by default. HTH, -- Laurent Wandrebeck HYGEOS, Earth Observation Department / Observation de la Terre Euratechnologies 165 Avenue de Bretagne 59000 Lille, France tel: +33 3 20 08 24 98 http://www.hygeos.com GPG fingerprint/Empreinte GPG: F5CA 37A4 6D03 A90C 7A1D 2A62 54E6 EF2C D17C F64C |
From: Thomas S H. <tha...@gm...> - 2010-12-10 16:04:46
|
Thanks guys! Thats what I needed to know, that also helps since some of our chunkservers have more space than others, I will continue to wait then and continue to trust the moose! -Tom 2010/12/10 Michał Borychowski <mic...@ge...> > But please remember that this process takes quite a long time (it may be > 2-3 > weeks). Performance is the most important thing for the system, not > rebalancing. > > > Regards > Michał > > -----Original Message----- > From: Laurent Wandrebeck [mailto:lw...@hy...] > Sent: Friday, December 10, 2010 10:43 AM > To: moo...@li... > Subject: Re: [Moosefs-users] Balance chunks > > On Thu, 9 Dec 2010 12:56:09 -0700 > Thomas S Hatch <tha...@gm...> wrote: > > > I am wondering, I have a large moosefs setup right now with over 140T, > > but we built the chunkservers out one at a time and the file load is > > very different on all the servers, I have some servers using %45 of > > thier disk space and some using above %90. > > > > This of course happened because we were running on a few servers, > > added a lot of files and then added more servers, I am just curious, > > as I have been unable to find this in the docs anywhere, but is it > > possible to tell the mfsmaster to start moving chunks around for a > > more even distribution of files in this case? Or should it just even out > over time? > > > > -Tom Hatch > That's pretty strange, mfs balances by default data load. > If your fs is 80% full, your say 3 chunkservers should be about 80% full > each. try restarting the mfschunkserver service on a lightly loaded > chunkserver ? > There's no way afaik to tell mfsmaster to balance. It does this by default. > HTH, > -- > Laurent Wandrebeck > HYGEOS, Earth Observation Department / Observation de la Terre > Euratechnologies > 165 Avenue de Bretagne > 59000 Lille, France > tel: +33 3 20 08 24 98 > http://www.hygeos.com > GPG fingerprint/Empreinte GPG: F5CA 37A4 6D03 A90C 7A1D 2A62 54E6 EF2C > D17C > F64C > > |