Thanks for the replies. I get the philosophy of the striping, it is just different than what I expected.
It would be neat if Moose had pluggable chunk distribution. The built in one has priorities to level the usage of the disks in the system which results in a lot of striping. I for one would prefer that chunks be allocated on the same disk as other chunks for the file, and rebalanced to 'defragment' files onto fewer disks. There is also the idea of local chunkservers, you could implement a chunk distributor that tended to place new chunks on a server local to the client. An interface could be developed so that implementations could even be scripted. WIld idea, I know, but just a thought.
Ethan
On Mar 4, 2011, at 2:29 AM, Steve wrote:
>
> Hi,
>
>
>
> The idea is that when you loose the first drive moosefs will re-address the
> balance by making copies. Unless you loose 3 chunkservers at the same time
> (highly unlikely) youd be fine. More chunkservers than the highest goal are
> required for security. More the better.
>
>
>
> Steve
>
>
>
>
>
> -------Original Message-------
>
>
>
> From: Ethan Tuttle
>
> Date: 04/03/2011 09:38:46
>
> To: moo...@li...
>
> Subject: [Moosefs-users] chunk distribution & striping
>
>
>
> I have a question about Moose FS' chunk distribution algorithm. Due to the
> striping, an entire set of files with a given goal can be lost rather than
> just the files on failed devices. In other words, with 10 disks and all
> files goal=3, you likely lose the the entire filesystem if three disks go
> down.
>
>
>
> Will MooseFS be improved in this area? Perhaps the chunk distribution could
> tend to put files on the same disks? I realize this isn't a trivial problem
> but I'm curious if it is on the roadmap.
>
>
>
> Regards,
>
>
>
> Ethan
>
> -----------------------------------------------------------------------------
>
>
> What You Don't Know About Data Connectivity CAN Hurt You
>
> This paper provides an overview of data connectivity, details
>
> its effect on application quality, and explores various alternative
>
> solutions. http://p.sf.net/sfu/progress-d2d
>
> _______________________________________________
>
> moosefs-users mailing list
>
> moo...@li...
>
> https://lists.sourceforge.net/lists/listinfo/moosefs-users
>
>
|
