Re: [Moosefs-users] Best FileSystem for chunkers.

[Steve W. <st...@pu...>]

On 05/16/2012 05:34 PM, wkmail wrote:
> We are building another MFS cluster.
>
> What is the current thought regarding File systems for Chunkers using
> older retired Opteron 250 servers (SATA2) each with 2GB RAM.
>
> We would use Scientific Linux 6.x which defaults to EXT4 so that is the
> first thing to come to mind, but reviews are mixed.
>
> Some really push EXT3
>
> http://source.yeeyan.org/view/353552_f0d/Linux%20filesystems%20benchmarked:%20EXT3%20vs%20EXT4%20vs%20XFS%20vs%20BTRFS
>
> and since the chunkserver environment is decidedly single purpose we are
> leaning in that direction.
>
> Note: we aren't terribly excited about XFS as we have had some issues
> with that in the past, but if someone feels strongly about it...
>
> Sincerely,
>
> -wk
>

We have used both ext4 and XFS with equal success.  ext4 has more 
overhead than XFS which on our chunk servers (8 x 3TB disks) causes the 
ext4 chunk servers to report 21TB of space while the XFS chunk servers 
report 22TB of space.  It's hard to give up a terabyte of space!

I'd like to know if anyone has tried a file system with compression like 
ZFS on Linux.  Some have mentioned that it might yield a performance 
improvement.  I might give it a try on our next pair of chunk servers 
but it would be good to know if anyone else has gone this route before 
and what their experience has been.

Steve