Re: [MooseFS-Users] BTRFS

[Aleksander W. <ale...@mo...>]

Hi.

In your situation the best idea is to add another chunk server and change GOAL to 3 as it was mentioned by Ricardo J. Barberis.
Replication mechanism in MooseFS 2.0 and 3.0 is redesigned, and it works much more efficient than in old 1.6 version.
So for example if you loose one disk(full 1TB) it will replicate in less than 2 hours - 1TB RAID1 rebuild will take much much more time than this.

Another problems:
- RAID1 is slower than JBOD in MooseFS
- Available space is lower when you are using RAID1 for chunkserver disk than JBOD. 

About BTRFS - we have tested older version of BTFS an we had kernel panic during tests.
We didn’t test the latest available release but we will in the nearest future.
At this moment we recommend XFS as backend FS for chunkserver disks.

Best regards
Aleksander Wieliczko
Technical Support Engineer
MooseFS.com <moosefs.com>

> On 15 Jul 2015, at 19:17, Ricardo J. Barberis <ric...@do...> wrote:
> 
> Maybe you could consider another chunkserver and a goal of 3?
> 
> It's one more chunkserver but only 1.5x disk space compared to 2x with 2 
> chunkservers and RAID1 (whether by software or hardware).
> 
> El Miércoles 15/07/2015, Aleksander Wieliczko escribió:
>> Hi Michael
>> 
>> We had bad experience with BTFS so we are not advising to use this fs as
>> backend for chunkserver HDD.
>> We recommend XFS because we achieved the best performance with disk of
>> 90% usage.
>> 
>> We have extra questions:
>> How big your MooseFS is - how many files you have?
>> What is your LAN speed?
>> What is the MooseFS version?
>> 
>> Best regards
>> Aleksander Wieliczko
>> Technical Support Engineer
>> MooseFS.com <http://moosefs.com/> <moosefs.com <http://moosefs.com/>>
>> 
>> On 15.07.2015 09:24, Michael Tinsay wrote:
>>> Hi.
>>> 
>>> Is anybody using btrfs for moosefs?
>>> 
>>> I currently have a 2-chunkserver (using jbod, ext4 fs, and goal=2 for
>>> all files) setup running that has recently experienced an hd failure
>>> in one of the chunkservers.  While replacing the failed hdd was an
>>> almost trivial task, there was a long span of time where a big number
>>> of chunks only had 1 copy.  While I did not lose sleep over it, I had
>>> this concern of potentially losing chunks should there be another hd
>>> failure in the other chunkserver while moosefs is still replicating
>>> the 1-copy chunks.
>>> 
>>> So now I'm entertaining the idea of moving from
>>> just-a-bunch-of-ext4-disks to one-big-btrfs-raid1-fs as the underlying
>>> storage provider -- using Ubuntu 14.04 distro plus the 4.1.x LTS
>>> kernel from kernel-ppa.
>>> 
>>> I'm thinking that with such a setup I would still be up and running
>>> with 2 copies for all chunks even if both chunkservers have 1 disk
>>> failure each at the same time.  And the setup would survive a failed
>>> chunkserver with 1 failed disk in the remaining chunkserver.
>>> 
>>> I would like to hear your thoughts on this.
>>> 
>>> Regards.
>>> 
>>> 
>>> --- mike t.
>>> 
>>> 
>>> -------------------------------------------------------------------------
>>> ----- Don't Limit Your Business. Reach for the Cloud.
>>> GigeNET's Cloud Solutions provide you with the tools and support that
>>> you need to offload your IT needs and focus on growing your business.
>>> Configured For All Businesses. Start Your Cloud Today.
>>> https://www.gigenetcloud.com/
>>> 
>>> 
>>> _________________________________________
>>> moosefs-users mailing list
>>> moo...@li...
>>> https://lists.sourceforge.net/lists/listinfo/moosefs-users
> 
> 
> 
> -- 
> Ricardo J. Barberis
> Senior SysAdmin / IT Architect
> DonWeb
> La Actitud Es Todo
> www.DonWeb.com <http://www.donweb.com/>
> 
> ------------------------------------------------------------------------------
> Don't Limit Your Business. Reach for the Cloud.
> GigeNET's Cloud Solutions provide you with the tools and support that
> you need to offload your IT needs and focus on growing your business.
> Configured For All Businesses. Start Your Cloud Today.
> https://www.gigenetcloud.com/
> _________________________________________
> moosefs-users mailing list
> moo...@li...
> https://lists.sourceforge.net/lists/listinfo/moosefs-users