Re: [Moosefs-users] How big can MooseFS really go?

[Michal B. <mic...@ge...>]

WOW!!! 

 

And what about FusionIO in all the chunkservers? ;) But as you are talking
about FusionIO in mfsmaster so probably you are also going to use them in
metaloggers? I just think if it is necessary. Metadata is cached in RAM in
mfsmaster, but there are changelogs. If the system will be busy (and for
sure it will be) there would be lots of operations logged to the files and
transmitted to metaloggers.

 

Please tell us how many files do you plan to store?

 

 

Regards

Michal

 

 

From: Thomas S Hatch [mailto:tha...@gm...] 
Sent: Tuesday, January 18, 2011 6:06 PM
To: moosefs-users
Subject: [Moosefs-users] How big can MooseFS really go?

 

I am architecting a potential 3P MooseFS install.... 3 Peta-bytes... and
maybe even 4P (assuming we will be moving to 4T disks when they come out).

 

My question is this, can MooseFS handle that kind of load? Are there any
additional considerations that I will need to take as I approach such a high
volume.

 

As I am seeing I will have over 100 chunkservers attached to one master. I
am going to change out the mfsmaster metadata store with fusionio
(http://www.fusionio.com/) drives to maintain the disk speed that metadata
operations will need.

 

This deployment will also require well over 100 million chunks.

 

So my question again is, what, if any, special considerations should I take
as I roll this out?

 

-Thomas S Hatch