Re: [Moosefs-users] mfsmaster performance and hardware

[Michal B. <mic...@ge...>]

Hi Robert

I wrote shortly about multithreading in mfsmaster here:
http://sourceforge.net/mailarchive/message.php?msg_id=26680860

So no, it is not on our roadmap.

And yes, performance of MooseFS is dependent on the performance of
mfsmaster. CPU load depends on amount of operations in the filesystem. In
our environment the master server consumes about 30% of CPU (ca. 1500
operations per second).  HDD doesn't have to be huge, but still it should be
quick for dumps of metadata and continuous saving of changelogs. 

Rough estimate how much RAM you need is here:
http://www.moosefs.org/moosefs-faq.html#sort

And to be honest metalogger machines should be as good as the master itself
because in case of emergency metalogger should be switched to the role of
the master.


Kind regards
-Michal


-----Original Message-----
From: Robert Sandilands [mailto:rsa...@ne...] 
Sent: Thursday, August 04, 2011 2:42 AM
To: moo...@li...
Subject: [Moosefs-users] mfsmaster performance and hardware

We have been spending a lot of time trying to get MooseFS stable and 
optimized.

Something I have noticed is that mfsmaster seems to be a bottleneck in 
our setup. What I also noticed is that mfsmaster is single threaded. 
 From reading the source code it seems to use a very interesting polling 
loop to handle all communications and actions.

So a question: Is there anything on the roadmap to make mfsmaster 
multithreaded?

It also seems that the performance of MooseFS is very dependent on the 
performance of mfsmaster. If the machine running mfsmaster is slow or is 
busy then it can slow everything down significantly or even cause 
instability in the file system.

This also implies that if you want to buy a dedicated machine for 
mfsmaster that you have to buy the fastest possible CPU and as much RAM 
as you need. Local disk space and multiple CPUs and cores are not 
important. Is this correct? What would the recommendation be for an 
optimal machine to run mfsmaster?

Robert


----------------------------------------------------------------------------
--
BlackBerry® DevCon Americas, Oct. 18-20, San Francisco, CA
The must-attend event for mobile developers. Connect with experts. 
Get tools for creating Super Apps. See the latest technologies.
Sessions, hands-on labs, demos & much more. Register early & save!
http://p.sf.net/sfu/rim-blackberry-1
_______________________________________________
moosefs-users mailing list
moo...@li...
https://lists.sourceforge.net/lists/listinfo/moosefs-users