Re: [Moosefs-users] Small file performance is an order of magnitude worse than large files

[Kristofer P. <kri...@cy...>]

MFS is designed for large files, as it was written as a clone to Google File System. It will perform very poorly with small files. I don't think there is much you can do. 

----- Original Message -----

From: "Vineet Jain" <vin...@gm...> 
To: moo...@li... 
Sent: Tuesday, August 2, 2011 10:03:26 AM 
Subject: [Moosefs-users] Small file performance is an order of magnitude worse than large files 

I have a test instance up with a 5 drives one master and one chunk server. Large file performance is fine. However when testing with 100,000's of small files (10k - 100k) I'm getting about 200-300k write performance per drive from looking at the output of iostat. Is that sound right? Any way to speed up the writes. It is painfully slow. 




------------------------------------------------------------------------------ 
BlackBerry&reg; DevCon Americas, Oct. 18-20, San Francisco, CA 
The must-attend event for mobile developers. Connect with experts. 
Get tools for creating Super Apps. See the latest technologies. 
Sessions, hands-on labs, demos & much more. Register early & save! 
http://p.sf.net/sfu/rim-blackberry-1 
_______________________________________________ 
moosefs-users mailing list 
moo...@li... 
https://lists.sourceforge.net/lists/listinfo/moosefs-users