[Moosefs-users] MFS bottleneck?

[Marco B <mar...@gm...>]

Hi All,
we are doing some benchmarks with MooseFS using a single server
Linux CentOS 5.7, HP DL585G6 4x6core Opteron 2.8Ghz, 128GB Ram, 160 GB
ioDrive SLC

Here is Bonnie result over ioDrive partition (unoptimized ext3 filesystem):

Version 1.03e       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
mfs1.domain   1000M 72004  92 623230  99 1007946  99 87689  99 +++++
+++ +++++ +++
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++


Here is Bonnie result on the same ioDrive mounted over MooseFS:

Version 1.03e       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
mfs1.domain   1000M 46785  65 61631   8 85611   9 84549  98 2026423
99  4230   7
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16   669   4 29247  20  5808  12   699   3  3405   5  1544   5

It seems there is a big bottleneck in mfs or maybe Fuse.
During tests we saw mfschunkserver and mfsmount processes eating 100%
of a single CPU each.

Waiting for comments/suggestions
Regards
Marco