Re: [MooseFS-Users] performance inquiry

[Aleksander W. <ale...@mo...>]

Hi.

Can we get some more details about your configuration?

- MooseFS master version?
- MooseFS chunkserver version?
- MooseFS client version?
- Kernel version ?
- CPU speed ?
- RAM size ?
- Number of disks per chunkserver?
- What GOAL you set for test folder?
- NIC interface type - Coper or Fiber?
- Network latency from client to master and chunkservers(ping mfsmaster)?
- Do you have some traffic shaping/QOS in you LAN?

Best regards
Aleksander Wieliczko
Technical Support Engineer
MooseFS.com <moosefs.com>


On 25.08.2015 18:29, Joseph Love wrote:
> They’re all on 10gbe.  I did turn on Jumbo frames during my testing, it didn’t seem to make a really big difference.
>
> I just tried with SSDs in the chunk servers (Intel DC S3500 200GB), and still seeing about the same performance characteristic.
>
> I know in the middle of some other synthetic tests that I can break 200MB/s (sequential) read, 150MB/s write, but that’s a multithreaded test application.
> Actually, now that I say that, I suppose it might be a single-thread performance characteristic with FUSE on FreeBSD.
>
> Anyone have statistic from a Linux system that shows > 100MB/s per thread on a client?
>
> -Joe
>
>> On Aug 25, 2015, at 11:12 AM, Ricardo J. Barberis <ric...@do...> wrote:
>>
>> El Martes 25/08/2015, Joseph Love escribió:
>>> Hi,
>>>
>>> I’ve been doing some tests to get an idea as to what sort of speeds I can
>>> maybe expect from moosefs, and ran into something unexpected.  From
>>> multiple clients, I can sustain 80-100MB/s per client (only tested up to 3
>>> clients) to my 3-node cluster (3 chunk servers).  From a single client
>>> (while everything else is idle) I get the same result.  It occurred to me
>>> that the write speed to a disk in each chunk server is roughly 100MB/s, and
>>> I was curious if this seems to be the likely culprit for performance
>>> limitations for a single stream from a single client.
>>>
>>> I’m about to try it again with SSDs, but I have a bit of time before that’s
>>> ready, and I figured I’d try to pose the question early.
>>>
>>> Thoughts?
>>>
>>> -Joe
>> How about network? If your clients are connected to 1 Gbps, 100 MB/s is nearly 
>> saturating the network.
>>
>> Also, using Jumbo frames might give you a few extra MB/s.
>>
>> Regards,
>> -- 
>> Ricardo J. Barberis
>> Senior SysAdmin / IT Architect
>> DonWeb
>> La Actitud Es Todo
>> www.DonWeb.com
>>  _____
>>
>> ------------------------------------------------------------------------------
>> _________________________________________
>> moosefs-users mailing list
>> moo...@li...
>> https://lists.sourceforge.net/lists/listinfo/moosefs-users
>
> ------------------------------------------------------------------------------
> _________________________________________
> moosefs-users mailing list
> moo...@li...
> https://lists.sourceforge.net/lists/listinfo/moosefs-users