Re: [MooseFS-Users] 3.0.39 - linux client, freebsd servers, seems to fail to write data

[Aleksander W. <ale...@mo...>]

Hi Joseph
Good to hear that all is working ok.

We are interested in your performance test.
Can you send as some feedback after you get some results / observations?

Best regards
Aleksander Wieliczko
Technical Support Engineer
MooseFS.com <moosefs.com>

On 18.08.2015 15:22, Joseph Love wrote:
> *Solution:*
> Put the linux client on the right network, and it works now.
>
>
> Rest of my email that I was writing up before I realized what I’d done:
>
> Sorry for the confusion, the performance issue was on a FreeBSD client
> with the FreeBSD servers, which became my drive to test some other
> clients (linux, mac).  Both the linux and mac clients do the same
> thing: connect with mfsmount, let me list and cd to different folders,
> then fail to do any file I/O.
>
> Additionally, I have realized why my linux client wasn’t working - I
> had screwed up its network settings.. it was on the wrong network.
>
> About the network setup:
> All 4 systems have Intel X520-DA2 10gbit network cards.  There are no
> firewalls turn on, and no VLANs configured.  
> They’re connected to two switches: 
> - Brocade 10gbit network switch, with 172.31.31.0/24 network, no other
> traffic here.
> - Juniper 10gbit network switch, for managing them, this is where my
> other traffic is, and where I mistakenly put the linux client.
>
>
>
> Sorry about that, it actually wasn’t until I’d started writing this
> email regarding the network setup where it finally clicked that the
> chunk servers are all expecting to only talk on the 172.31.31.0
> network, which is *not* where I put that linux client initially.
>  Moving it there solved that issue.  I’ll follow this up with some
> performance testing, and get back to my previous issue, where I feel
> like the freebsd client performance is poor.  Quick dd test on the
> linux client gives me about a 2.2x performance of what I was seeing on
> FreeBSD.
>
> So, thanks for making me think through my issue again, back to
> performance testing.
>
> -Joe
>
>> On Aug 18, 2015, at 1:22 AM, Aleksander Wieliczko
>> <ale...@mo...
>> <mailto:ale...@mo...>> wrote:
>>
>> Hi Joe!
>>
>> First of all I wouldn't call that performance issue because it's look
>> like your client have problem with chunkservers communication.
>>
>> Please check your firewall configuration.
>> Mfsclient use 9422 port to communicate with chunkservers and 9420 to
>> communicate with master.
>> Does your all moosefs components are in the same network, the same VALN?
>>
>> All ports that are used in MooseFS cluster communication are from
>> range 9419-9422
>>
>> I would like to add that default block size for dd is 512 bytes, so
>> you will not achieve good performance not only in MooseFS but in all
>> distributed file systems.
>> Try to increase block size to something like 4k, 8k, 32k, 64k 1M and
>> see the results.
>>
>> Can you tell as something more about your network configurations?
>>
>> Best regards
>> Aleksander Wieliczko
>> Technical Support Engineer
>> MooseFS.com <x-msg://30/moosefs.com>
>>
>> On 14.08.2015 21:13, Joseph Love wrote:
>>> Hi,
>>>
>>> I was testing out moosefs (again) on FreeBSD, when I ran into what appeared to be a performance issue, which I assumed was related to the client.  So, I decided to try a linux client with my FreeBSD master & chunk servers.
>>> All systems are running 3.0.39, the master & chunk servers are on FreeBSD, and the client is Debian (jessie).
>>>
>>> I can mount the moosefs share on the client, it shows me existing content.  I can traverse folders, create new folders, ‘touch’ new files, but the second I try and put data into a file, (“echo blah > test.txt” or “dd if=/dev/zero of=test.dd count=1”) the client seems to just lock-up.
>>>
>>> It did work with a FreeBSD client, but again, I think there may be a performance issue, as I couldn’t seem to exceed about 140MB/s (SSDs, 10gbit ethernet, many cores, lots of memory) hence why I wanted to try a linux client.  Ultimately I don’t care to run linux clients, but I would have liked to see a comparison in performance between the two.
>>>
>>> Any ideas why L linux client doesn’t seem to like my FreeBSD master/chunk servers?
>>>
>>> -Joe
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> _________________________________________
>>> moosefs-users mailing list
>>> moo...@li...
>>> https://lists.sourceforge.net/lists/listinfo/moosefs-users
>>
>