Re: [Moosefs-users] Fw: Re: chunkserver over several offices

[Alexander A. <akh...@ri...>]

Hi ALL!

We also use MooseFS on virtual ESX4.1 environment
and I can share my experience.

Virtual machines are Open SuSE 2.6.34.7
On MooseFS we have around 1 000 000 fs objects

# ls -l /moosefs/metadata/metadata.mfs.back
-rw-r----- 1 mfs mfs 121913374 Apr 20 12:00 /moosefs/metadata/metadata.mfs.back

7 MFS-client connected (mfs is shared by Samba for Windows clients (including
terminal server farm and Winsows XP stations)

I had not any performance issues because of virtualization.

But ... ESX is for money and MooseFS is for free ;--)

wbr
Alexander Akhobadze

======================================================

Hi!

On physical hosts it is VMWare ESX4.1, on virtual machines it is Debian
Squeeze. 

Test environment had 5 chunkservers (some older physical servers with one
CPU Xeon, 1GB RAM, 1TB SATA drives, Debian Squeeze), mfsmaster and
mfsmetalogger on virtual machines and 5 clients using MFS. W have not
noticed any difficulties. Everything is connected with 1Gbps network. There
wasn't many files in MFS environment, about 10k, 1TB of data. In one-two
months we plan to move whole hosting enviroment (about 6TB of data, don't
know number of files, but it is high  :) )  to MFS and then I will be able
to give you some more detailed performance info. 

>From my experience, there is no big impact on performance in virtual
machines. We have virtualized about 30 servers last year, and I don't see
any difference in performance between physical servers and virtual machines.

Best regards
Krzysztof Janiszewski
ecenter sp. z o.o.
--------------------------------------
Domeny, hosting, poczta wideo :: http://www.ecenter.pl ::

Niniejsza wiadomość przekazana została Państwu przez ecenter sp z o.o.
87-100 Toruń, Ul. Goździkowa 2
Zarejestrowana w Sądzie Rejonowym w Toruniu VII Wydział Gospodarczy
Krajowego Rejestru Sądowego pod numerem 0000251110 Z kapitałem zakładowym w
wysokości 142500zł NIP 956-216-66-73


-----Original Message-----
From: Michal Borychowski [mailto:mic...@ge...] 
Sent: Wednesday, April 20, 2011 9:29 AM
To: 'Krzysztof Janiszewski - ecenter sp. z o.o.'
Cc: moo...@li...
Subject: RE: [Moosefs-users] Fw: Re: chunkserver over several offices

Hi!

The solution is very smart. In what environment have you done the tests?
What operating systems (for the physical machine and virtual machine). How
many files there were in MooseFS? How big was metadata file? How many
clients connected? Was the whole MooseFS quite busy? What about performance
of the master running in virtual machines? 


Kind regards
-Michal

-----Original Message-----
From: Krzysztof Janiszewski - ecenter sp. z o.o.
[mailto:k.j...@ec...]
Sent: Wednesday, April 20, 2011 9:06 AM
To: 'Boyko Yordanov'
Cc: moo...@li...
Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices

We have found failover solution for mfsserver. Our mfsserver is running on
VMWare virtual machine, which is configured in Fault tolerance mode. This
means that there are in fact two running virtual machines on two physical
hosts. Primary VM and secondary VM are doing the same CPU operations. When
primary VM fails, secondary takes over all tasks and everything is runnining
fine without interruption or data loss.

Best regards
Krzysztof Janiszewski
ecenter sp. z o.o.
--------------------------------------
Domeny, hosting, poczta wideo :: http://www.ecenter.pl ::


-----Original Message-----
From: Boyko Yordanov [mailto:b.y...@ex...]
Sent: Wednesday, April 20, 2011 8:48 AM
To: Michal Borychowski
Cc: moo...@li...
Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices

Hi,

Great news indeed, however, isn't it more important to implement reliable
failover solution and fix the single point of failure?

So far there is no real working failover solution, not even Thomas Hatch's
one. Its just that mfsmetalogger can't be trusted. 

Boyko
 
On Apr 20, 2011, at 8:18 AM, Michal Borychowski wrote:

>> I've got great news - we are going to introduce big improvements in
upcoming 1.6.21 version which also include "rack awaraness" :) This is a
feature lots of people were waiting for and I hope it will cater to your
needs.