Menu
▾
▴
moosefs-users
|
From: Steve <st...@bo...> - 2011-04-18 11:44:53
|
I will fwd to the list as your more detailed description may help someone chip in. I'm sure Michal will be along. I think what your asking is beyond the current scope of moose. Which is primarily designed be gemius for there in house use although some rack awareness has been discussed and maybe on the road map. Maybe search the list archive and/or moose website. -------Original Message------- From: Eric mourgaya Date: 18/04/2011 12:02:55 To: Steve Subject: Re: [Moosefs-users] chunkserver over several offices hi, In fact , we have 4 datacenters and I need for some partitions not all, at least one copie of these partition on each datacenter or a subset of these datacenters (at least 2). And for some datacenter the number of chunkserver is greater than 4 so I have to ensure that these chunks are not on the same datacenter. The goal is to ensure a recovery on another datacenter in crash case. Have you an idea to solve my problem with a distributed point of view? thanks 2011/4/18 Steve <st...@bo...> What are you trying to gain over having them in one place ? -------Original Message------- From: Eric mourgaya Date: 18/04/2011 09:40:09 To: moo...@li... Subject: [Moosefs-users] chunkserver over several offices Hi, How to ensure a least a copy of each chunk on servers dispatch on several offices. The solution is easy if we have one chunkserver on each office. How can I do this when some office have, for example, 5 chunkservers and other only one? thank for you help -- Eric Mourgaya, Respectons la planète! Luttons contre la médiocrité! ----------------------------------------------------------------------------- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users -- Eric Mourgaya, Respectons la planète! Luttons contre la médiocrité! |
|
From: Michal B. <mic...@ge...> - 2011-04-18 12:03:07
|
Hi! I've got great news - we are going to introduce big improvements in upcoming 1.6.21 version which also include "rack awaraness" :) This is a feature lots of people were waiting for and I hope it will cater to your needs. PS. If you want to have chunkservers across different locations you still would have to have a very good connection between them. Kind regards Michał Borychowski MooseFS Support Manager _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ Gemius S.A. ul. Wołoska 7, 02-672 Warszawa Budynek MARS, klatka D Tel.: +4822 874-41-00 Fax : +4822 874-41-01 -----Original Message----- From: Steve [mailto:st...@bo...] Sent: Monday, April 18, 2011 1:45 PM To: moo...@li... Subject: [Moosefs-users] Fw: Re: chunkserver over several offices I will fwd to the list as your more detailed description may help someone chip in. I'm sure Michal will be along. I think what your asking is beyond the current scope of moose. Which is primarily designed be gemius for there in house use although some rack awareness has been discussed and maybe on the road map. Maybe search the list archive and/or moose website. -------Original Message------- From: Eric mourgaya Date: 18/04/2011 12:02:55 To: Steve Subject: Re: [Moosefs-users] chunkserver over several offices hi, In fact , we have 4 datacenters and I need for some partitions not all, at least one copie of these partition on each datacenter or a subset of these datacenters (at least 2). And for some datacenter the number of chunkserver is greater than 4 so I have to ensure that these chunks are not on the same datacenter. The goal is to ensure a recovery on another datacenter in crash case. Have you an idea to solve my problem with a distributed point of view? thanks 2011/4/18 Steve <st...@bo...> What are you trying to gain over having them in one place ? -------Original Message------- From: Eric mourgaya Date: 18/04/2011 09:40:09 To: moo...@li... Subject: [Moosefs-users] chunkserver over several offices Hi, How to ensure a least a copy of each chunk on servers dispatch on several offices. The solution is easy if we have one chunkserver on each office. How can I do this when some office have, for example, 5 chunkservers and other only one? thank for you help -- Eric Mourgaya, Respectons la planète! Luttons contre la médiocrité! ----------------------------------------------------------------------------- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users -- Eric Mourgaya, Respectons la planète! Luttons contre la médiocrité! ------------------------------------------------------------------------------ Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
|
From: Alexander A. <akh...@ri...> - 2011-04-18 12:36:47
|
WOW!!!! That is grate news!!! wbr Alexander ====================================================== Hi! I've got great news - we are going to introduce big improvements in upcoming 1.6.21 version which also include "rack awaraness" This is a feature lots of people were waiting for and I hope it will cater to your needs. PS. If you want to have chunkservers across different locations you still would have to have a very good connection between them. Kind regards Michał Borychowski MooseFS Support Manager _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ Gemius S.A. ul. Wołoska 7, 02-672 Warszawa Budynek MARS, klatka D Tel.: +4822 874-41-00 Fax : +4822 874-41-01 -----Original Message----- From: Steve [mailto:st...@bo...] Sent: Monday, April 18, 2011 1:45 PM To: moo...@li... Subject: [Moosefs-users] Fw: Re: chunkserver over several offices I will fwd to the list as your more detailed description may help someone chip in. I'm sure Michal will be along. I think what your asking is beyond the current scope of moose. Which is primarily designed be gemius for there in house use although some rack awareness has been discussed and maybe on the road map. Maybe search the list archive and/or moose website. -------Original Message------- From: Eric mourgaya Date: 18/04/2011 12:02:55 To: Steve Subject: Re: [Moosefs-users] chunkserver over several offices hi, In fact , we have 4 datacenters and I need for some partitions not all, at least one copie of these partition on each datacenter or a subset of these datacenters (at least 2). And for some datacenter the number of chunkserver is greater than 4 so I have to ensure that these chunks are not on the same datacenter. The goal is to ensure a recovery on another datacenter in crash case. Have you an idea to solve my problem with a distributed point of view? thanks 2011/4/18 Steve <st...@bo...> What are you trying to gain over having them in one place ? -------Original Message------- From: Eric mourgaya Date: 18/04/2011 09:40:09 To: moo...@li... Subject: [Moosefs-users] chunkserver over several offices Hi, How to ensure a least a copy of each chunk on servers dispatch on several offices. The solution is easy if we have one chunkserver on each office. How can I do this when some office have, for example, 5 chunkservers and other only one? thank for you help -- Eric Mourgaya, Respectons la planète! Luttons contre la médiocrité! ----------------------------------------------------------------------------- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users -- Eric Mourgaya, Respectons la planète! Luttons contre la médiocrité! ------------------------------------------------------------------------------ Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users ------------------------------------------------------------------------------ Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
|
From: youngcow <you...@gm...> - 2011-04-18 13:09:29
|
Wow! That's great! > Hi! > > I've got great news - we are going to introduce big improvements in upcoming 1.6.21 version which also include "rack awaraness" :) This is a feature lots of people were waiting for and I hope it will cater to your needs. > > PS. If you want to have chunkservers across different locations you still would have to have a very good connection between them. > > > Kind regards > Michał Borychowski > MooseFS Support Manager > _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ > Gemius S.A. > ul. Wołoska 7, 02-672 Warszawa > Budynek MARS, klatka D > Tel.: +4822 874-41-00 > Fax : +4822 874-41-01 > > > -----Original Message----- > From: Steve [mailto:st...@bo...] > Sent: Monday, April 18, 2011 1:45 PM > To: moo...@li... > Subject: [Moosefs-users] Fw: Re: chunkserver over several offices > > > I will fwd to the list as your more detailed description may help someone > chip in. I'm sure Michal will be along. > > > > I think what your asking is beyond the current scope of moose. Which is > primarily designed be gemius for there in house use although some rack > awareness has been discussed and maybe on the road map. Maybe search the > list archive and/or moose website. > > > > > > > > -------Original Message------- > > > > From: Eric mourgaya > > Date: 18/04/2011 12:02:55 > > To: Steve > > Subject: Re: [Moosefs-users] chunkserver over several offices > > > > hi, > > > > > > In fact , we have 4 datacenters and I need for some partitions not all, at > least one copie of these partition on each datacenter or a subset of these > datacenters (at least 2). > > And for some datacenter the number of chunkserver is greater than 4 so I > have to ensure that these chunks are not on the same datacenter. > > > > The goal is to ensure a recovery on another datacenter in crash case. Have > you an idea to solve my problem with a distributed point of view? > > > > > > > > > > thanks > > > > > > > > 2011/4/18 Steve<st...@bo...> > > > > What are you trying to gain over having them in one place ? > > > > > > > > > > -------Original Message------- > > > > From: Eric mourgaya > > Date: 18/04/2011 09:40:09 > > To: moo...@li... > > Subject: [Moosefs-users] chunkserver over several offices > > > > Hi, > > > > How to ensure a least a copy of each chunk on servers dispatch on several > offices. The solution is easy if we have one chunkserver on each office. > > How can I do this when some office have, for example, 5 chunkservers and > other only one? > > > > thank for you help > > > > > |
|
From: jose m. <let...@us...> - 2011-04-19 22:44:29
|
>> El vie, 03-12-2010 a las 18:44 +0100 >> * Until the feature "Goal per Rac, and it is not foreseen" not >> "Location awareness" comes, >> Pater Noster qui es in Polonia ....you need N independent cluster's, and rsync or similar .... >El lun, 18-04-2011 a las 14:02 +0200, Michal Borychowski escribió: > Hi! > > I've got great news - we are going to introduce big improvements in upcoming 1.6.21 > version which also include "rack awaraness" :) This is a feature lots of people were > waiting for and I hope it will cater to your needs. > PS. If you want to have chunkservers across different locations you still would > > have to have a very good connection between them. > * Yeaaaah !!! ;-) * I appreciate your effort, sincerely. >> El lun, 08-11-2010 a las 15:05 -0700 >> * MooseFS not provide HA, unfortunately, it appears that I have a >> candle to the Black Virgin of Chestokova. >> * cheers .... * Pater Noster qui es in Polonia ... && Chestokova Rulez .. ;-) |
|
From: Michal B. <mic...@ge...> - 2011-04-20 05:17:21
|
Hola Jose! Si, Pater Noster qui es in Polonia ;) Saludos! Michal -----Original Message----- From: jose maria [mailto:let...@us...] Sent: Wednesday, April 20, 2011 12:44 AM To: moo...@li... Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices >> El vie, 03-12-2010 a las 18:44 +0100 >> * Until the feature "Goal per Rac, and it is not foreseen" not >> "Location awareness" comes, >> Pater Noster qui es in Polonia ....you need N independent cluster's, and rsync or similar .... >El lun, 18-04-2011 a las 14:02 +0200, Michal Borychowski escribió: > Hi! > > I've got great news - we are going to introduce big improvements in upcoming 1.6.21 > version which also include "rack awaraness" :) This is a feature lots of people were > waiting for and I hope it will cater to your needs. > PS. If you want to have chunkservers across different locations you still would > > have to have a very good connection between them. > * Yeaaaah !!! ;-) * I appreciate your effort, sincerely. >> El lun, 08-11-2010 a las 15:05 -0700 >> * MooseFS not provide HA, unfortunately, it appears that I have a >> candle to the Black Virgin of Chestokova. >> * cheers .... * Pater Noster qui es in Polonia ... && Chestokova Rulez .. ;-) ------------------------------------------------------------------------------ Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
|
From: Michal B. <mic...@ge...> - 2011-04-20 07:00:13
|
Hi This is a difficult question. If preparing a failover solution had been that easy, we would have done it already. And it is not. On the other hand we've been using MooseFS for more than 5 years with this architecture in a very busy production environment and it just works. Let Thomas finish his failover solution :) I am sure it will satisfy the needs of all users. Regards Michal -----Original Message----- From: Boyko Yordanov [mailto:b.y...@ex...] Sent: Wednesday, April 20, 2011 8:48 AM To: Michal Borychowski Cc: 'Léon Keijser'; moo...@li... Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices Hi, Great news indeed, however, isn't it more important to implement reliable failover solution and fix the single point of failure? So far there is no real working failover solution, not even Thomas Hatch's one. Its just that mfsmetalogger can't be trusted. Boyko On Apr 20, 2011, at 8:18 AM, Michal Borychowski wrote: >> I've got great news - we are going to introduce big improvements in upcoming 1.6.21 version which also include "rack awaraness" :) This is a feature lots of people were waiting for and I hope it will cater to your needs. > |
|
From: Boyko Y. <b.y...@ex...> - 2011-04-20 07:33:06
|
Yep, I can imagine it isn't that easy indeed. It does just works, and works well, until the mfsmaster goes down. Then its lottery.. if you're lucky, you'll get metadata successfully recovered. If not.. you're lost. I've been with Thomas implementing his solution on a few boxes for test purposes and it really looks promising, however not completely reliable yet. Hopefully he'll have the time to work it further. Boyko On Apr 20, 2011, at 9:59 AM, Michal Borychowski wrote: > Hi > > This is a difficult question. If preparing a failover solution had been that > easy, we would have done it already. And it is not. On the other hand we've > been using MooseFS for more than 5 years with this architecture in a very > busy production environment and it just works. Let Thomas finish his > failover solution :) I am sure it will satisfy the needs of all users. > > > Regards > Michal > > > -----Original Message----- > From: Boyko Yordanov [mailto:b.y...@ex...] > Sent: Wednesday, April 20, 2011 8:48 AM > To: Michal Borychowski > Cc: 'Léon Keijser'; moo...@li... > Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices > > Hi, > > Great news indeed, however, isn't it more important to implement reliable > failover solution and fix the single point of failure? > > So far there is no real working failover solution, not even Thomas Hatch's > one. Its just that mfsmetalogger can't be trusted. > > Boyko > > On Apr 20, 2011, at 8:18 AM, Michal Borychowski wrote: > >>> I've got great news - we are going to introduce big improvements in > upcoming 1.6.21 version which also include "rack awaraness" :) This is a > feature lots of people were waiting for and I hope it will cater to your > needs. >> |
|
From: Steve <st...@bo...> - 2011-04-18 13:15:46
|
Indeed!! "big improvements" sounds intriguing even though I think moosefs is already perfect!! -------Original Message------- From: Alexander Akhobadze Date: 18/04/2011 13:37:18 To: Michal Borychowski Cc: moo...@li... Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices WOW!!!! That is grate news!!! wbr Alexander ====================================================== Hi! I've got great news - we are going to introduce big improvements in upcoming 1.6.21 version which also include "rack awaraness" This is a feature lots of people were waiting for and I hope it will cater to your needs. PS. If you want to have chunkservers across different locations you still would have to have a very good connection between them. Kind regards Michał Borychowski MooseFS Support Manager _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ Gemius S.A. ul. Wołoska 7, 02-672 Warszawa Budynek MARS, klatka D Tel.: +4822 874-41-00 Fax : +4822 874-41-01 -----Original Message----- From: Steve [mailto:st...@bo...] Sent: Monday, April 18, 2011 1:45 PM To: moo...@li... Subject: [Moosefs-users] Fw: Re: chunkserver over several offices I will fwd to the list as your more detailed description may help someone chip in. I'm sure Michal will be along. I think what your asking is beyond the current scope of moose. Which is primarily designed be gemius for there in house use although some rack awareness has been discussed and maybe on the road map. Maybe search the list archive and/or moose website. -------Original Message------- From: Eric mourgaya Date: 18/04/2011 12:02:55 To: Steve Subject: Re: [Moosefs-users] chunkserver over several offices hi, In fact , we have 4 datacenters and I need for some partitions not all, at least one copie of these partition on each datacenter or a subset of these datacenters (at least 2). And for some datacenter the number of chunkserver is greater than 4 so I have to ensure that these chunks are not on the same datacenter. The goal is to ensure a recovery on another datacenter in crash case. Have you an idea to solve my problem with a distributed point of view? thanks 2011/4/18 Steve <st...@bo...> What are you trying to gain over having them in one place ? -------Original Message------- From: Eric mourgaya Date: 18/04/2011 09:40:09 To: moo...@li... Subject: [Moosefs-users] chunkserver over several offices Hi, How to ensure a least a copy of each chunk on servers dispatch on several offices. The solution is easy if we have one chunkserver on each office. How can I do this when some office have, for example, 5 chunkservers and other only one? thank for you help -- Eric Mourgaya, Respectons la planète! Luttons contre la médiocrité! ----------------------------------------------------------------------------- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users -- Eric Mourgaya, Respectons la planète! Luttons contre la médiocrité! ----------------------------------------------------------------------------- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users ----------------------------------------------------------------------------- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users ----------------------------------------------------------------------------- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
|
From: Léon K. <ke...@st...> - 2011-04-19 21:06:44
|
On Mon, 2011-04-18 at 12:02 +0000, Michal Borychowski wrote: > Hi! > > I've got great news - we are going to introduce big improvements in upcoming 1.6.21 version which also include "rack awaraness" :) This is a feature lots of people were waiting for and I hope it will cater to your needs. Hi Michal, This is great news indeed. When (approximately) do you think 1.6.21 will be released? Kind regards, Léon |
|
From: Michal B. <mic...@ge...> - 2011-04-20 05:19:16
|
I cannot give any fixed date. Probably it would be still in April, but I do not want to promise anything. It is being tested in our production environment now. Regards Michal -----Original Message----- From: Léon Keijser [mailto:ke...@st...] Sent: Tuesday, April 19, 2011 10:47 PM To: moo...@li... Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices On Mon, 2011-04-18 at 12:02 +0000, Michal Borychowski wrote: > Hi! > > I've got great news - we are going to introduce big improvements in upcoming 1.6.21 version which also include "rack awaraness" :) This is a feature lots of people were waiting for and I hope it will cater to your needs. Hi Michal, This is great news indeed. When (approximately) do you think 1.6.21 will be released? Kind regards, Léon ------------------------------------------------------------------------------ Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
|
From: Boyko Y. <b.y...@ex...> - 2011-04-20 06:48:07
|
Hi, Great news indeed, however, isn't it more important to implement reliable failover solution and fix the single point of failure? So far there is no real working failover solution, not even Thomas Hatch's one. Its just that mfsmetalogger can't be trusted. Boyko On Apr 20, 2011, at 8:18 AM, Michal Borychowski wrote: >> I've got great news - we are going to introduce big improvements in upcoming 1.6.21 version which also include "rack awaraness" :) This is a feature lots of people were waiting for and I hope it will cater to your needs. > |
|
From: Krzysztof J. - e. s. z o.o. <k.j...@ec...> - 2011-04-20 07:22:47
|
We have found failover solution for mfsserver. Our mfsserver is running on VMWare virtual machine, which is configured in Fault tolerance mode. This means that there are in fact two running virtual machines on two physical hosts. Primary VM and secondary VM are doing the same CPU operations. When primary VM fails, secondary takes over all tasks and everything is runnining fine without interruption or data loss. Best regards Krzysztof Janiszewski ecenter sp. z o.o. -------------------------------------- Domeny, hosting, poczta wideo :: http://www.ecenter.pl :: -----Original Message----- From: Boyko Yordanov [mailto:b.y...@ex...] Sent: Wednesday, April 20, 2011 8:48 AM To: Michal Borychowski Cc: moo...@li... Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices Hi, Great news indeed, however, isn't it more important to implement reliable failover solution and fix the single point of failure? So far there is no real working failover solution, not even Thomas Hatch's one. Its just that mfsmetalogger can't be trusted. Boyko On Apr 20, 2011, at 8:18 AM, Michal Borychowski wrote: >> I've got great news - we are going to introduce big improvements in upcoming 1.6.21 version which also include "rack awaraness" :) This is a feature lots of people were waiting for and I hope it will cater to your needs. > ---------------------------------------------------------------------------- -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
|
From: Michal B. <mic...@ge...> - 2011-04-20 07:29:17
|
Hi! The solution is very smart. In what environment have you done the tests? What operating systems (for the physical machine and virtual machine). How many files there were in MooseFS? How big was metadata file? How many clients connected? Was the whole MooseFS quite busy? What about performance of the master running in virtual machines? Kind regards -Michal -----Original Message----- From: Krzysztof Janiszewski - ecenter sp. z o.o. [mailto:k.j...@ec...] Sent: Wednesday, April 20, 2011 9:06 AM To: 'Boyko Yordanov' Cc: moo...@li... Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices We have found failover solution for mfsserver. Our mfsserver is running on VMWare virtual machine, which is configured in Fault tolerance mode. This means that there are in fact two running virtual machines on two physical hosts. Primary VM and secondary VM are doing the same CPU operations. When primary VM fails, secondary takes over all tasks and everything is runnining fine without interruption or data loss. Best regards Krzysztof Janiszewski ecenter sp. z o.o. -------------------------------------- Domeny, hosting, poczta wideo :: http://www.ecenter.pl :: -----Original Message----- From: Boyko Yordanov [mailto:b.y...@ex...] Sent: Wednesday, April 20, 2011 8:48 AM To: Michal Borychowski Cc: moo...@li... Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices Hi, Great news indeed, however, isn't it more important to implement reliable failover solution and fix the single point of failure? So far there is no real working failover solution, not even Thomas Hatch's one. Its just that mfsmetalogger can't be trusted. Boyko On Apr 20, 2011, at 8:18 AM, Michal Borychowski wrote: >> I've got great news - we are going to introduce big improvements in upcoming 1.6.21 version which also include "rack awaraness" :) This is a feature lots of people were waiting for and I hope it will cater to your needs. > ---------------------------------------------------------------------------- -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users ---------------------------------------------------------------------------- -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
|
From: Boyko Y. <b.y...@ex...> - 2011-04-20 07:57:32
|
Hi, Just want to add a question, As I'm not familiar w/ VMware's fault tolerance mode, is it possible to configure more than one 'backup' vm? E.g. having 2 or more backup copies of the same vm? Boyko On Apr 20, 2011, at 10:28 AM, Michal Borychowski wrote: > Hi! > > The solution is very smart. In what environment have you done the tests? > What operating systems (for the physical machine and virtual machine). How > many files there were in MooseFS? How big was metadata file? How many > clients connected? Was the whole MooseFS quite busy? What about performance > of the master running in virtual machines? > > > Kind regards > -Michal > > -----Original Message----- > From: Krzysztof Janiszewski - ecenter sp. z o.o. > [mailto:k.j...@ec...] > Sent: Wednesday, April 20, 2011 9:06 AM > To: 'Boyko Yordanov' > Cc: moo...@li... > Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices > > We have found failover solution for mfsserver. Our mfsserver is running on > VMWare virtual machine, which is configured in Fault tolerance mode. This > means that there are in fact two running virtual machines on two physical > hosts. Primary VM and secondary VM are doing the same CPU operations. When > primary VM fails, secondary takes over all tasks and everything is runnining > fine without interruption or data loss. > > Best regards > Krzysztof Janiszewski > ecenter sp. z o.o. > -------------------------------------- > Domeny, hosting, poczta wideo :: http://www.ecenter.pl :: > > > -----Original Message----- > From: Boyko Yordanov [mailto:b.y...@ex...] > Sent: Wednesday, April 20, 2011 8:48 AM > To: Michal Borychowski > Cc: moo...@li... > Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices > > Hi, > > Great news indeed, however, isn't it more important to implement reliable > failover solution and fix the single point of failure? > > So far there is no real working failover solution, not even Thomas Hatch's > one. Its just that mfsmetalogger can't be trusted. > > Boyko > > On Apr 20, 2011, at 8:18 AM, Michal Borychowski wrote: > >>> I've got great news - we are going to introduce big improvements in > upcoming 1.6.21 version which also include "rack awaraness" :) This is a > feature lots of people were waiting for and I hope it will cater to your > needs. >> > > > ---------------------------------------------------------------------------- > -- > Benefiting from Server Virtualization: Beyond Initial Workload Consolidation > -- Increasing the use of server virtualization is a top > priority.Virtualization can reduce costs, simplify management, and improve > application availability and disaster protection. Learn more about boosting > the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev > _______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users > > > ---------------------------------------------------------------------------- > -- > Benefiting from Server Virtualization: Beyond Initial Workload > Consolidation -- Increasing the use of server virtualization is a top > priority.Virtualization can reduce costs, simplify management, and improve > application availability and disaster protection. Learn more about boosting > the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev > _______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users > > > ------------------------------------------------------------------------------ > Benefiting from Server Virtualization: Beyond Initial Workload > Consolidation -- Increasing the use of server virtualization is a top > priority.Virtualization can reduce costs, simplify management, and improve > application availability and disaster protection. Learn more about boosting > the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev > _______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users > |
|
From: Krzysztof J. - e. s. z o.o. <k.j...@ec...> - 2011-04-20 08:03:53
|
Boyko, it is not possible to have more then one copy of virtual machine, but I think it is not necessary. When primary VM fails, secondary takes over everything and becomes primary. Then VMWare automatically creates new secondary VM on next available physical host. Best regards Krzysztof Janiszewski ecenter sp. z o.o. -------------------------------------- Domeny, hosting, poczta wideo :: http://www.ecenter.pl :: -----Original Message----- From: Boyko Yordanov [mailto:b.y...@ex...] Sent: Wednesday, April 20, 2011 9:57 AM To: Krzysztof Janiszewski - ecenter sp. z o.o. Cc: moo...@li...; Michal Borychowski Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices Hi, Just want to add a question, As I'm not familiar w/ VMware's fault tolerance mode, is it possible to configure more than one 'backup' vm? E.g. having 2 or more backup copies of the same vm? Boyko On Apr 20, 2011, at 10:28 AM, Michal Borychowski wrote: > Hi! > > The solution is very smart. In what environment have you done the tests? > What operating systems (for the physical machine and virtual machine). > How many files there were in MooseFS? How big was metadata file? How > many clients connected? Was the whole MooseFS quite busy? What about > performance of the master running in virtual machines? > > > Kind regards > -Michal > > -----Original Message----- > From: Krzysztof Janiszewski - ecenter sp. z o.o. > [mailto:k.j...@ec...] > Sent: Wednesday, April 20, 2011 9:06 AM > To: 'Boyko Yordanov' > Cc: moo...@li... > Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices > > We have found failover solution for mfsserver. Our mfsserver is > running on VMWare virtual machine, which is configured in Fault > tolerance mode. This means that there are in fact two running virtual > machines on two physical hosts. Primary VM and secondary VM are doing > the same CPU operations. When primary VM fails, secondary takes over > all tasks and everything is runnining fine without interruption or data loss. > > Best regards > Krzysztof Janiszewski > ecenter sp. z o.o. > -------------------------------------- > Domeny, hosting, poczta wideo :: http://www.ecenter.pl :: > > > -----Original Message----- > From: Boyko Yordanov [mailto:b.y...@ex...] > Sent: Wednesday, April 20, 2011 8:48 AM > To: Michal Borychowski > Cc: moo...@li... > Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices > > Hi, > > Great news indeed, however, isn't it more important to implement > reliable failover solution and fix the single point of failure? > > So far there is no real working failover solution, not even Thomas > Hatch's one. Its just that mfsmetalogger can't be trusted. > > Boyko > > On Apr 20, 2011, at 8:18 AM, Michal Borychowski wrote: > >>> I've got great news - we are going to introduce big improvements in > upcoming 1.6.21 version which also include "rack awaraness" :) This is > a feature lots of people were waiting for and I hope it will cater to > your needs. >> > > > ---------------------------------------------------------------------- > ------ > -- > Benefiting from Server Virtualization: Beyond Initial Workload > Consolidation > -- Increasing the use of server virtualization is a top > priority.Virtualization can reduce costs, simplify management, and > improve application availability and disaster protection. Learn more > about boosting the value of server virtualization. > http://p.sf.net/sfu/vmware-sfdev2dev > _______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users > > > ---------------------------------------------------------------------- > ------ > -- > Benefiting from Server Virtualization: Beyond Initial Workload > Consolidation -- Increasing the use of server virtualization is a top > priority.Virtualization can reduce costs, simplify management, and > improve application availability and disaster protection. Learn more > about boosting the value of server virtualization. > http://p.sf.net/sfu/vmware-sfdev2dev > _______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users > > > ---------------------------------------------------------------------- > -------- Benefiting from Server Virtualization: Beyond Initial > Workload Consolidation -- Increasing the use of server virtualization > is a top priority.Virtualization can reduce costs, simplify > management, and improve application availability and disaster > protection. Learn more about boosting the value of server > virtualization. http://p.sf.net/sfu/vmware-sfdev2dev > _______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users > |
|
From: Alexander A. <akh...@ri...> - 2011-04-20 09:09:59
|
Hi ALL! We also use MooseFS on virtual ESX4.1 environment and I can share my experience. Virtual machines are Open SuSE 2.6.34.7 On MooseFS we have around 1 000 000 fs objects # ls -l /moosefs/metadata/metadata.mfs.back -rw-r----- 1 mfs mfs 121913374 Apr 20 12:00 /moosefs/metadata/metadata.mfs.back 7 MFS-client connected (mfs is shared by Samba for Windows clients (including terminal server farm and Winsows XP stations) I had not any performance issues because of virtualization. But ... ESX is for money and MooseFS is for free ;--) wbr Alexander Akhobadze ====================================================== Hi! On physical hosts it is VMWare ESX4.1, on virtual machines it is Debian Squeeze. Test environment had 5 chunkservers (some older physical servers with one CPU Xeon, 1GB RAM, 1TB SATA drives, Debian Squeeze), mfsmaster and mfsmetalogger on virtual machines and 5 clients using MFS. W have not noticed any difficulties. Everything is connected with 1Gbps network. There wasn't many files in MFS environment, about 10k, 1TB of data. In one-two months we plan to move whole hosting enviroment (about 6TB of data, don't know number of files, but it is high :) ) to MFS and then I will be able to give you some more detailed performance info. >From my experience, there is no big impact on performance in virtual machines. We have virtualized about 30 servers last year, and I don't see any difference in performance between physical servers and virtual machines. Best regards Krzysztof Janiszewski ecenter sp. z o.o. -------------------------------------- Domeny, hosting, poczta wideo :: http://www.ecenter.pl :: Niniejsza wiadomość przekazana została Państwu przez ecenter sp z o.o. 87-100 Toruń, Ul. Goździkowa 2 Zarejestrowana w Sądzie Rejonowym w Toruniu VII Wydział Gospodarczy Krajowego Rejestru Sądowego pod numerem 0000251110 Z kapitałem zakładowym w wysokości 142500zł NIP 956-216-66-73 -----Original Message----- From: Michal Borychowski [mailto:mic...@ge...] Sent: Wednesday, April 20, 2011 9:29 AM To: 'Krzysztof Janiszewski - ecenter sp. z o.o.' Cc: moo...@li... Subject: RE: [Moosefs-users] Fw: Re: chunkserver over several offices Hi! The solution is very smart. In what environment have you done the tests? What operating systems (for the physical machine and virtual machine). How many files there were in MooseFS? How big was metadata file? How many clients connected? Was the whole MooseFS quite busy? What about performance of the master running in virtual machines? Kind regards -Michal -----Original Message----- From: Krzysztof Janiszewski - ecenter sp. z o.o. [mailto:k.j...@ec...] Sent: Wednesday, April 20, 2011 9:06 AM To: 'Boyko Yordanov' Cc: moo...@li... Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices We have found failover solution for mfsserver. Our mfsserver is running on VMWare virtual machine, which is configured in Fault tolerance mode. This means that there are in fact two running virtual machines on two physical hosts. Primary VM and secondary VM are doing the same CPU operations. When primary VM fails, secondary takes over all tasks and everything is runnining fine without interruption or data loss. Best regards Krzysztof Janiszewski ecenter sp. z o.o. -------------------------------------- Domeny, hosting, poczta wideo :: http://www.ecenter.pl :: -----Original Message----- From: Boyko Yordanov [mailto:b.y...@ex...] Sent: Wednesday, April 20, 2011 8:48 AM To: Michal Borychowski Cc: moo...@li... Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices Hi, Great news indeed, however, isn't it more important to implement reliable failover solution and fix the single point of failure? So far there is no real working failover solution, not even Thomas Hatch's one. Its just that mfsmetalogger can't be trusted. Boyko On Apr 20, 2011, at 8:18 AM, Michal Borychowski wrote: >> I've got great news - we are going to introduce big improvements in upcoming 1.6.21 version which also include "rack awaraness" :) This is a feature lots of people were waiting for and I hope it will cater to your needs. |
|
From: Fabien G. <fab...@gm...> - 2011-04-20 13:14:06
|
Hello, 2011/4/20 Alexander Akhobadze <akh...@ri...> > I had not any performance issues because of virtualization. > > But ... ESX is for money and MooseFS is for free ;--) > It seems you can use KVM/Xen + Kemari (see http://www.osrg.net/kemari/ and http://wiki.qemu.org/Features/FaultTolerance), and get the same kind of fault tolerance infrastructure... for free. If someone has ever tried, I'd be really happy to read about his experience... Fabien |
|
From: Alexander A. <akh...@ri...> - 2011-04-22 12:37:12
|
Thanks for link! It is interesting! But I found on that page: Failover must be kicked whenever a failure in the primary node is detected. Currently, we don't have automatic failover mechanism ... So, by now, in my opinion, this is not a case :--( wbr Alexander ====================================================== Hello, 2011/4/20 Alexander Akhobadze <akh...@ri...> I had not any performance issues because of virtualization. But ... ESX is for money and MooseFS is for free ;--) http://www.osrg.net/kemari/http://wiki.qemu.org/Features/FaultTolerance), and get the same kind of fault tolerance infrastructure... for free. If someone has ever tried, I'd be really happy to read about his experience... Fabien |
|
From: Thomas S H. <tha...@gm...> - 2011-04-20 15:27:10
|
Since my name came up while I was sleeping I will comment. My goal with mfs-failover (https://github.com/thatch45/mfs-failover) is to make is operate without the overhead of extra layers like vm level failover and drbd solutions. With that said, kudos to finding these solutions, I hope I can hammer out my solution soon. -Thomas S Hatch |
|
From: Krzysztof J. - e. s. z o.o. <k.j...@ec...> - 2011-04-20 08:00:46
|
Hi! On physical hosts it is VMWare ESX4.1, on virtual machines it is Debian Squeeze. Test environment had 5 chunkservers (some older physical servers with one CPU Xeon, 1GB RAM, 1TB SATA drives, Debian Squeeze), mfsmaster and mfsmetalogger on virtual machines and 5 clients using MFS. W have not noticed any difficulties. Everything is connected with 1Gbps network. There wasn't many files in MFS environment, about 10k, 1TB of data. In one-two months we plan to move whole hosting enviroment (about 6TB of data, don't know number of files, but it is high :) ) to MFS and then I will be able to give you some more detailed performance info. >From my experience, there is no big impact on performance in virtual machines. We have virtualized about 30 servers last year, and I don't see any difference in performance between physical servers and virtual machines. Best regards Krzysztof Janiszewski ecenter sp. z o.o. -------------------------------------- Domeny, hosting, poczta wideo :: http://www.ecenter.pl :: Niniejsza wiadomość przekazana została Państwu przez ecenter sp z o.o. 87-100 Toruń, Ul. Goździkowa 2 Zarejestrowana w Sądzie Rejonowym w Toruniu VII Wydział Gospodarczy Krajowego Rejestru Sądowego pod numerem 0000251110 Z kapitałem zakładowym w wysokości 142500zł NIP 956-216-66-73 -----Original Message----- From: Michal Borychowski [mailto:mic...@ge...] Sent: Wednesday, April 20, 2011 9:29 AM To: 'Krzysztof Janiszewski - ecenter sp. z o.o.' Cc: moo...@li... Subject: RE: [Moosefs-users] Fw: Re: chunkserver over several offices Hi! The solution is very smart. In what environment have you done the tests? What operating systems (for the physical machine and virtual machine). How many files there were in MooseFS? How big was metadata file? How many clients connected? Was the whole MooseFS quite busy? What about performance of the master running in virtual machines? Kind regards -Michal -----Original Message----- From: Krzysztof Janiszewski - ecenter sp. z o.o. [mailto:k.j...@ec...] Sent: Wednesday, April 20, 2011 9:06 AM To: 'Boyko Yordanov' Cc: moo...@li... Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices We have found failover solution for mfsserver. Our mfsserver is running on VMWare virtual machine, which is configured in Fault tolerance mode. This means that there are in fact two running virtual machines on two physical hosts. Primary VM and secondary VM are doing the same CPU operations. When primary VM fails, secondary takes over all tasks and everything is runnining fine without interruption or data loss. Best regards Krzysztof Janiszewski ecenter sp. z o.o. -------------------------------------- Domeny, hosting, poczta wideo :: http://www.ecenter.pl :: -----Original Message----- From: Boyko Yordanov [mailto:b.y...@ex...] Sent: Wednesday, April 20, 2011 8:48 AM To: Michal Borychowski Cc: moo...@li... Subject: Re: [Moosefs-users] Fw: Re: chunkserver over several offices Hi, Great news indeed, however, isn't it more important to implement reliable failover solution and fix the single point of failure? So far there is no real working failover solution, not even Thomas Hatch's one. Its just that mfsmetalogger can't be trusted. Boyko On Apr 20, 2011, at 8:18 AM, Michal Borychowski wrote: >> I've got great news - we are going to introduce big improvements in upcoming 1.6.21 version which also include "rack awaraness" :) This is a feature lots of people were waiting for and I hope it will cater to your needs. > ---------------------------------------------------------------------------- -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users ---------------------------------------------------------------------------- -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
×
Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.
Thanks for helping keep SourceForge clean.
X