Thread: [Moosefs-users] How to make MFS replicate automatically?

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 422-6466

Dear MFS users,

How come my moosefs cannot replicate data automatically? Where to turn on this option?

Thank you.

Am 14.06.2011 02:20, schrieb Howie Chen:
> Dear MFS users,
>
> How come my moosefs cannot replicate data automatically? Where to turn on this option?
>
> Thank you.
> ------------------------------------------------------------------------------
> EditLive Enterprise is the world's most technically advanced content
> authoring tool. Experience the power of Track Changes, Inline Image
> Editing and ensure content is compliant with Accessibility Checking.
> http://p.sf.net/sfu/ephox-dev2dev
> _______________________________________________
> moosefs-users mailing list
> moo...@li...
> https://lists.sourceforge.net/lists/listinfo/moosefs-users

Did you set the goal to your files / direcotry?

Check with "mfsgetgoal directory/filename" if it is set to 1 you have
to do "mfssetgoal 2 directory/filename"  <-- change to your needs.

More information with  "man mfssetgoal"

If mfsgetgoal shows a number greater than 1  then there is an error / 
bug an we need more information ;)

Regards,

Chris
-- 
Vorstand/Board of Management:
Dr. Bernd Finkbeiner, Dr. Roland Niemeier, 
Dr. Arno Steitz, Dr. Ingrid Zech
Vorsitzender des Aufsichtsrats/
Chairman of the Supervisory Board:
Philippe Miltin
Sitz/Registered Office: Tuebingen
Registergericht/Registration Court: Stuttgart
Registernummer/Commercial Register No.: HRB 382196 

On Mon, 13 Jun 2011 17:20:39 -0700
Howie Chen <ho...@he...> wrote:

> Dear MFS users,
Hello,
> 
> How come my moosefs cannot replicate data automatically? Where to turn on this option?
Either you're joking, or you forgot to set goal >1 (mfssetgoal), or you
didn't wait enough once goal has been set ? It can take a couple
minutes.
Oh, and if you have a single chunkserver, a goal >1 isn't taken care
of, because it has absolutely no use.
Hope it helps,
-- 
Laurent Wandrebeck
HYGEOS, Earth Observation Department / Observation de la Terre
Euratechnologies
165 Avenue de Bretagne
59000 Lille, France
tel: +33 3 20 08 24 98
http://www.hygeos.com
GPG fingerprint/Empreinte GPG: F5CA 37A4 6D03 A90C 7A1D  2A62 54E6 EF2C
D17C F64C

I have a sense that this question is due to confusing drives and chunkservers.  MFS only replicates across chunkservers.  So, if you have multiple drives attached to a single chunkserver, MFS wont replicate inside of the chunkserver.

this brings up my question - can one safely run multiple chunkserver processes on a single machine?

max

On Jun 14, 2011, at 4:26 PM, Laurent Wandrebeck wrote:

> On Mon, 13 Jun 2011 17:20:39 -0700
> Howie Chen <ho...@he...> wrote:
> 
>> Dear MFS users,
> Hello,
>> 
>> How come my moosefs cannot replicate data automatically? Where to turn on this option?
> Either you're joking, or you forgot to set goal >1 (mfssetgoal), or you
> didn't wait enough once goal has been set ? It can take a couple
> minutes.
> Oh, and if you have a single chunkserver, a goal >1 isn't taken care
> of, because it has absolutely no use.
> Hope it helps,
> -- 
> Laurent Wandrebeck
> HYGEOS, Earth Observation Department / Observation de la Terre
> Euratechnologies
> 165 Avenue de Bretagne
> 59000 Lille, France
> tel: +33 3 20 08 24 98
> http://www.hygeos.com
> GPG fingerprint/Empreinte GPG: F5CA 37A4 6D03 A90C 7A1D  2A62 54E6 EF2C
> D17C F64C
> ------------------------------------------------------------------------------
> EditLive Enterprise is the world's most technically advanced content
> authoring tool. Experience the power of Track Changes, Inline Image
> Editing and ensure content is compliant with Accessibility Checking.
> http://p.sf.net/sfu/ephox-dev2dev_______________________________________________
> moosefs-users mailing list
> moo...@li...
> https://lists.sourceforge.net/lists/listinfo/moosefs-users

On Wed, 29 Jun 2011 16:07:49 +0800
Max Cantor <mxc...@gm...> wrote:

> I have a sense that this question is due to confusing drives and chunkservers.  MFS only replicates across chunkservers.  So, if you have multiple drives attached to a single chunkserver, MFS wont replicate inside of the chunkserver.
Agreed.
> 
> this brings up my question - can one safely run multiple chunkserver processes on a single machine?
> 
> max
Provided you take care of port numbers, and partitions used by
different CS processes yes. But you lose fault tolerance. A failing box
will take down several CS…which is pretty bad. You definitely don't
want to do that :)
HTH,
-- 
Laurent Wandrebeck
HYGEOS, Earth Observation Department / Observation de la Terre
Euratechnologies
165 Avenue de Bretagne
59000 Lille, France
tel: +33 3 20 08 24 98
http://www.hygeos.com
GPG fingerprint/Empreinte GPG: F5CA 37A4 6D03 A90C 7A1D  2A62 54E6 EF2C
D17C F64C

I think you can use raid technology to protect drives failed on one 
chunkserver.

> I have a sense that this question is due to confusing drives and chunkservers.  MFS only replicates across chunkservers.  So, if you have multiple drives attached to a single chunkserver, MFS wont replicate inside of the chunkserver.
>
> this brings up my question - can one safely run multiple chunkserver processes on a single machine?
>
> max
>
> On Jun 14, 2011, at 4:26 PM, Laurent Wandrebeck wrote:
>
>> On Mon, 13 Jun 2011 17:20:39 -0700
>> Howie Chen<ho...@he...>  wrote:
>>
>>> Dear MFS users,
>> Hello,
>>>
>>> How come my moosefs cannot replicate data automatically? Where to turn on this option?
>> Either you're joking, or you forgot to set goal>1 (mfssetgoal), or you
>> didn't wait enough once goal has been set ? It can take a couple
>> minutes.
>> Oh, and if you have a single chunkserver, a goal>1 isn't taken care
>> of, because it has absolutely no use.
>> Hope it helps,
>> --
>> Laurent Wandrebeck
>> HYGEOS, Earth Observation Department / Observation de la Terre
>> Euratechnologies
>> 165 Avenue de Bretagne
>> 59000 Lille, France
>> tel: +33 3 20 08 24 98
>> http://www.hygeos.com
>> GPG fingerprint/Empreinte GPG: F5CA 37A4 6D03 A90C 7A1D  2A62 54E6 EF2C
>> D17C F64C
>> ------------------------------------------------------------------------------
>> EditLive Enterprise is the world's most technically advanced content
>> authoring tool. Experience the power of Track Changes, Inline Image
>> Editing and ensure content is compliant with Accessibility Checking.
>> http://p.sf.net/sfu/ephox-dev2dev_______________________________________________
>> moosefs-users mailing list
>> moo...@li...
>> https://lists.sourceforge.net/lists/listinfo/moosefs-users
>
>
> ------------------------------------------------------------------------------
> All of the data generated in your IT infrastructure is seriously valuable.
> Why? It contains a definitive record of application performance, security
> threats, fraudulent activity, and more. Splunk takes this data and makes
> sense of it. IT sense. And common sense.
> http://p.sf.net/sfu/splunk-d2d-c2
> _______________________________________________
> moosefs-users mailing list
> moo...@li...
> https://lists.sourceforge.net/lists/listinfo/moosefs-users

El Miércoles 29 Junio 2011, youngcow escribió:
> I think you can use raid technology to protect drives failed on one
> chunkserver.

Yes, but as Laurent said you (still) loose fault tolerance.

Disks aren't the only components that can fail, you also have to take 
consideration power supply, memory, processor, motherboard, etc.

So I guess it depends on how critical the data you put in mfs is, or as I read 
some time ago:

"<Dr_Memory> or to put it another way: your kitten photos do not need the same 
high-availabity system infrastructure as Citibank's transaction databases :)

<topaz> I CAN HAS FIEV NIENS?"

:)

> > I have a sense that this question is due to confusing drives and
> > chunkservers.  MFS only replicates across chunkservers.  So, if you have
> > multiple drives attached to a single chunkserver, MFS wont replicate
> > inside of the chunkserver.
> >
> > this brings up my question - can one safely run multiple chunkserver
> > processes on a single machine?
> >
> > max

Cheers,
-- 
Ricardo J. Barberis
Senior SysAdmin / ITI
Dattatec.com :: Soluciones de Web Hosting
Tu Hosting hecho Simple!

Thread: [Moosefs-users] How to make MFS replicate automatically?

Fault tolerant, POSIX-compliant, Net Distributed Storage / File System

moosefs-users