Re: [Zookeeper-user] zookeeper vs. heartbeat messages

[Stefan G. <sg...@10...>]

Great! Thanks! That was basically what I was hoping to hear.

We just started a new sourceforge open source project named katta -  
that will server apache lucene shards using hadoop, zookeeper :) and  
of course lucene.

Thanks for the fast feedback.
Stefan


On Apr 22, 2008, at 2:46 PM, Ted Dunning wrote:
>
> I would definitely recommend zookeeper over heartbeat.  Here are my  
> reasons:
>
> A) it works.  Anything you implement using heartbeats will not work
> initially and you will (should) always worry about that implementation
> because it won't get as much testing.
>
> B) it works.  The use of ephemeral files is much easier than doing a  
> good
> heartbeat API.  In particular, heartbeat always implies some sort of
> fail-over which is trivial to implement well in zookeeper and very  
> hard to
> implement (correctly) by hand.
>
> C) it works.  Heartbeat architectures often lead logically to a  
> spiraling
> number of heartbeats being exchanged.  With zookeeper, your server  
> will be
> talking to zookeeper, and everybody else will have low latency  
> updates in
> case of a problem (if they want).
>
>
> Regarding the amount of data, I doubt you will have a problem if you  
> keep
> your zookeeper files reasonably sized.  There is an imposed limit of  
> 1MB,
> but would you be going anywhere near that?
>
> On 4/22/08 2:31 PM, "Stefan Groschupf" <sg...@10...> wrote:
>
>> Hi
>> I'm new to zookeeper and I work on a system that require classical
>> master - slave communication similar to hadoop dfs or hbase.
>> Though in my case the master need to know much faster if a slave
>> crashes than in other cases.
>> So I wonder if it would make sense instead of using classical
>> heartbeat messages in can use zookeeper.
>> Basically the master need to know if a new slave becomes available  
>> and
>> what kind of data it servers.
>>
>> Is there any limitations where the amount of data stored within
>> zookeeper becomes an issue?
>> Would you recommend to use zookeeper over heartbeat messages?
>>
>> Thanks for any hints.
>> Stefan
>>
>>
>> -------------------------------------------------------------------------
>> This SF.net email is sponsored by the 2008 JavaOne(SM) Conference
>> Don't miss this year's exciting event. There's still time to save  
>> $100.
>> Use priority code J8TL2D2.
>> http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone
>> _______________________________________________
>> Zookeeper-user mailing list
>> Zoo...@li...
>> https://lists.sourceforge.net/lists/listinfo/zookeeper-user
>
>

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
101tec Inc.
Menlo Park, California, USA
http://www.101tec.com