Re: [Postgres-xc-general] PG-XC node addition

[Koichi S. <koi...@gm...>]

Design discussion has not been made extensively.  I just gave my idea
to the developer personaly.   I'm planning to make more discussion
before posting to this ML.    It is not just simple and will take a
bit more (a week or so).

Regards;
----------
Koichi Suzuki


2012/9/6 Mason Sharp <ma...@st...>:
> On Thu, Sep 6, 2012 at 6:00 AM, Koichi Suzuki <koi...@gm...> wrote:
>> Thanks for the question.
>>
>> With XC-1.0.x, we cannot add a node at runtime.   This feature is
>> included in the current development and will be available with the
>> next major release.
>
> I may have missed emails discussing the design.  Can you please
> summarize the design?
>
> We could have GTM manage node membership. For example, a new candidate
> data node registers itself as available to GTM (we may want some kind
> of GTM authentication instead of merely connecting to the ip:port).
> ADD NODE is executed on one single coordinator, which validates
> against GTM, updates the status, adds it to the cluster and notifies
> the other Coordinators. There would no longer be any need for the
> manual DDL that is done now.
>
> This could be expanded in the future to help support multiple
> read-only replicas for read intensive workloads, where they are
> identified by distribution segment and registered in a similar
> fashion. (Instead of just node id, we use segment id, where a node can
> be associated with a segment, either as the primary or a read-only
> slave.)
>
>>
>> The safest way is to backup the whole database with pg_dump,
>> reinitialize all the nodes including the additional ones, configure
>> the cluster (CREATE NODE and ALTER NODE) and then restore the data
>> with pg_restore.   You may need to create each table in advance so
>> that it can be distributed/replicated among all the nodes.
>>
>> New feature of node addition will include:
>> 1) Create new coordinators and datanodes on new servers at runtime,
>> which copies all the necessary catalog such as role, database, etc.,
>> from existing components,
>> 2) Add them to the cluster,
>> 3) Reballance tables with new components.
>>
>> It's very helpful if you submit your requirement for this feature.
>>
>> Regards;
>> ----------
>> Koichi Suzuki
>>
>>
>> 2012/9/6 "Marco Güttler" <mar...@gm...>:
>>> Hey all,
>>>
>>> I have a question concerning node addition (coordinator and datanode) at runtime. Is it possible to add a node at runtime? If so, how to do node addition?
>>> If not so, what is an alternative way to add a coordinator and datanode?
>>>
>>> Thanks and regards
>>> Marco
>>>
>>> ------------------------------------------------------------------------------
>>> Live Security Virtual Conference
>>> Exclusive live event will cover all the ways today's security and
>>> threat landscape has changed and how IT managers can respond. Discussions
>>> will include endpoint security, mobile security and the latest in malware
>>> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
>>> _______________________________________________
>>> Postgres-xc-general mailing list
>>> Pos...@li...
>>> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>>
>> ------------------------------------------------------------------------------
>> Live Security Virtual Conference
>> Exclusive live event will cover all the ways today's security and
>> threat landscape has changed and how IT managers can respond. Discussions
>> will include endpoint security, mobile security and the latest in malware
>> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
>> _______________________________________________
>> Postgres-xc-general mailing list
>> Pos...@li...
>> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>
>
>
> --
> Mason Sharp
>
> StormDB - http://www.stormdb.com
> The Database Cloud