Thread: [Postgres-xc-general] Any Virtual Box images to test postgres-xc?

Brought to you by: ahsanhadi, amitdkhan, ashutoshbapat, gabbasb, and 3 others

postgres-xc-general

[Postgres-xc-general] Any Virtual Box images to test postgres-xc?

From: Benjamin H. <bh...@ud...> - 2012-07-27 08:42:25

Hi,

Does anybody has Virtual Box images to test postgres-xc out of the box?

On the Getting Started page, there is:

"Although you can install Postgres-XC cluster in single Linux
operating system, we advise you to install on multiple Linux virtual
machines using Virtual Box or VMWare. The number of virtual machines
depends on the Postgres-XC configuration. Please take a look at
configuration section in this page."

If nobody has some, I could spend some time on make some Vbox images.

Best,

-- 
Benjamin Henrion <bhenrion at ffii.org>
FFII Brussels - +32-484-566109 - +32-2-3500762
"In July 2005, after several failed attempts to legalise software
patents in Europe, the patent establishment changed its strategy.
Instead of explicitly seeking to sanction the patentability of
software, they are now seeking to create a central European patent
court, which would establish and enforce patentability rules in their
favor, without any possibility of correction by competing courts or
democratically elected legislators."

Re: [Postgres-xc-general] Any Virtual Box images to test postgres-xc?

From: Michael P. <mic...@gm...> - 2012-07-27 09:08:47

On 2012/07/27, at 17:42, Benjamin Henrion <bh...@ud...> wrote:

> Hi,
> 
> Does anybody has Virtual Box images to test postgres-xc out of the box?
I don't have any images of vbox with xc preinstalled on it, sorry.
Somebody here perhaps?
> 
> On the Getting Started page, there is:
> 
> "Although you can install Postgres-XC cluster in single Linux
> operating system, we advise you to install on multiple Linux virtual
> machines using Virtual Box or VMWare. The number of virtual machines
> depends on the Postgres-XC configuration. Please take a look at
> configuration section in this page."
> 
> If nobody has some, I could spend some time on make some Vbox images.
Why not. It would be helpful for everybody for sure.

Thanks,

Michael
> 
> Best,
> 
> -- 
> Benjamin Henrion <bhenrion at ffii.org>
> FFII Brussels - +32-484-566109 - +32-2-3500762
> "In July 2005, after several failed attempts to legalise software
> patents in Europe, the patent establishment changed its strategy.
> Instead of explicitly seeking to sanction the patentability of
> software, they are now seeking to create a central European patent
> court, which would establish and enforce patentability rules in their
> favor, without any possibility of correction by competing courts or
> democratically elected legislators."
> 
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and 
> threat landscape has changed and how IT managers can respond. Discussions 
> will include endpoint security, mobile security and the latest in malware 
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> _______________________________________________
> Postgres-xc-general mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general

Re: [Postgres-xc-general] Any Virtual Box images to test postgres-xc?

From: Joshua D. D. <jd...@co...> - 2012-07-27 16:09:57

Hello,

That would be very helpful. Thank you for offering.

Sincerely,

jD

Re: [Postgres-xc-general] Any Virtual Box images to test postgres-xc?

From: Benjamin H. <bh...@ud...> - 2012-08-01 13:28:24

On Fri, Jul 27, 2012 at 6:09 PM, Joshua D. Drake <jd...@co...> wrote:
>
> Hello,
>
> That would be very helpful. Thank you for offering.

I just installed postgres-xc debian package that's available in SID in
an openvz container, now I have this stuff running:

========================================================================
root@sid /var/lib/postgres-xc [13]# ps aux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0  10588   852 ?        Ss   15:20   0:00 init [2]
root       911  0.0  0.0  52584  1624 ?        Sl   15:20   0:00
/usr/sbin/rsyslogd -c5
root       922  0.0  0.0  18816   852 ?        Ss   15:20   0:00 /usr/sbin/cron
root       929  0.0  0.0  18644   624 ?        Ss   15:20   0:00 vzctl: pts/0
root       930  0.0  0.0  17788  2008 pts/0    Ss   15:20   0:00 -bash
101       8083  0.3  0.1 101552  9140 ?        S    15:24   0:00
/usr/bin/postgres -C -D /var/lib/postgres-xc/coord
101       8093  0.0  0.0 101536  1608 ?        Ss   15:24   0:00
postgres: pooler process
101       8094  0.0  0.0 101536  1984 ?        Ss   15:24   0:00
postgres: writer process
101       8095  0.0  0.0 101536  1812 ?        Ss   15:24   0:00
postgres: wal writer process
101       8096  0.0  0.0 102416  3232 ?        Ss   15:24   0:00
postgres: autovacuum launcher process
101       8097  0.0  0.0  69496  1700 ?        Ss   15:24   0:00
postgres: stats collector process
101       8127  0.3  0.1 101552  9140 ?        S    15:24   0:00
/usr/bin/postgres -X -D /var/lib/postgres-xc/datanode1
101       8135  0.0  0.0 101536  1988 ?        Ss   15:24   0:00
postgres: writer process
101       8136  0.0  0.0 101536  1784 ?        Ss   15:24   0:00
postgres: wal writer process
101       8137  0.0  0.0 102284  2776 ?        Ss   15:24   0:00
postgres: autovacuum launcher process
101       8138  0.0  0.0  69496  1636 ?        Ss   15:24   0:00
postgres: stats collector process
101       8145  0.3  0.1 101552  9136 ?        S    15:24   0:00
/usr/bin/postgres -X -D /var/lib/postgres-xc/datanode2
101       8153  0.0  0.0 101536  1984 ?        Ss   15:24   0:00
postgres: writer process
101       8154  0.0  0.0 101536  1780 ?        Ss   15:24   0:00
postgres: wal writer process
101       8155  0.0  0.0 102284  2772 ?        Ss   15:24   0:00
postgres: autovacuum launcher process
101       8156  0.0  0.0  69496  1632 ?        Ss   15:24   0:00
postgres: stats collector process
root      8781  0.0  0.0  17784  1984 pts/0    S    15:27   0:00 bash
root      8792  0.0  0.0  15236  1136 pts/0    R+   15:29   0:00 ps aux
root@sid /var/lib/postgres-xc [14]#
========================================================================

If anybody is interested in a copy of the openvz container (basically
a rootfs), let me know, I will push it somewhere.

>From the debian package, how do I configure another box so that the
two databases are in master-master mode?

Best,

--
Benjamin Henrion <bhenrion at ffii.org>
FFII Brussels - +32-484-566109 - +32-2-3500762
"In July 2005, after several failed attempts to legalise software
patents in Europe, the patent establishment changed its strategy.
Instead of explicitly seeking to sanction the patentability of
software, they are now seeking to create a central European patent
court, which would establish and enforce patentability rules in their
favor, without any possibility of correction by competing courts or
democratically elected legislators."

Re: [Postgres-xc-general] Any Virtual Box images to test postgres-xc?

From: Michael P. <mic...@gm...> - 2012-08-01 13:31:12

On 2012/08/01, at 22:28, Benjamin Henrion <bh...@ud...> wrote:

> On Fri, Jul 27, 2012 at 6:09 PM, Joshua D. Drake <jd...@co...> wrote:
>> 
>> Hello,
>> 
>> That would be very helpful. Thank you for offering.
> 
> I just installed postgres-xc debian package that's available in SID in
> an openvz container, now I have this stuff running:
> 
> ========================================================================
> root@sid /var/lib/postgres-xc [13]# ps aux
> USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
> root         1  0.0  0.0  10588   852 ?        Ss   15:20   0:00 init [2]
> root       911  0.0  0.0  52584  1624 ?        Sl   15:20   0:00
> /usr/sbin/rsyslogd -c5
> root       922  0.0  0.0  18816   852 ?        Ss   15:20   0:00 /usr/sbin/cron
> root       929  0.0  0.0  18644   624 ?        Ss   15:20   0:00 vzctl: pts/0
> root       930  0.0  0.0  17788  2008 pts/0    Ss   15:20   0:00 -bash
> 101       8083  0.3  0.1 101552  9140 ?        S    15:24   0:00
> /usr/bin/postgres -C -D /var/lib/postgres-xc/coord
> 101       8093  0.0  0.0 101536  1608 ?        Ss   15:24   0:00
> postgres: pooler process
> 101       8094  0.0  0.0 101536  1984 ?        Ss   15:24   0:00
> postgres: writer process
> 101       8095  0.0  0.0 101536  1812 ?        Ss   15:24   0:00
> postgres: wal writer process
> 101       8096  0.0  0.0 102416  3232 ?        Ss   15:24   0:00
> postgres: autovacuum launcher process
> 101       8097  0.0  0.0  69496  1700 ?        Ss   15:24   0:00
> postgres: stats collector process
> 101       8127  0.3  0.1 101552  9140 ?        S    15:24   0:00
> /usr/bin/postgres -X -D /var/lib/postgres-xc/datanode1
> 101       8135  0.0  0.0 101536  1988 ?        Ss   15:24   0:00
> postgres: writer process
> 101       8136  0.0  0.0 101536  1784 ?        Ss   15:24   0:00
> postgres: wal writer process
> 101       8137  0.0  0.0 102284  2776 ?        Ss   15:24   0:00
> postgres: autovacuum launcher process
> 101       8138  0.0  0.0  69496  1636 ?        Ss   15:24   0:00
> postgres: stats collector process
> 101       8145  0.3  0.1 101552  9136 ?        S    15:24   0:00
> /usr/bin/postgres -X -D /var/lib/postgres-xc/datanode2
> 101       8153  0.0  0.0 101536  1984 ?        Ss   15:24   0:00
> postgres: writer process
> 101       8154  0.0  0.0 101536  1780 ?        Ss   15:24   0:00
> postgres: wal writer process
> 101       8155  0.0  0.0 102284  2772 ?        Ss   15:24   0:00
> postgres: autovacuum launcher process
> 101       8156  0.0  0.0  69496  1632 ?        Ss   15:24   0:00
> postgres: stats collector process
> root      8781  0.0  0.0  17784  1984 pts/0    S    15:27   0:00 bash
> root      8792  0.0  0.0  15236  1136 pts/0    R+   15:29   0:00 ps aux
> root@sid /var/lib/postgres-xc [14]#
> ========================================================================
> 
> If anybody is interested in a copy of the openvz container (basically
> a rootfs), let me know, I will push it somewhere.
That would be cool!
> 
> From the debian package, how do I configure another box so that the
> two databases are in master-master mode?
I am sure Vladimir knows about that, I am not using the Debian packages at all.

Thanks, 
Michael
> 
> Best,
> 
> --
> Benjamin Henrion <bhenrion at ffii.org>
> FFII Brussels - +32-484-566109 - +32-2-3500762
> "In July 2005, after several failed attempts to legalise software
> patents in Europe, the patent establishment changed its strategy.
> Instead of explicitly seeking to sanction the patentability of
> software, they are now seeking to create a central European patent
> court, which would establish and enforce patentability rules in their
> favor, without any possibility of correction by competing courts or
> democratically elected legislators."

Re: [Postgres-xc-general] Any Virtual Box images to test postgres-xc?

From: Benjamin H. <bh...@ud...> - 2012-08-01 13:52:45

On Wed, Aug 1, 2012 at 3:31 PM, Michael Paquier
<mic...@gm...> wrote:
>
> On 2012/08/01, at 22:28, Benjamin Henrion <bh...@ud...> wrote:
>
>> On Fri, Jul 27, 2012 at 6:09 PM, Joshua D. Drake <jd...@co...> wrote:
>>>
>>> Hello,
>>>
>>> That would be very helpful. Thank you for offering.
>>
>> I just installed postgres-xc debian package that's available in SID in
>> an openvz container, now I have this stuff running:
>>
>> ========================================================================
>> root@sid /var/lib/postgres-xc [13]# ps aux
>> USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
>> root         1  0.0  0.0  10588   852 ?        Ss   15:20   0:00 init [2]
>> root       911  0.0  0.0  52584  1624 ?        Sl   15:20   0:00
>> /usr/sbin/rsyslogd -c5
>> root       922  0.0  0.0  18816   852 ?        Ss   15:20   0:00 /usr/sbin/cron
>> root       929  0.0  0.0  18644   624 ?        Ss   15:20   0:00 vzctl: pts/0
>> root       930  0.0  0.0  17788  2008 pts/0    Ss   15:20   0:00 -bash
>> 101       8083  0.3  0.1 101552  9140 ?        S    15:24   0:00
>> /usr/bin/postgres -C -D /var/lib/postgres-xc/coord
>> 101       8093  0.0  0.0 101536  1608 ?        Ss   15:24   0:00
>> postgres: pooler process
>> 101       8094  0.0  0.0 101536  1984 ?        Ss   15:24   0:00
>> postgres: writer process
>> 101       8095  0.0  0.0 101536  1812 ?        Ss   15:24   0:00
>> postgres: wal writer process
>> 101       8096  0.0  0.0 102416  3232 ?        Ss   15:24   0:00
>> postgres: autovacuum launcher process
>> 101       8097  0.0  0.0  69496  1700 ?        Ss   15:24   0:00
>> postgres: stats collector process
>> 101       8127  0.3  0.1 101552  9140 ?        S    15:24   0:00
>> /usr/bin/postgres -X -D /var/lib/postgres-xc/datanode1
>> 101       8135  0.0  0.0 101536  1988 ?        Ss   15:24   0:00
>> postgres: writer process
>> 101       8136  0.0  0.0 101536  1784 ?        Ss   15:24   0:00
>> postgres: wal writer process
>> 101       8137  0.0  0.0 102284  2776 ?        Ss   15:24   0:00
>> postgres: autovacuum launcher process
>> 101       8138  0.0  0.0  69496  1636 ?        Ss   15:24   0:00
>> postgres: stats collector process
>> 101       8145  0.3  0.1 101552  9136 ?        S    15:24   0:00
>> /usr/bin/postgres -X -D /var/lib/postgres-xc/datanode2
>> 101       8153  0.0  0.0 101536  1984 ?        Ss   15:24   0:00
>> postgres: writer process
>> 101       8154  0.0  0.0 101536  1780 ?        Ss   15:24   0:00
>> postgres: wal writer process
>> 101       8155  0.0  0.0 102284  2772 ?        Ss   15:24   0:00
>> postgres: autovacuum launcher process
>> 101       8156  0.0  0.0  69496  1632 ?        Ss   15:24   0:00
>> postgres: stats collector process
>> root      8781  0.0  0.0  17784  1984 pts/0    S    15:27   0:00 bash
>> root      8792  0.0  0.0  15236  1136 pts/0    R+   15:29   0:00 ps aux
>> root@sid /var/lib/postgres-xc [14]#
>> ========================================================================
>>
>> If anybody is interested in a copy of the openvz container (basically
>> a rootfs), let me know, I will push it somewhere.
> That would be cool!
>>
>> From the debian package, how do I configure another box so that the
>> two databases are in master-master mode?
> I am sure Vladimir knows about that, I am not using the Debian packages at all.

Basically I end up with the following setup:

http://michael.otacoo.com/postgresql-2/start-a-postgres-xc-cluster-in-more-or-less-10-commands/

Now I do not understand how master-master can work since the
coordinator is still a SPOF.

--
Benjamin Henrion <bhenrion at ffii.org>
FFII Brussels - +32-484-566109 - +32-2-3500762
"In July 2005, after several failed attempts to legalise software
patents in Europe, the patent establishment changed its strategy.
Instead of explicitly seeking to sanction the patentability of
software, they are now seeking to create a central European patent
court, which would establish and enforce patentability rules in their
favor, without any possibility of correction by competing courts or
democratically elected legislators."

Re: [Postgres-xc-general] Any Virtual Box images to test postgres-xc?

From: Michael P. <mic...@gm...> - 2012-08-01 23:49:35

On Wed, Aug 1, 2012 at 10:52 PM, Benjamin Henrion <bh...@ud...> wrote:

> On Wed, Aug 1, 2012 at 3:31 PM, Michael Paquier
> <mic...@gm...> wrote:
> >
> > On 2012/08/01, at 22:28, Benjamin Henrion <bh...@ud...> wrote:
> >
> >> On Fri, Jul 27, 2012 at 6:09 PM, Joshua D. Drake <jd...@co...>
> wrote:
> >>>
> >>> Hello,
> >>>
> >>> That would be very helpful. Thank you for offering.
> >>
> >> I just installed postgres-xc debian package that's available in SID in
> >> an openvz container, now I have this stuff running:
> >>
> >> ========================================================================
> >> root@sid /var/lib/postgres-xc [13]# ps aux
> >> USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
> >> root         1  0.0  0.0  10588   852 ?        Ss   15:20   0:00 init
> [2]
> >> root       911  0.0  0.0  52584  1624 ?        Sl   15:20   0:00
> >> /usr/sbin/rsyslogd -c5
> >> root       922  0.0  0.0  18816   852 ?        Ss   15:20   0:00
> /usr/sbin/cron
> >> root       929  0.0  0.0  18644   624 ?        Ss   15:20   0:00 vzctl:
> pts/0
> >> root       930  0.0  0.0  17788  2008 pts/0    Ss   15:20   0:00 -bash
> >> 101       8083  0.3  0.1 101552  9140 ?        S    15:24   0:00
> >> /usr/bin/postgres -C -D /var/lib/postgres-xc/coord
> >> 101       8093  0.0  0.0 101536  1608 ?        Ss   15:24   0:00
> >> postgres: pooler process
> >> 101       8094  0.0  0.0 101536  1984 ?        Ss   15:24   0:00
> >> postgres: writer process
> >> 101       8095  0.0  0.0 101536  1812 ?        Ss   15:24   0:00
> >> postgres: wal writer process
> >> 101       8096  0.0  0.0 102416  3232 ?        Ss   15:24   0:00
> >> postgres: autovacuum launcher process
> >> 101       8097  0.0  0.0  69496  1700 ?        Ss   15:24   0:00
> >> postgres: stats collector process
> >> 101       8127  0.3  0.1 101552  9140 ?        S    15:24   0:00
> >> /usr/bin/postgres -X -D /var/lib/postgres-xc/datanode1
> >> 101       8135  0.0  0.0 101536  1988 ?        Ss   15:24   0:00
> >> postgres: writer process
> >> 101       8136  0.0  0.0 101536  1784 ?        Ss   15:24   0:00
> >> postgres: wal writer process
> >> 101       8137  0.0  0.0 102284  2776 ?        Ss   15:24   0:00
> >> postgres: autovacuum launcher process
> >> 101       8138  0.0  0.0  69496  1636 ?        Ss   15:24   0:00
> >> postgres: stats collector process
> >> 101       8145  0.3  0.1 101552  9136 ?        S    15:24   0:00
> >> /usr/bin/postgres -X -D /var/lib/postgres-xc/datanode2
> >> 101       8153  0.0  0.0 101536  1984 ?        Ss   15:24   0:00
> >> postgres: writer process
> >> 101       8154  0.0  0.0 101536  1780 ?        Ss   15:24   0:00
> >> postgres: wal writer process
> >> 101       8155  0.0  0.0 102284  2772 ?        Ss   15:24   0:00
> >> postgres: autovacuum launcher process
> >> 101       8156  0.0  0.0  69496  1632 ?        Ss   15:24   0:00
> >> postgres: stats collector process
> >> root      8781  0.0  0.0  17784  1984 pts/0    S    15:27   0:00 bash
> >> root      8792  0.0  0.0  15236  1136 pts/0    R+   15:29   0:00 ps aux
> >> root@sid /var/lib/postgres-xc [14]#
> >> ========================================================================
> >>
> >> If anybody is interested in a copy of the openvz container (basically
> >> a rootfs), let me know, I will push it somewhere.
> > That would be cool!
> >>
> >> From the debian package, how do I configure another box so that the
> >> two databases are in master-master mode?
> > I am sure Vladimir knows about that, I am not using the Debian packages
> at all.
>
> Basically I end up with the following setup:
>
>
> http://michael.otacoo.com/postgresql-2/start-a-postgres-xc-cluster-in-more-or-less-10-commands/
>
> Now I do not understand how master-master can work since the
> coordinator is still a SPOF.
>
OK. I have never used the debian packages so I thought that it installed a
small cluster for you automatically like what we can see for postgres on
ubuntu for example.

When you want to create a cluster with multiple Coordinators, the setting
is the same, except that when registering nodes on Coordinators you need to
do it for each Coordinator, and you need to register on each Coordinator
all the other Coordinators.
For example, for a 2Coordinator/2Datanode cluster on the same server
1) Initialize:
cd $HOME/pgsql
initgtm -Z gtm -D gtm # Initialize GTM
initdb -D datanode1 --nodename dn1 # Initialize Datanode 1
initdb -D datanode2 --nodename dn2 # Initialize Datanode 2
initdb -D coord1 --nodename co1 # Initialize Coordinator 1
initdb -D coord2 --nodename co2 # Initialize Coordinator 2
2) Change the port numbers if necessary...
3) start-up
gtm -D gtm & # Start-up GTM
postgres -X -D datanode1 -i & # Start Datanode 1
postgres -X -D datanode2 -i & # Start Datanode 2
postgres -C -D coord1 -i & # Start Coordinator 1
postgres -C -D coord2 -i & # Start Coordinator 2
4) Define all the nodes on Coordinator 1 and update pooler cache.
psql -p $CO1_PORT -c "CREATE NODE dn1 WITH (TYPE='datanode', PORT=$DN1_PORT)"
postgres #define dn1
psql -p $CO1_PORT -c "CREATE NODE dn2 WITH (TYPE='datanode', PORT=$DN2_PORT)"
postgres #define dn2
psql -p $CO1_PORT -c "CREATE NODE co2 WITH (TYPE='coordinator',
PORT=$CO2_PORT)" postgres #define co2
psql -p $CO1_PORT -c "SELECT pgxc_pool_reload()" postgres
5) Define all the nodes on Coordinator 2 and update pooler cache
psql -p $CO2_PORT -c "CREATE NODE dn1 WITH (TYPE='datanode', PORT=$DN1_PORT)"
postgres #define dn1
psql -p $CO2_PORT -c "CREATE NODE dn2 WITH (TYPE='datanode', PORT=$DN2_PORT)"
postgres #define dn2
psql -p $CO2_PORT -c "CREATE NODE co1 WITH (TYPE='coordinator',
PORT=$CO1_PORT)" postgres #define co1
psql -p $CO2_PORT -c "SELECT pgxc_pool_reload()" postgres

So simply you need to register on each Coordinator all the other nodes of
your cluster.
-- 
Michael Paquier
http://michael.otacoo.com