Menu
▾
▴
#2773 makedns -n will hang after inital install for xcat on aix
When i finish installing xcat on aix initially,i have set up all xcat table properly and modify /etc/resolv.conf and /etc/hosts, then running "makedns -n" several times, the following different error messages would occur:
Apr 12 02:45:11 hv32s38p16 local4:info xCAT: xCAT: Allowing makedns -n for root from loopback
Apr 12 02:45:11 hv32s38p16 daemon:notice named[5636116]: starting BIND 9.4.1
Apr 12 02:45:11 hv32s38p16 daemon:info named[5636116]: found 4 CPUs, using 4 worker threads
Apr 12 02:45:11 hv32s38p16 daemon:info named[5636116]: loading configuration from '/etc/named.conf'
Apr 12 02:45:11 hv32s38p16 daemon:info named[5636116]: listening on IPv4 interface en1, 9.114.154.123#53
Apr 12 02:45:11 hv32s38p16 daemon:err|error named[5636116]: interfacemgr.c:290: unexpected error:
Apr 12 02:45:11 hv32s38p16 daemon:err|error named[5636116]: UDP ns_clientmgr_createclients(): shutting down
Apr 12 02:45:11 hv32s38p16 daemon:err|error named[5636116]: creating IPv4 interface en1 failed; interface ignored
Apr 12 02:45:11 hv32s38p16 daemon:info named[5636116]: listening on IPv4 interface lo0, 127.0.0.1#53
Apr 12 02:45:11 hv32s38p16 daemon:err|error named[5636116]: could not listen on UDP socket: shutting down
Apr 12 02:45:11 hv32s38p16 daemon:err|error named[5636116]: creating IPv4 interface lo0 failed; interface ignored
Apr 12 02:45:11 hv32s38p16 daemon:info named[5636116]: prefix length for ::1 is unknown (assume 128)
Apr 12 02:45:11 hv32s38p16 daemon:warn|warning named[5636116]: not listening on any interfaces
Apr 12 02:45:11 hv32s38p16 daemon:err|error named[5636116]: cache.c:611: unexpected error:
Apr 12 02:45:11 hv32s38p16 daemon:err|error named[5636116]: isc_task_create() failed: shutting down
Apr 12 02:45:11 hv32s38p16 daemon:info named[5636116]: additionally listening on IPv4 interface en1, 9.114.154.123#53
Apr 12 02:45:11 hv32s38p16 daemon:err|error named[5636116]: could not listen on UDP socket: address in use
Apr 12 02:45:11 hv32s38p16 daemon:err|error named[5636116]: creating IPv4 interface en1 failed; interface ignored
Apr 12 02:45:11 hv32s38p16 daemon:info named[5636116]: additionally listening on IPv4 interface lo0, 127.0.0.1#53
Apr 12 02:45:11 hv32s38p16 daemon:err|error named[5636116]: could not listen on UDP socket: shutting down
Apr 12 02:45:11 hv32s38p16 daemon:err|error named[5636116]: creating IPv4 interface lo0 failed; interface ignored
Apr 12 02:45:11 hv32s38p16 daemon:info named[5636116]: prefix length for ::1 is unknown (assume 128)
Apr 12 02:45:11 hv32s38p16 daemon:crit named[5636116]: loading configuration: unexpected error
Apr 12 02:45:11 hv32s38p16 daemon:crit named[5636116]: exiting (due to fatal error)
Apr 12 02:46:20 hv32s38p16 local4:info xCAT: xcatd: ddns plugin bug, pid 14352600, process description: 'xCATd SSL: makedns for root@loopback: ddns instance' with error 'Not a subroutine reference at /usr/opt/perl5/lib/5.10.1/aix-thread-multi/IO/Select.pm line 105, <$parfd> line 21. '
Apr 12 02:46:20 hv32s38p16 local4:info xCAT: Client abort requested
Apr 12 02:46:20 hv32s38p16 local4:info xCAT: xcatd: possible BUG encountered by xCAT TCP service: Died at /opt/xcat/sbin/xcatd line 1899.
Apr 12 02:46:20 hv32s38p16 local4:info xCAT: xcatd: Unexpected client disconnect
Apr 12 02:46:55 hv32s38p16 local4:info xCAT: xCAT: Allowing makedns -n for root from loopback
Apr 12 02:46:55 hv32s38p16 daemon:notice named[10813468]: starting BIND 9.4.1
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: found 4 CPUs, using 4 worker threads
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: loading configuration from '/etc/named.conf'
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: listening on IPv4 interface en1, 9.114.154.123#53
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: listening on IPv4 interface lo0, 127.0.0.1#53
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: prefix length for ::1 is unknown (assume 128)
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: automatic empty zone: 127.IN-ADDR.ARPA
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: automatic empty zone: 254.169.IN-ADDR.ARPA
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: automatic empty zone: 2.0.192.IN-ADDR.ARPA
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: automatic empty zone: 255.255.255.255.IN-ADDR.ARPA
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: automatic empty zone: 0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.IP6.ARPA
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: automatic empty zone: 1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.IP6.ARPA
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: automatic empty zone: D.F.IP6.ARPA
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: automatic empty zone: 8.E.F.IP6.ARPA
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: automatic empty zone: 9.E.F.IP6.ARPA
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: automatic empty zone: A.E.F.IP6.ARPA
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: automatic empty zone: B.E.F.IP6.ARPA
Apr 12 02:46:55 hv32s38p16 daemon:err|error named[10813468]: cache.c:611: unexpected error:
Apr 12 02:46:55 hv32s38p16 daemon:err|error named[10813468]: isc_task_create() failed: shutting down
Apr 12 02:46:55 hv32s38p16 daemon:info named[10813468]: prefix length for ::1 is unknown (assume 128)
Apr 12 02:46:55 hv32s38p16 daemon:crit named[10813468]: loading configuration: unexpected error
Apr 12 02:46:55 hv32s38p16 daemon:crit named[10813468]: exiting (due to fatal error)
Apr 12 02:47:19 hv32s38p16 local4:info xCAT: Client abort requested
Apr 12 02:47:19 hv32s38p16 local4:info xCAT: xcatd: possible BUG encountered by xCAT TCP service: Died at /opt/xcat/sbin/xcatd line 1899.
Apr 12 02:47:19 hv32s38p16 local4:info xCAT: xcatd: ddns plugin bug, pid 14614758, process description: 'xCATd SSL: makedns for root@loopback: ddns instance' with error 'Not a subroutine reference at /usr/opt/perl5/lib/5.10.1/aix-thread-multi/IO/Select.pm line 105, <$parfd> line 21. '
Apr 12 02:47:19 hv32s38p16 local4:info xCAT: xcatd: Unexpected client disconnect
Apr 12 02:48:20 hv32s38p16 local4:info xCAT: xCAT: Allowing makedns -n for root from loopback
Apr 12 02:48:20 hv32s38p16 daemon:notice named[10813472]: starting BIND 9.4.1
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: found 4 CPUs, using 4 worker threads
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: loading configuration from '/etc/named.conf'
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: listening on IPv4 interface en1, 9.114.154.123#53
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: listening on IPv4 interface lo0, 127.0.0.1#53
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: prefix length for ::1 is unknown (assume 128)
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: automatic empty zone: 127.IN-ADDR.ARPA
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: automatic empty zone: 254.169.IN-ADDR.ARPA
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: automatic empty zone: 2.0.192.IN-ADDR.ARPA
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: automatic empty zone: 255.255.255.255.IN-ADDR.ARPA
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: automatic empty zone: 0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.IP6.ARPA
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: automatic empty zone: 1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.IP6.ARPA
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: automatic empty zone: D.F.IP6.ARPA
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: automatic empty zone: 8.E.F.IP6.ARPA
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: automatic empty zone: 9.E.F.IP6.ARPA
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: automatic empty zone: A.E.F.IP6.ARPA
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: automatic empty zone: B.E.F.IP6.ARPA
Apr 12 02:48:20 hv32s38p16 daemon:err|error named[10813472]: none:0: open: /etc/rndc.key: file not found
Apr 12 02:48:20 hv32s38p16 daemon:notice named[10813472]: couldn't add command channel 127.0.0.1#953: file not found
Apr 12 02:48:20 hv32s38p16 daemon:err|error named[10813472]: none:0: open: /etc/rndc.key: file not found
Apr 12 02:48:20 hv32s38p16 daemon:notice named[10813472]: couldn't add command channel ::1#953: file not found
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: no source of entropy found
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: prefix length for ::1 is unknown (assume 128)
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: zone 154.114.9.IN-ADDR.ARPA/IN: loaded serial 2012041200
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: zone ppd.pok.ibm.com/IN: loaded serial 2012041200
Apr 12 02:48:20 hv32s38p16 daemon:notice named[10813472]: running
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: shutting down
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: no longer listening on 9.114.154.123#53
Apr 12 02:48:20 hv32s38p16 daemon:info named[10813472]: no longer listening on 127.0.0.1#53
Apr 12 02:48:20 hv32s38p16 daemon:notice named[10813472]: exiting
Apr 12 02:48:33 hv32s38p16 local4:info xCAT: Client abort requested
Apr 12 02:48:33 hv32s38p16 local4:info xCAT: xcatd: possible BUG encountered by xCAT TCP service: Died at /opt/xcat/sbin/xcatd line 1899.
Apr 12 02:48:33 hv32s38p16 local4:info xCAT: xcatd: ddns plugin bug, pid 14745826, process description: 'xCATd SSL: makedns for root@loopback: ddns instance' with error 'Not a subroutine reference at /usr/opt/perl5/lib/5.10.1/aix-thread-multi/IO/Select.pm line 105, <$parfd> line 21. '
Apr 12 02:48:33 hv32s38p16 local4:info xCAT: xcatd: Unexpected client disconnect
Apr 12 02:52:00 hv32s38p16 local4:info xCAT: xCAT: Allowing makedns -n for root from loopback
Apr 12 02:52:00 hv32s38p16 daemon:notice named[7929938]: starting BIND 9.4.1
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: found 4 CPUs, using 4 worker threads
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: loading configuration from '/etc/named.conf'
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: listening on IPv4 interface en1, 9.114.154.123#53
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: listening on IPv4 interface lo0, 127.0.0.1#53
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: prefix length for ::1 is unknown (assume 128)
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: automatic empty zone: 127.IN-ADDR.ARPA
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: automatic empty zone: 254.169.IN-ADDR.ARPA
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: automatic empty zone: 2.0.192.IN-ADDR.ARPA
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: automatic empty zone: 255.255.255.255.IN-ADDR.ARPA
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: automatic empty zone: 0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.IP6.ARPA
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: automatic empty zone: 1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.IP6.ARPA
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: automatic empty zone: D.F.IP6.ARPA
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: automatic empty zone: 8.E.F.IP6.ARPA
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: automatic empty zone: 9.E.F.IP6.ARPA
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: automatic empty zone: A.E.F.IP6.ARPA
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: automatic empty zone: B.E.F.IP6.ARPA
Apr 12 02:52:00 hv32s38p16 daemon:err|error named[7929938]: none:0: open: /etc/rndc.key: file not found
Apr 12 02:52:00 hv32s38p16 daemon:notice named[7929938]: couldn't add command channel 127.0.0.1#953: file not found
Apr 12 02:52:00 hv32s38p16 daemon:err|error named[7929938]: none:0: open: /etc/rndc.key: file not found
Apr 12 02:52:00 hv32s38p16 daemon:notice named[7929938]: couldn't add command channel ::1#953: file not found
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: no source of entropy found
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: prefix length for ::1 is unknown (assume 128)
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: zone 154.114.9.IN-ADDR.ARPA/IN: loaded serial 2012041200
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: zone ppd.pok.ibm.com/IN: loaded serial 2012041200
Apr 12 02:52:00 hv32s38p16 daemon:notice named[7929938]: running
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: shutting down
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: no longer listening on 9.114.154.123#53
Apr 12 02:52:00 hv32s38p16 daemon:info named[7929938]: no longer listening on 127.0.0.1#53
Apr 12 02:52:00 hv32s38p16 daemon:notice named[7929938]: exiting
Discussion
I debugged on the system and right after the initial install of xat if you run makedns -n you get the errors.
I ran makedns -n under XCATBYPASS and did not get the errors
I ran restartxcatd -r ( which is what happens durig install) and still get the errors.
Accorrding to han jing, if we run restartxcatd, we will not longer get the errors, but we wanted to get someone on the machine while we can create the problem without running restartxcatd which would get rid of the situation.
The only thing I know that restartxcatd ( without -r) would do would be run AAsn.pm, but could not determine why this would clean up the problem
The MN is hv32s38p16.ppd.pok.ibm.com
Han Jing,
You said "have set up all xcat table properly", have you manually changed attribute site.master? If this is the case, you will have to restart xcatd. I do not think this is a common problem, because we have never heard complains from someone else.
Guang Cheng,
I try to config everything else is ok before i run "makedns -n" so that i can eliminate any possibility of user error, besides this is not first time i encounter this.
I think you can login on hv32s38p16 to see this , or you can rinstall this node so that you can make a initial install for xcat in order to recreate this issue.
and i did not modify site.master since i make the initial install for xcat
No, still can not recreate this problem.
I reinstalled xCAT, and then run the following commands:
. /etc/profile
chdef -t site nameservers=9.114.154.123 domain=ppd.pok.ibm.com forwarders=9.114.1.1
makedns
Everything worked perfectly and did not see any problem...
Well, first i did not say using "makedns" without flag would somewhat uncover the point coz makedns will only update exist db.* file under /var/named which is totally different from using "makedns -n".
second,You should not reinstall xcat on the same node which is not what i am saying,this issue will not recreate unless xcat install for the very first time.
Talked with Hanjing, this problem could not constly recreated, moving it to 2.7.2 for further investigation.
Sun Jing said this problem has been fixed in the 2.8 build, please verify.