From: Arno L. <al...@it...> - 2008-12-01 20:59:24
|
Hello, 29.11.2008 19:45, Bob Hetzel wrote: > >> From: Arno Lehmann <al...@it...> > > Date: Thu, 27 Nov 2008 08:14:45 +0100 >> Hi, > > >> 26.11.2008 21:22, Bob Hetzel wrote: >>>> I've got bacula currently in a hung state with the following interesting >>>> info. When I run a status storage produces the following... >> Is your Bacula still stuck? If so, and you have gdb installed, and a >> Bacula with debug symbols, now might be a good time to see what it's >> doing... >> > > I'll put the traceback at the end Great. >>>> Used Volume status: >>>> [nothing further and the bconsole program hangs here] >> That alone would be a bug, I guess... > [snip] >> Sounds like it's worth a bug report - especially if you can re-create >> the problem. I cc'ed this to Eric, who - I believe - has been working >> on this sort of problems recently. As I'm a bit too busy right now I forward this to Eric again - if he's still working on this he might know if it relates to any current bug report. Perhaps he even opens one himself :-) Please see my inline comments first, especially the last ones... >> Arno >> > It didn't crash so I tried to force the traceback per the instructions > at http://www.bacula.org/en/dev-manual/What_Do_When_Bacula.html > > The first line of the output implies that I did something wrong but > anyway... I don't know why that message appears, but the traceback looks good to me. > /usr/sbin: No such file or directory. > Using host libthread_db library "/lib/libthread_db.so.1". > [Thread debugging using libthread_db enabled] > [New Thread -1214433584 (LWP 5411)] > [New Thread -1416819824 (LWP 9229)] > [New Thread -1425212528 (LWP 8819)] > [New Thread -1374856304 (LWP 8816)] > [New Thread -1341285488 (LWP 8670)] > [New Thread -1400034416 (LWP 8553)] > [New Thread -1366463600 (LWP 8402)] > [New Thread -1442006128 (LWP 8160)] > [New Thread -1408427120 (LWP 8157)] > [New Thread -1383249008 (LWP 8154)] > [New Thread -1358070896 (LWP 8151)] > [New Thread -1324434544 (LWP 8017)] > [New Thread -1316041840 (LWP 8016)] > [New Thread -1307649136 (LWP 8015)] > [New Thread -1282483312 (LWP 8014)] > [New Thread -1274090608 (LWP 8013)] > [New Thread -1265697904 (LWP 8012)] > [New Thread -1257292912 (LWP 8007)] > [New Thread -1248900208 (LWP 8004)] > [New Thread -1240507504 (LWP 8003)] > [New Thread -1299256432 (LWP 8002)] > [New Thread -1332892784 (LWP 8001)] > [New Thread -1433613424 (LWP 8000)] > [New Thread -1231897712 (LWP 7921)] > [New Thread -1223505008 (LWP 5414)] > [New Thread -1215112304 (LWP 5413)] > 0xb7f6a410 in __kernel_vsyscall () > $1 = "gyrus-dir", '\0' <repeats 20 times> > $2 = 0x80f8e00 "bacula-dir" > $3 = 0x80f90b0 "/usr/sbin/" > $4 = 0x80f91e0 "MySQL" > $5 = 0x80ed18b "2.4.3 (10 October 2008)" > $6 = 0x80ed1a3 "i686-pc-linux-gnu" > $7 = 0x80ed1b5 "suse" > $8 = 0x80ed1ba "10.2" > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c73876 in __nanosleep_nocancel () from /lib/libpthread.so.0 > #2 0x080a827b in bmicrosleep (sec=60, usec=0) at bsys.c:71 > #3 0x08071b28 in wait_for_next_job (one_shot_job_to_run=0x0) at > scheduler.c:130 > #4 0x0804de85 in main (argc=0, argv=0xbfe00164) at dird.c:288 > > Thread 26 (Thread -1215112304 (LWP 5413)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7adba41 in ___newselect_nocancel () from /lib/libc.so.6 > #2 0x080a99b9 in bnet_thread_server (addrs=0x80f9860, max_clients=20, > client_wq=0x80f64e0, handle_client_request=0x808d536 > <handle_UA_client_request>) > at bnet_server.c:161 The above line looks like it might be related to the problem... in general, there's one thread per job running (plus the parent threads), and the variable max_clients might indicate the number of currently active thread servers is exhausted or something... > #3 0x0808d52e in connect_thread (arg=0x80f9860) at ua_server.c:84 > #4 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #5 0xb7ae22ee in clone () from /lib/libc.so.6 > > Thread 25 (Thread -1223505008 (LWP 5414)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c707dc in pthread_cond_timedwait@@GLIBC_2.3.2 () from > /lib/libpthread.so.0 > #2 0x080ccf27 in watchdog_thread (arg=0x0) at watchdog.c:307 > #3 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #4 0xb7ae22ee in clone () from /lib/libc.so.6 Above: a watchdog / timer thread? > Thread 24 (Thread -1231897712 (LWP 7921)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0x8213df0, ptr=0xb692b1b4 > "\333\v\016\b\350\261\222\266\217#", nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0x8213df0) at bsock.c:381 > #4 0x080a9021 in bnet_recv (bsock=0x8213df0) at bnet.c:187 > #5 0x0808ef27 in do_storage_status (ua=0x8173d48, store=0x81d9f00) at > ua_status.c:325 > #6 0x0808f6ae in status_cmd (ua=0x8173d48, cmd=0x8160778 "status > storage") at ua_status.c:134 > #7 0x08076dd0 in do_a_command (ua=0x8173d48, cmd=0x8160778 "status > storage") at ua_cmds.c:180 > #8 0x0808d647 in handle_UA_client_request (arg=0x81b77e8) at > ua_server.c:147 > #9 0x080cd952 in workq_server (arg=0x80f64e0) at workq.c:357 > #10 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #11 0xb7ae22ee in clone () from /lib/libc.so.6 This one: a storage status request. > Thread 23 (Thread -1433613424 (LWP 8000)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0x820e898, ptr=0xaa8cc024 "", > nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0x820e898) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0x820e898) at getmsg.c:109 > #5 0x080513f8 in wait_for_job_termination (jcr=0x821ac70) at backup.c:274 > #6 0x08051abd in do_backup (jcr=0x821ac70) at backup.c:235 > #7 0x08063da5 in job_thread (arg=0x821ac70) at job.c:290 > #8 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466 > #9 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #10 0xb7ae22ee in clone () from /lib/libc.so.6 This one: A job running? > > Thread 22 (Thread -1332892784 (LWP 8001)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0xb2f00b28, ptr=0xb08d9f44 > "\264/Ç·(\240\215\260\340\354\030\b0\354\030\bp", nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0xb2f00b28) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0xb2f00b28) at getmsg.c:109 > #5 0x0806c08f in start_storage_daemon_job (jcr=0x82238c8, rstore=0x0, > wstore=0x818f970) at msgchan.c:285 > #6 0x080517e3 in do_backup (jcr=0x82238c8) at backup.c:142 > #7 0x08063da5 in job_thread (arg=0x82238c8) at job.c:290 > #8 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466 > #9 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #10 0xb7ae22ee in clone () from /lib/libc.so.6 Another job running? > Thread 21 (Thread -1299256432 (LWP 8002)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c707dc in pthread_cond_timedwait@@GLIBC_2.3.2 () from > /lib/libpthread.so.0 > #2 0x0806afd8 in wait_for_storage_daemon_termination (jcr=0x8211270) at > msgchan.c:409 > #3 0x080514e2 in wait_for_job_termination (jcr=0x8211270) at backup.c:304 > #4 0x08051abd in do_backup (jcr=0x8211270) at backup.c:235 > #5 0x08063da5 in job_thread (arg=0x8211270) at job.c:290 > #6 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466 > #7 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #8 0xb7ae22ee in clone () from /lib/libc.so.6 Another job? > Thread 20 (Thread -1240507504 (LWP 8003)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0xb2f02f28, ptr=0xb60f5024 "", > nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0xb2f02f28) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0xb2f02f28) at getmsg.c:109 > #5 0x080513f8 in wait_for_job_termination (jcr=0x8221cb8) at backup.c:274 > #6 0x08051abd in do_backup (jcr=0x8221cb8) at backup.c:235 > #7 0x08063da5 in job_thread (arg=0x8221cb8) at job.c:290 > #8 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466 > #9 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #10 0xb7ae22ee in clone () from /lib/libc.so.6 Another job? > Thread 19 (Thread -1248900208 (LWP 8004)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0xb2f03008, ptr=0xb58f4024 "", > nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0xb2f03008) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0xb2f03008) at getmsg.c:109 > #5 0x080513f8 in wait_for_job_termination (jcr=0x8215870) at backup.c:274 > #6 0x08051abd in do_backup (jcr=0x8215870) at backup.c:235 > #7 0x08063da5 in job_thread (arg=0x8215870) at job.c:290 > #8 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466 > #9 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #10 0xb7ae22ee in clone () from /lib/libc.so.6 Another job? > Thread 18 (Thread -1257292912 (LWP 8007)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0x82af080, > ptr=0xb50f2f44 > +"\264/Ç·(0\017\265\360\366\032\b@\366\032\b\220\004\033\b\3100\017\265\201\336\005\b\200\360*\b\264/Ç·H0\017\265\260\221\n\b\200\360*\b\234}\032\b\004", > +nbytes=4) > at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0x82af080) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0x82af080) at getmsg.c:109 > #5 0x0806c08f in start_storage_daemon_job (jcr=0x82246d0, rstore=0x0, > wstore=0x8190518) at msgchan.c:285 > #6 0x080517e3 in do_backup (jcr=0x82246d0) at backup.c:142 > #7 0x08063da5 in job_thread (arg=0x82246d0) at job.c:290 > #8 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466 > #9 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #10 0xb7ae22ee in clone () from /lib/libc.so.6 Another job? > Thread 17 (Thread -1265697904 (LWP 8012)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c707dc in pthread_cond_timedwait@@GLIBC_2.3.2 () from > /lib/libpthread.so.0 > #2 0x0806afd8 in wait_for_storage_daemon_termination (jcr=0x8222ac0) at > msgchan.c:409 > #3 0x080514e2 in wait_for_job_termination (jcr=0x8222ac0) at backup.c:304 > #4 0x08051abd in do_backup (jcr=0x8222ac0) at backup.c:235 > #5 0x08063da5 in job_thread (arg=0x8222ac0) at job.c:290 > #6 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466 > #7 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #8 0xb7ae22ee in clone () from /lib/libc.so.6 Another running job? > Thread 16 (Thread -1274090608 (LWP 8013)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c707dc in pthread_cond_timedwait@@GLIBC_2.3.2 () from > /lib/libpthread.so.0 > #2 0x0806afd8 in wait_for_storage_daemon_termination (jcr=0x8212e70) at > msgchan.c:409 > #3 0x080514e2 in wait_for_job_termination (jcr=0x8212e70) at backup.c:304 > #4 0x08051abd in do_backup (jcr=0x8212e70) at backup.c:235 > #5 0x08063da5 in job_thread (arg=0x8212e70) at job.c:290 > #6 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466 > #7 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #8 0xb7ae22ee in clone () from /lib/libc.so.6 Another job running... > Thread 15 (Thread -1282483312 (LWP 8014)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0x82adf18, ptr=0xb38ecf44 > "\264/Ç·(\320\216\263\020\345\032\b`\344\032\b", nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0x82adf18) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0x82adf18) at getmsg.c:109 > #5 0x0806c08f in start_storage_daemon_job (jcr=0x8227ef0, rstore=0x0, > wstore=0x818ff98) at msgchan.c:285 > #6 0x080517e3 in do_backup (jcr=0x8227ef0) at backup.c:142 > #7 0x08063da5 in job_thread (arg=0x8227ef0) at job.c:290 > #8 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466 > #9 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #10 0xb7ae22ee in clone () from /lib/libc.so.6 Another job... > Thread 14 (Thread -1307649136 (LWP 8015)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c707dc in pthread_cond_timedwait@@GLIBC_2.3.2 () from > /lib/libpthread.so.0 > #2 0x0806afd8 in wait_for_storage_daemon_termination (jcr=0x8208a08) at > msgchan.c:409 > #3 0x080514e2 in wait_for_job_termination (jcr=0x8208a08) at backup.c:304 > #4 0x08051abd in do_backup (jcr=0x8208a08) at backup.c:235 > #5 0x08063da5 in job_thread (arg=0x8208a08) at job.c:290 > #6 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466 > #7 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #8 0xb7ae22ee in clone () from /lib/libc.so.6 Another job... > Thread 13 (Thread -1316041840 (LWP 8016)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c707dc in pthread_cond_timedwait@@GLIBC_2.3.2 () from > /lib/libpthread.so.0 > #2 0x0806afd8 in wait_for_storage_daemon_termination (jcr=0x821e470) at > msgchan.c:409 > #3 0x080514e2 in wait_for_job_termination (jcr=0x821e470) at backup.c:304 > #4 0x08051abd in do_backup (jcr=0x821e470) at backup.c:235 > #5 0x08063da5 in job_thread (arg=0x821e470) at job.c:290 > #6 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466 > #7 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #8 0xb7ae22ee in clone () from /lib/libc.so.6 Another job? > Thread 12 (Thread -1324434544 (LWP 8017)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c707dc in pthread_cond_timedwait@@GLIBC_2.3.2 () from > /lib/libpthread.so.0 > #2 0x0806afd8 in wait_for_storage_daemon_termination (jcr=0x8204df0) at > msgchan.c:409 > #3 0x080514e2 in wait_for_job_termination (jcr=0x8204df0) at backup.c:304 > #4 0x08051abd in do_backup (jcr=0x8204df0) at backup.c:235 > #5 0x08063da5 in job_thread (arg=0x8204df0) at job.c:290 > #6 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466 > #7 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #8 0xb7ae22ee in clone () from /lib/libc.so.6 Another job... > Thread 11 (Thread -1358070896 (LWP 8151)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0x820f190, ptr=0xaf0d7114 "", > nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0x820f190) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0x820f190) at getmsg.c:109 > #5 0x0806b2f5 in msg_thread (arg=0x8208a08) at msgchan.c:374 > #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #7 0xb7ae22ee in clone () from /lib/libc.so.6 Something I can't guess what it does... some message thread, currently reading from somewhere. > Thread 10 (Thread -1383249008 (LWP 8154)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0x82b5000, ptr=0xad8d4114 "", > nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0x82b5000) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0x82b5000) at getmsg.c:109 > #5 0x0806b2f5 in msg_thread (arg=0x8211270) at msgchan.c:374 > #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #7 0xb7ae22ee in clone () from /lib/libc.so.6 Another message thread? > Thread 9 (Thread -1408427120 (LWP 8157)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0x82ade78, ptr=0xac0d1114 "", > nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0x82ade78) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0x82ade78) at getmsg.c:109 > #5 0x0806b2f5 in msg_thread (arg=0x8204df0) at msgchan.c:374 > #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #7 0xb7ae22ee in clone () from /lib/libc.so.6 Another message thread? > Thread 8 (Thread -1442006128 (LWP 8160)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0x8160da8, ptr=0xaa0cb114 "", > nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0x8160da8) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0x8160da8) at getmsg.c:109 > #5 0x0806b2f5 in msg_thread (arg=0x8212e70) at msgchan.c:374 > #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #7 0xb7ae22ee in clone () from /lib/libc.so.6 Another message thread? > Thread 7 (Thread -1366463600 (LWP 8402)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0xb2f01f20, ptr=0xae8d6114 "", > nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0xb2f01f20) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0xb2f01f20) at getmsg.c:109 > #5 0x0806b2f5 in msg_thread (arg=0x8215870) at msgchan.c:374 > #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #7 0xb7ae22ee in clone () from /lib/libc.so.6 Messagethread, again? > Thread 6 (Thread -1400034416 (LWP 8553)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0x8188718, ptr=0xac8d2114 "", > nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0x8188718) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0x8188718) at getmsg.c:109 > #5 0x0806b2f5 in msg_thread (arg=0x821ac70) at msgchan.c:374 > #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #7 0xb7ae22ee in clone () from /lib/libc.so.6 One more... > Thread 5 (Thread -1341285488 (LWP 8670)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0x82b6fc8, ptr=0xb00d9114 "", > nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0x82b6fc8) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0x82b6fc8) at getmsg.c:109 > #5 0x0806b2f5 in msg_thread (arg=0x821e470) at msgchan.c:374 > #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #7 0xb7ae22ee in clone () from /lib/libc.so.6 And another one... > Thread 4 (Thread -1374856304 (LWP 8816)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0xb2f01940, ptr=0xae0d5114 "", > nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0xb2f01940) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0xb2f01940) at getmsg.c:109 > #5 0x0806b2f5 in msg_thread (arg=0x8221cb8) at msgchan.c:374 > #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #7 0xb7ae22ee in clone () from /lib/libc.so.6 And one more... > Thread 3 (Thread -1425212528 (LWP 8819)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0x820c000, ptr=0xab0cf114 "", > nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0x820c000) at bsock.c:381 > #4 0x0805de81 in bget_dirmsg (bs=0x820c000) at getmsg.c:109 > #5 0x0806b2f5 in msg_thread (arg=0x8222ac0) at msgchan.c:374 > #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #7 0xb7ae22ee in clone () from /lib/libc.so.6 And one more... > Thread 2 (Thread -1416819824 (LWP 9229)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0 > #2 0x080a9300 in read_nbytes (bsock=0x820ea78, ptr=0xab8d01d4 > "\377\001", nbytes=4) at bnet.c:82 > #3 0x080aba1c in BSOCK::recv (this=0x820ea78) at bsock.c:381 > #4 0x080a9021 in bnet_recv (bsock=0x820ea78) at bnet.c:187 > #5 0x0807594b in do_mount_cmd (ua=0x8213c70, command=0x80db09d "mount") > at ua_cmds.c:1489 > #6 0x080759d1 in mount_cmd (ua=0x8213c70, cmd=0x8225cd8 "") at > ua_cmds.c:1502 > #7 0x08076dd0 in do_a_command (ua=0x8213c70, cmd=0x8225cd8 "") at > ua_cmds.c:180 > #8 0x0808d647 in handle_UA_client_request (arg=0x8213e90) at > ua_server.c:147 > #9 0x080cd952 in workq_server (arg=0x80f64e0) at workq.c:357 > #10 0xb7c6c112 in start_thread () from /lib/libpthread.so.0 > #11 0xb7ae22ee in clone () from /lib/libc.so.6 A console job, doing a mount command. > Thread 1 (Thread -1214433584 (LWP 5411)): > #0 0xb7f6a410 in __kernel_vsyscall () > #1 0xb7c73876 in __nanosleep_nocancel () from /lib/libpthread.so.0 > #2 0x080a827b in bmicrosleep (sec=60, usec=0) at bsys.c:71 > #3 0x08071b28 in wait_for_next_job (one_shot_job_to_run=0x0) at > scheduler.c:130 > #4 0x0804de85 in main (argc=0, argv=0xbfe00164) at dird.c:288 > #0 0xb7f6a410 in __kernel_vsyscall () > #0 0xb7f6a410 in __kernel_vsyscall () > No symbol table info available. The main thread, I guess. > #1 0xb7c73876 in __nanosleep_nocancel () from /lib/libpthread.so.0 > No symbol table info available. > #2 0x080a827b in bmicrosleep (sec=60, usec=0) at bsys.c:71 > 71 stat = nanosleep(&timeout, NULL); > Current language: auto; currently c++ > timeout = {tv_sec = 60, tv_nsec = 0} > tv = {tv_sec = 3, tv_usec = 48} > tz = {tz_minuteswest = 3, tz_dsttime = 10} > stat = 0 > #3 0x08071b28 in wait_for_next_job (one_shot_job_to_run=0x0) at > scheduler.c:130 > 130 bmicrosleep(next_check_secs, 0); /* recheck once per minute */ > jcr = (JCR *) 0x82254d8 > job = (JOB *) 0x8164af8 > run = (RUN *) 0x81dbfa8 > now = 45766 > prev = 1227723000 > next_job = (job_item *) 0x0 > first = false > #4 0x0804de85 in main (argc=0, argv=0xbfe00164) at dird.c:288 > 288 while ( (jcr = wait_for_next_job(runjob)) ) { > ch = -1 > jcr = (JCR *) 0x82254d8 > no_signals = false > test_config = false > uid = 0xbfe0051a "bacula" > gid = 0xbfe00524 "bacula" > #0 0x00000000 in ?? () > No symbol table info available. > #0 0x00000000 in ?? () > No symbol table info available. > #0 0x00000000 in ?? () > No symbol table info available. Ok... there are quite a number of threads that could be console connections. There is a hard limit of the active console connections - it seems possible that you ran into that limit. Have you checked how many console connections are currently open? IIRC, if you SIGTERM a console, it does not necessarily die... so there could be console processes laying around somewhere, keeping their connections open. If you find those and 'kill -9' them, do your new console connections work? Arno -- Arno Lehmann IT-Service Lehmann Sandstr. 6, 49080 Osnabrück www.its-lehmann.de |