Re: [SSI-devel] Critical ext3 bug in latest SSI kernel from CVS OPENSSI-RH branc
Brought to you by:
brucewalker,
rogertsang
From: Roger T. <pe...@ho...> - 2004-12-09 19:05:41
|
I believe I resolved this issue. I had unwittingly replaced some glibc kernel headers with SSI kernel headers by symlinking to /usr/src/linux/include. It is tradition on older RedHat systems to do this symlink when upgrading kernels, but apparently not for Fedora Core 2. I fixed this by reinstalling glibc-kernheaders and recompiling nfs-utils, util-linux, and Apache2. Mount and umount are from the util-linux package, so simply executing the bad umount probably caused the kernel oops. -Roger > >Roger Tsang wrote: >>I've rebuilt the SSI userspace tools too and doesn't help unfortunately. > >How are you producing the problem, exactly? Simple umounting a filesystem >doesn't panic for me. > >John Byrne > > >> >>Dec 8 12:56:16 node1 init: Trying to re-exec init >>Dec 8 13:10:24 node1 kernel: kernel BUG in header file at line 325 Dec 8 >>13:10:24 node1 kernel: ------------[ cut here ]------------ Dec 8 >>13:10:24 node1 kernel: kernel BUG at panic.c:297! >>Dec 8 13:10:24 node1 kernel: invalid operand: 0000 >>Dec 8 13:10:24 node1 kernel: r128 agpgart nfsd ipt_REJECT ipt_multiport >>ipt_state ip_conntrack iptable_filter ip_tables floppy ide-cd sr_mod cdrom >>dm-mod keybdev mousedev hid input usb-uh >>Dec 8 13:10:24 node1 kernel: CPU: 0 >>Dec 8 13:10:24 node1 kernel: EIP: 0060:[<c0128a39>] Not tainted Dec >> 8 13:10:24 node1 kernel: EFLAGS: 00210286 >>Dec 8 13:10:24 node1 kernel: >>Dec 8 13:10:24 node1 kernel: EIP is at __out_of_line_bug [kernel] 0x19 >>(2.4.22-1.2199.nptl_ssi_5develsmp) >>Dec 8 13:10:24 node1 kernel: eax: 00000026 ebx: c7795d80 ecx: >>00000000 edx: c066f980 >>Dec 8 13:10:24 node1 kernel: esi: d1bf97bc edi: c7795dec ebp: >>f4695c44 esp: f4695c3c >>Dec 8 13:10:24 node1 kernel: ds: 0068 es: 0068 ss: 0068 >>Dec 8 13:10:24 node1 kernel: Process nfsd (pid: 67604, >>stackpage=f4695000) >>Dec 8 13:10:24 node1 kernel: Stack: c03e2f90 00000145 f4695c64 c0173b39 >>00000145 000001f0 d1bf97bc fffffff4 >>Dec 8 13:10:24 node1 kernel: f2348680 f233c580 f4695c88 c01684b8 >>f2348680 d1bf97bc 00000000 00000000 >>Dec 8 13:10:24 node1 kernel: cebfd3c0 f51c1080 f2348680 f4695c9c >>c016858e d1bf97bc f2348680 00000000 >>Dec 8 13:10:24 node1 kernel: Call Trace: >>Dec 8 13:10:24 node1 kernel: [<c0173b39>] d_alloc [kernel] 0x199 >>(0xf4695c48) >>Dec 8 13:10:24 node1 kernel: [<c01684b8>] lookup_hash_it [kernel] 0x88 >>(0xf4695c68) >>Dec 8 13:10:24 node1 kernel: [<c016858e>] lookup_hash [kernel] 0x1e >>(0xf4695c8c) >>Dec 8 13:10:24 node1 kernel: [<c0253434>] cfsd_lookup [kernel] 0x54 >>(0xf4695ca0) >>Dec 8 13:10:24 node1 kernel: [<c035a850>] ip_finish_output2 [kernel] 0x0 >>(0xf4695cac) >>Dec 8 13:10:24 node1 kernel: [<c024ec63>] cfs_proc_lookup [kernel] 0x1b3 >>(0xf4695cd8) >>Dec 8 13:10:24 node1 kernel: [<c03466b7>] nf_hook_slow [kernel] 0xf7 >>(0xf4695cec) >>Dec 8 13:10:24 node1 kernel: [<c035a980>] ip_queue_xmit2 [kernel] 0x0 >>(0xf4695d08) >>Dec 8 13:10:24 node1 kernel: [<c035a980>] ip_queue_xmit2 [kernel] 0x0 >>(0xf4695d18) >>Dec 8 13:10:24 node1 kernel: [<c035962a>] ip_queue_xmit [kernel] 0x48a >>(0xf4695d24) >>Dec 8 13:10:24 node1 kernel: [<c025ab05>] cfstok_relsex [kernel] 0x215 >>(0xf4695d5c) >>Dec 8 13:10:24 node1 kernel: [<c023fb37>] tok_hold [kernel] 0x87 >>(0xf4695d84) >>Dec 8 13:10:24 node1 kernel: [<c025a547>] cfstok_req [kernel] 0x127 >>(0xf4695da4) >>Dec 8 13:10:24 node1 kernel: [<c024d351>] cfs_lookup [kernel] 0xe1 >>(0xf4695e1c) >>Dec 8 13:10:24 node1 kernel: [<c0168545>] lookup_hash_it [kernel] 0x115 >>(0xf4695e58) >>Dec 8 13:10:24 node1 kernel: [<c0168602>] lookup_one_len_it [kernel] 0x62 >>(0xf4695e7c) >>Dec 8 13:10:24 node1 kernel: [<c0168645>] lookup_one_len [kernel] 0x25 >>(0xf4695ea8) >>Dec 8 13:10:24 node1 kernel: [<f8a684cb>] nfsd_lookup [nfsd] 0xdb >>(0xf4695ec0) >>Dec 8 13:10:24 node1 kernel: [<c039ed8b>] svc_sock_enqueue [kernel] 0x13b >>(0xf4695ef0) >>Dec 8 13:10:24 node1 kernel: [<f8a6f8c0>] nfsd3_proc_lookup [nfsd] 0xa0 >>(0xf4695f0c) >>Dec 8 13:10:24 node1 kernel: [<f8a7198e>] nfs3svc_decode_diropargs [nfsd] >>0x7e (0xf4695f24) >>Dec 8 13:10:24 node1 kernel: [<f8a7784c>] nfsd_procedures3 [nfsd] 0x6c >>(0xf4695f3c) >>Dec 8 13:10:24 node1 kernel: [<f8a64639>] nfsd_dispatch [nfsd] 0xc9 >>(0xf4695f48) >>Dec 8 13:10:24 node1 kernel: [<f8a64570>] nfsd_dispatch [nfsd] 0x0 >>(0xf4695f60) >>Dec 8 13:10:24 node1 kernel: [<c039ea45>] svc_process [kernel] 0x355 >>(0xf4695f68) >>Dec 8 13:10:24 node1 kernel: [<f8a7784c>] nfsd_procedures3 [nfsd] 0x6c >>(0xf4695f8c) >>Dec 8 13:10:24 node1 kernel: [<f8a77118>] nfsd_version3 [nfsd] 0x0 >>(0xf4695f90) >>Dec 8 13:10:24 node1 kernel: [<f8a77138>] nfsd_program [nfsd] 0x0 >>(0xf4695f94) >>Dec 8 13:10:24 node1 kernel: [<f8a6441b>] nfsd [nfsd] 0x1fb (0xf4695fb0) >>Dec 8 13:10:24 node1 kernel: [<f8a64220>] nfsd [nfsd] 0x0 (0xf4695fe0) >>Dec 8 13:10:24 node1 kernel: [<c01077ed>] kernel_thread_helper [kernel] >>0x5 (0xf4695ff0) >>Dec 8 13:10:24 node1 kernel: >>Dec 8 13:10:24 node1 kernel: Code: 0f 0b 29 01 3d 27 3e c0 eb 0d 90 90 90 >>90 90 90 90 90 90 90 >> >> >>Dec 8 14:30:12 node1 kernel: Unable to handle kernel NULL pointer >>dereference at virtual address 00000070 >>Dec 8 14:30:12 node1 kernel: printing eip: >>Dec 8 14:30:12 node1 kernel: c024c894 >>Dec 8 14:30:12 node1 kernel: *pde = 33261001 >>Dec 8 14:30:12 node1 kernel: *pte = 00000000 >>Dec 8 14:30:12 node1 kernel: Oops: 0002 >>Dec 8 14:30:12 node1 kernel: r128 agpgart nfsd ipt_REJECT ipt_multiport >>ipt_state ip_conntrack iptable_filter ip_tables floppy ide-cd sr_mod cdrom >>dm-mod keybdev mousedev hid input usb-uh >>Dec 8 14:30:12 node1 kernel: CPU: 0 >>Dec 8 14:30:12 node1 kernel: EIP: 0060:[<c024c894>] Not tainted Dec >> 8 14:30:12 node1 kernel: EFLAGS: 00010286 >>Dec 8 14:30:12 node1 kernel: >>Dec 8 14:30:12 node1 kernel: EIP is at cfs_local_readdir [kernel] 0x84 >>(2.4.22-1.2199.nptl_ssi_5develsmp) >>Dec 8 14:30:12 node1 kernel: eax: f31f5680 ebx: ffffffec ecx: >>00000070 edx: 00000000 >>Dec 8 14:30:12 node1 kernel: esi: 00000070 edi: 00000000 ebp: >>f4289b94 esp: f4289b04 >>Dec 8 14:30:12 node1 kernel: ds: 0068 es: 0068 ss: 0068 >>Dec 8 14:30:12 node1 kernel: Process nfsd (pid: 67587, >>stackpage=f4289000) >>Dec 8 14:30:12 node1 kernel: Stack: f31e6b80 00004000 00000004 f4289b18 >>00000000 00000000 00000000 f31f5680 >>Dec 8 14:30:12 node1 kernel: 00000000 c057fce0 00000001 00008000 >>00000001 00000000 00000000 00000000 >>Dec 8 14:30:12 node1 kernel: 00000000 00000000 00000000 00000000 >>00000000 00000000 00000000 00000000 >>Dec 8 14:30:12 node1 kernel: Call Trace: >>Dec 8 14:30:12 node1 kernel: [<c024ce73>] cfs_readdir [kernel] 0x553 >>(0xf4289b98) >>Dec 8 14:30:12 node1 kernel: [<f8a66400>] filldir_one [nfsd] 0x0 >>(0xf4289ba4) >>Dec 8 14:30:12 node1 kernel: [<c0257384>] hfind [kernel] 0x14 >>(0xf4289bf8) >>Dec 8 14:30:12 node1 kernel: [<c0257478>] svrtok_lookup [kernel] 0x78 >>(0xf4289c18) >>Dec 8 14:30:12 node1 kernel: [<c019aec0>] ext3_lookup [kernel] 0x110 >>(0xf4289c20) >>Dec 8 14:30:12 node1 kernel: [<c016d6bd>] vfs_readdir [kernel] 0xad >>(0xf4289c4c) >>Dec 8 14:30:12 node1 kernel: [<f8a66400>] filldir_one [nfsd] 0x0 >>(0xf4289c58) >>Dec 8 14:30:12 node1 kernel: [<f8a66400>] filldir_one [nfsd] 0x0 >>(0xf4289c68) >>Dec 8 14:30:12 node1 kernel: [<f8a66600>] nfsd_get_name [nfsd] 0x190 >>(0xf4289c70) >>Dec 8 14:30:12 node1 kernel: [<f8a66400>] filldir_one [nfsd] 0x0 >>(0xf4289c78) >>Dec 8 14:30:12 node1 kernel: [<c02479ec>] cfs_hpget [kernel] 0xec >>(0xf4289c90) >>Dec 8 14:30:12 node1 kernel: [<f8a66b90>] splice [nfsd] 0x30 (0xf4289d48) >>Dec 8 14:30:12 node1 kernel: [<c0248775>] cfs_fh_to_dentry [kernel] 0xe5 >>(0xf4289dbc) >>Dec 8 14:30:12 node1 kernel: [<c025a8e7>] cfstok_relse [kernel] 0x47 >>(0xf4289dd4) >>Dec 8 14:30:12 node1 kernel: [<c024d395>] cfs_lookup [kernel] 0x125 >>(0xf4289e00) >>Dec 8 14:30:12 node1 kernel: [<c0172f21>] dput [kernel] 0x31 (0xf4289e3c) >>Dec 8 14:30:12 node1 kernel: [<f8a66abd>] nfsd_findparent [nfsd] 0xbd >>(0xf4289e54) >>Dec 8 14:30:12 node1 kernel: [<f8a73efc>] .rodata.str1.1 [nfsd] 0x160 >>(0xf4289e60) >>Dec 8 14:30:12 node1 kernel: [<f8a66ed7>] find_fh_dentry [nfsd] 0x1d7 >>(0xf4289e80) >>Dec 8 14:30:12 node1 kernel: [<f8a67269>] fh_verify [nfsd] 0x199 >>(0xf4289eb4) >>Dec 8 14:30:12 node1 kernel: [<c039ed8b>] svc_sock_enqueue [kernel] 0x13b >>(0xf4289ef0) >>Dec 8 14:30:12 node1 kernel: [<f8a6f6aa>] nfsd3_proc_getattr [nfsd] 0x6a >>(0xf4289f10) >>Dec 8 14:30:12 node1 kernel: [<f8a77804>] nfsd_procedures3 [nfsd] 0x24 >>(0xf4289f3c) >>Dec 8 14:30:12 node1 kernel: [<f8a64639>] nfsd_dispatch [nfsd] 0xc9 >>(0xf4289f48) >>Dec 8 14:30:12 node1 kernel: [<f8a64570>] nfsd_dispatch [nfsd] 0x0 >>(0xf4289f60) >>Dec 8 14:30:12 node1 kernel: [<c039ea45>] svc_process [kernel] 0x355 >>(0xf4289f68) >>Dec 8 14:30:12 node1 kernel: [<f8a77804>] nfsd_procedures3 [nfsd] 0x24 >>(0xf4289f8c) >>Dec 8 14:30:12 node1 kernel: [<f8a77118>] nfsd_version3 [nfsd] 0x0 >>(0xf4289f90) >>Dec 8 14:30:12 node1 kernel: [<f8a77138>] nfsd_program [nfsd] 0x0 >>(0xf4289f94) >>Dec 8 14:30:12 node1 kernel: [<f8a6441b>] nfsd [nfsd] 0x1fb (0xf4289fb0) >>Dec 8 14:30:12 node1 kernel: [<f8a64220>] nfsd [nfsd] 0x0 (0xf4289fe0) >>Dec 8 14:30:12 node1 kernel: [<c01077ed>] kernel_thread_helper [kernel] >>0x5 (0xf4289ff0) >>Dec 8 14:30:12 node1 kernel: >>Dec 8 14:30:12 node1 kernel: Code: f0 ff 4f 70 0f 88 c1 15 00 00 b8 00 e0 >>ff ff bb fe ff ff ff >> >> >>Dec 8 14:34:06 node1 kernel: Unable to handle kernel NULL pointer >>dereference at virtual address 000000cc >>Dec 8 14:34:06 node1 kernel: printing eip: >>Dec 8 14:34:06 node1 kernel: c014926c >>Dec 8 14:34:06 node1 kernel: *pde = 2879a001 >>Dec 8 14:34:06 node1 kernel: *pte = 2821c067 >>Dec 8 14:34:06 node1 kernel: Oops: 0000 >>Dec 8 14:34:06 node1 kernel: nfsd ipt_REJECT ipt_multiport ipt_state >>ip_conntrack iptable_filter ip_tables floppy ide-cd sr_mod cdrom dm-mod >>keybdev mousedev hid input usb-uhci ehci-hcd u >>Dec 8 14:34:06 node1 kernel: CPU: 0 >>Dec 8 14:34:06 node1 kernel: EIP: 0060:[<c014926c>] Not tainted Dec >> 8 14:34:06 node1 kernel: EFLAGS: 00010206 >>Dec 8 14:34:06 node1 kernel: >>Dec 8 14:34:06 node1 kernel: EIP is at generic_file_write [kernel] 0x1c >>(2.4.22-1.2199.nptl_ssi_5develsmp) >>Dec 8 14:34:06 node1 kernel: eax: 00000000 ebx: c1f6be78 ecx: >>000001eb edx: ffffffea >>Dec 8 14:34:06 node1 kernel: esi: ffffffff edi: 00000000 ebp: >>c1f6bdfc esp: c1f6bdd4 >>Dec 8 14:34:06 node1 kernel: ds: 0068 es: 0068 ss: 0068 >>Dec 8 14:34:06 node1 kernel: Process cfs_async (pid: 13, >>stackpage=c1f6b000) >>Dec 8 14:34:06 node1 kernel: Stack: c1f6be78 f02157a6 00000000 c1f6be98 >>e171ba80 c1f6a000 000007a6 c1f6be78 >>Dec 8 14:34:06 node1 kernel: ffffffff 00000000 c1f6be20 c0192d45 >>c1f6be78 df723000 000001eb c1f6be98 >>Dec 8 14:34:06 node1 kernel: c1f6a000 ffffffff ffffffff c1f6bef4 >>c0253f44 c1f6be78 df723000 000001eb >>Dec 8 14:34:06 node1 kernel: Call Trace: >>Dec 8 14:34:06 node1 kernel: [<c0192d45>] ext3_file_write [kernel] 0x35 >>(0xc1f6be00) >>Dec 8 14:34:06 node1 kernel: [<c0253f44>] cfsd_write [kernel] 0xe4 >>(0xc1f6be24) >>Dec 8 14:34:06 node1 kernel: [<c0253c11>] cfsd_close [kernel] 0x61 >>(0xc1f6be48) >>Dec 8 14:34:06 node1 kernel: [<c0253e48>] cfsd_read [kernel] 0x108 >>(0xc1f6be60) >>Dec 8 14:34:06 node1 kernel: [<c024f284>] cfs_proc_write [kernel] 0x1c4 >>(0xc1f6bef8) >>Dec 8 14:34:06 node1 kernel: [<c024b134>] cfs_async_handler_write >>[kernel] 0x104 (0xc1f6bf58) >>Dec 8 14:34:06 node1 kernel: [<c02930c6>] nsc_async_daemon [kernel] 0x1b6 >>(0xc1f6bfa4) >>Dec 8 14:34:06 node1 kernel: [<c0292f10>] nsc_async_daemon [kernel] 0x0 >>(0xc1f6bfe0) >>Dec 8 14:34:06 node1 kernel: [<c01077ed>] kernel_thread_helper [kernel] >>0x5 (0xc1f6bff0) >>Dec 8 14:34:06 node1 kernel: >>Dec 8 14:34:06 node1 kernel: Code: 8b 80 cc 00 00 00 8b 78 20 0f 88 a8 00 >>00 00 b9 00 e0 ff ff >> >> >> >>>I built the latest SSI kernel from CVS OPENSSI-RH branch using the >> >>Fedora >> >>>Core base kernel from srpms OPENSSI-FC branch. >>> >>>There is a critical ext3 bug. After reboot I lost >>>/boot/initrd-2.4.22...develsmp.img when I umount some other partition on >> >>the >> >> >> >>------------------------------------------------------- >>SF email is sponsored by - The IT Product Guide >>Read honest & candid reviews on hundreds of IT Products from real users. >>Discover which products truly live up to the hype. Start reading now. >>http://productguide.itmanagersjournal.com/ >>_______________________________________________ >>ssic-linux-devel mailing list >>ssi...@li... >>https://lists.sourceforge.net/lists/listinfo/ssic-linux-devel >> > > > >------------------------------------------------------- >SF email is sponsored by - The IT Product Guide >Read honest & candid reviews on hundreds of IT Products from real users. >Discover which products truly live up to the hype. Start reading now. >http://productguide.itmanagersjournal.com/ >_______________________________________________ >ssic-linux-devel mailing list >ssi...@li... >https://lists.sourceforge.net/lists/listinfo/ssic-linux-devel |