[Jfs-discussion] filesystem corruption

[James C. <clo...@jh...>]

I got some corruption with a post 2.6.13 kernel (shortly after the jfs
changes where merged).

I didn't notice the oops at first -- except that the:

  mount -n -o remount,rw

was stuck in text.lock (IIRC; text.something in any case).

In addition to the remount getting stuck, sync(1) and umount(8) also
got stuck, so I was forced to do an emergency sync/sync/umount/boot.

I dropped back to a kernel closer to 2.6.13 as released and that is
working fine, AFAICT.

The oops is below.

The symptom is mostly in the form of meta-data corruption for anything
that was changed under that kernel.  Several binaries ended up with
0666 rather than 0755 perms, as an example.  /etc/ld.so.conf was empty
(but easily recoverable as Gentoo frequently auto-gens it based on
what packages are installed; in fact that frequent auto-generation is
probably why it ended up empty).  

I suspect the emerge process copies the files into the filesystem such
that they are opened with 666 perms and then chmod(2)ed to the perms
they had in the staging install tree, which suggests that the failure
is only with meta-data changes.

I still have that kernel installed, so I can do some more debugging if
helpful, but only minor stuff as I need to boot with init=/bin/bash to
keep the box usable....

,----
| [4294746.121000] BUG at fs/jfs/jfs_logmgr.c:1622 assert(list_empty(&log->cqueue))
| [4294746.121000] ------------[ cut here ]------------
| [4294746.121000] kernel BUG at fs/jfs/jfs_logmgr.c:1622!
| [4294746.121000] invalid operand: 0000 [#1]
| [4294746.121000] Modules linked in: i8k snd_pcm_oss snd_mixer_oss
|                                     snd_maestro3 snd_ac97_codec
|                                     snd_ac97_bus snd_pcm snd_timer
|                                     snd soundcore snd_page_alloc
|                                     uhci_hcd e100
| [4294746.121000] CPU:    0
| [4294746.121000] EIP:    0060:[<c0219f12>]    Not tainted VLI
| [4294746.121000] EFLAGS: 00010286   (2.6.13-lug2) 
| [4294746.121000] EIP is at jfs_flush_journal+0x1c2/0x250
| [4294746.121000] eax: 00000058   ebx: 000000c8   ecx: c04fb22c   edx: c04fb22c
| [4294746.121000] esi: df8aa354   edi: df8aa2c0   ebp: debebeac   esp: debebe3c
| [4294746.121000] ds: 007b   es: 007b   ss: 0068
| [4294746.121000] Process mount (pid: 2246, threadinfo=debea000 task=df75f040)
| [4294746.121000] Stack: c047124d c047167c 00000656 c0471663 df8aa2c0 df8aa32c dee7c000 00000000 
| [4294746.121000]        00000002 c02362be c1721200 dee7c000 debebebc c01fe15d 00000000 00000001 
| [4294746.121000]        c15601e0 ffffffff debebec8 00000000 00000000 00000000 00000000 00000000 
| [4294746.121000] Call Trace:
| [4294746.121000]  [<c01034ba>] show_stack+0x7a/0x90
| [4294746.121000]  [<c0103639>] show_registers+0x149/0x1c0
| [4294746.121000]  [<c010382b>] die+0xbb/0x140
| [4294746.121000]  [<c0103931>] do_trap+0x81/0xc0
| [4294746.121000]  [<c0103ba5>] do_invalid_op+0xa5/0xb0
| [4294746.121000]  [<c0103133>] error_code+0x4f/0x54
| [4294746.121000]  [<c0202430>] jfs_umount_rw+0x20/0x70
| [4294746.121000]  [<c01fe49e>] jfs_remount+0x13e/0x170
| [4294746.121000]  [<c015ff0b>] do_remount_sb+0xcb/0x150
| [4294746.121000]  [<c0174c98>] do_remount+0x88/0xe0
| [4294746.121000]  [<c01755bd>] do_mount+0x18d/0x1c0
| [4294746.121000]  [<c0175928>] sys_mount+0x68/0xa0
| [4294746.121000]  [<c0102ebf>] sysenter_past_esp+0x54/0x75
| [4294746.121000]  Badness in do_exit at kernel/exit.c:787
| [4294746.180000]  [<c01034e7>] dump_stack+0x17/0x20
| [4294746.183000]  [<c011e603>] do_exit+0x353/0x360
| [4294746.185000]  [<c01038a4>] die+0x134/0x140
| [4294746.186000]  [<c0103931>] do_trap+0x81/0xc0
| [4294746.188000]  [<c0103ba5>] do_invalid_op+0xa5/0xb0
| [4294746.190000]  [<c0103133>] error_code+0x4f/0x54
| [4294746.191000]  [<c0202430>] jfs_umount_rw+0x20/0x70
| [4294746.193000]  [<c01fe49e>] jfs_remount+0x13e/0x170
| [4294746.195000]  [<c015ff0b>] do_remount_sb+0xcb/0x150
| [4294746.196000]  [<c0174c98>] do_remount+0x88/0xe0
| [4294746.198000]  [<c01755bd>] do_mount+0x18d/0x1c0
| [4294746.200000]  [<c0175928>] sys_mount+0x68/0xa0
| [4294746.201000]  [<c0102ebf>] sysenter_past_esp+0x54/0x75
`----

-JimC
-- 
James H. Cloos, Jr. <cl...@jh...>