Here is fsck output from my large volume (84TB/76.4 TiB). I suffered a power outage and this volume was actually almost never accessed and hadn't been accessed in many hours as the disks were even asleep when it occured but with a small number of files on it even and only 5 TiB used logredo failed:

fsck.jfs version 1.1.15, 04-Mar-2011
processing started: 3/4/2012 22:59:27
Using default parameter: -p
The current device is:  /dev/sde1
Open(...READ/WRITE EXCLUSIVE...) returned rc = 0
Primary superblock is valid.
The type of file system for the device is JFS.
Block size in bytes:  4096
Filesystem size in blocks:  20507808768
**Phase 0 - Replay Journal Log
LOGREDO:  Log record for Sync Point at:    0x0429a28
LOGREDO:  Beginning to update the Inode Allocation Map.
LOGREDO:  Done updating the Inode Allocation Map.
LOGREDO:  Beginning to update the Block Map.
LOGREDO:  Invalid leaf index detected while updating dmap page.
LOGREDO:  Error rebuilding DMap page (k=(d) 0, j=(d) 398, i=(d) 660).
LOGREDO:  Write Block Map control page failed in UpdateMaps().
LOGREDO:  Unable to update map(s).
logredo failed (rc=-220).  fsck continuing.
**Phase 1 - Check Blocks, Files/Directories, and  Directory Entries
**Phase 2 - Count links
**Phase 3 - Duplicate Block Rescan and Directory Connectedness
**Phase 4 - Report Problems
**Phase 5 - Check Connectivity
**Phase 6 - Perform Approved Corrections
**Phase 7 - Rebuild File/Directory Allocation Maps
**Phase 8 - Rebuild Disk Allocation Maps
**Phase 9 - Reformat File System Log
logformat returned rc = 0
Filesystem Summary:
Blocks in use for inodes:  452
Inode count:  3616
File count:  3391
Directory count:  38
Block count:  20507808768
Free block count:  19153345377
82031235072 kilobytes total disk space.
      891 kilobytes in 38 directories.
5405194747 kilobytes in 3391 user files.
        0 kilobytes in extended attributes
        0 kilobytes in access control lists
 12659708 kilobytes reserved for system use.
76613381508 kilobytes are available for use.
Filesystem is clean.
All observed inconsistencies have been repaired.
Filesystem has been marked clean.
**** Filesystem was modified. ****
processing terminated:  3/4/2012 23:00:54  with return code: 0  exit code: 0.


Fsck took about 1.5 minutes to run. Guessing it was quick cause its got a very small number of inodes on it.


On 05/01/2011 04:56 AM, Sandon Van Ness wrote:
Damn, I wonder why I still had problems =(

On 04/30/2011 04:07 PM, Tim Nufire wrote:
Dave & Sandon,

I just had 2 servers crash. Each of them had 3x 24TB JFS volumes so I got a chance to test the latest patch.... And it worked!!! 

Although on further inspection 3 of the 6 volumes suffered minor damage so the news is not all good. I've seen problems like this on servers that never crashed so it's not clear these problems were caused by the crash. In particular, I find problems in the File/Directory Allocation and Disk Allocation Maps on a regular basis :-/ The corrupt file system objects (FF696078, FF8660023 and FF16186301) are more likely a result of the crash because our application writes new files with the .tmp extension and then removes the extension when the files has been fully written to disk.

Here's the jfs_fsck output showing that the journal replay succeeded on all 6 volumes, something I have not seen since my volumes crossed the 16TB threshold:

time jfs_fsck -v /dev/md10
jfs_fsck version 1.1.15.patched.2011.03.07, 04-Mar-2011
processing started: 4/27/2011 17:39:50
Using default parameter: -p
The current device is:  /dev/md10
Open(...READ/WRITE EXCLUSIVE...) returned rc = 0
Primary superblock is valid.
The type of file system for the device is JFS.
Block size in bytes:  4096
Filesystem size in blocks:  6342544000
**Phase 0 - Replay Journal Log
LOGREDO:  Log record for Sync Point at:    0x026d13a8
LOGREDO:  Beginning to update the Inode Allocation Map.
LOGREDO:  Done updating the Inode Allocation Map.
LOGREDO:  Beginning to update the Block Map.
LOGREDO:  Done updating the Block Map.
LOGREDO:  End of log found at logend = 0x02703ff8
LOGREDO:  Synch point record number:  0x026d13a8
LOGREDO:  Synch point record address:  0x0266a500
LOGREDO:  Number of log records:    (d) 5670
LOGREDO:  Number of Do blocks:    (d) 1149
LOGREDO:  Number of NoDo blocks:    (d) 136
logredo returned rc = 0
Filesystem is clean.
All observed inconsistencies have been repaired.
Filesystem has been marked clean.
**** Filesystem was modified. ****
processing terminated:  4/27/2011 17:42:43  with return code: 0  exit code: 0.

real    2m53.388s
user    0m2.280s
sys     0m5.184s

time jfs_fsck -v /dev/md11
jfs_fsck version 1.1.15.patched.2011.03.07, 04-Mar-2011
processing started: 4/27/2011 17:39:57
Using default parameter: -p
The current device is:  /dev/md11
Open(...READ/WRITE EXCLUSIVE...) returned rc = 0
Primary superblock is valid.
The type of file system for the device is JFS.
Block size in bytes:  4096
Filesystem size in blocks:  6342544000
**Phase 0 - Replay Journal Log
LOGREDO:  Log record for Sync Point at:    0x061145c0
LOGREDO:  Log record for Sync Point at:    0x06094580
LOGREDO:  Beginning to update the Inode Allocation Map.
LOGREDO:  Done updating the Inode Allocation Map.
LOGREDO:  Beginning to update the Block Map.
LOGREDO:  Done updating the Block Map.
LOGREDO:  End of log found at logend = 0x0611bfd4
LOGREDO:  Synch point record number:  0x061145c0
LOGREDO:  Synch point record address:  0x06063464
LOGREDO:  Number of log records:    (d) 5720
LOGREDO:  Number of Do blocks:    (d) 1035
LOGREDO:  Number of NoDo blocks:    (d) 48
logredo returned rc = 0
Filesystem is clean.
All observed inconsistencies have been repaired.
Filesystem has been marked clean.
**** Filesystem was modified. ****
processing terminated:  4/27/2011 17:45:29  with return code: 0  exit code: 0.

real    5m32.306s
user    0m2.300s
sys     0m4.836s

time jfs_fsck -v /dev/md12
jfs_fsck version 1.1.15.patched.2011.03.07, 04-Mar-2011
processing started: 4/27/2011 17:40:03
Using default parameter: -p
The current device is:  /dev/md12
Open(...READ/WRITE EXCLUSIVE...) returned rc = 0
Primary superblock is valid.
The type of file system for the device is JFS.
Block size in bytes:  4096
Filesystem size in blocks:  6342544000
**Phase 0 - Replay Journal Log
LOGREDO:  Log record for Sync Point at:    0x07c5f9b0
LOGREDO:  Beginning to update the Inode Allocation Map.
LOGREDO:  Done updating the Inode Allocation Map.
LOGREDO:  Beginning to update the Block Map.
LOGREDO:  Done updating the Block Map.
LOGREDO:  End of log found at logend = 0x07cd50b8
LOGREDO:  Synch point record number:  0x07c5f9b0
LOGREDO:  Synch point record address:  0x07be30f8
LOGREDO:  Number of log records:    (d) 9043
LOGREDO:  Number of Do blocks:    (d) 1138
LOGREDO:  Number of NoDo blocks:    (d) 198
logredo returned rc = 0
Filesystem is clean.
All observed inconsistencies have been repaired.
Filesystem has been marked clean.
**** Filesystem was modified. ****
processing terminated:  4/27/2011 17:42:57  with return code: 0  exit code: 0.

real    2m53.897s
user    0m2.284s
sys     0m5.116s

Here's the output for the second sever that crashed:

time jfs_fsck -v /dev/md10
jfs_fsck version 1.1.15.patched.2011.03.07, 04-Mar-2011
processing started: 4/27/2011 17:21:59
Using default parameter: -p
The current device is:  /dev/md10
Open(...READ/WRITE EXCLUSIVE...) returned rc = 0
Primary superblock is valid.
The type of file system for the device is JFS.
Block size in bytes:  4096
Filesystem size in blocks:  6342544000
**Phase 0 - Replay Journal Log
LOGREDO:  Log record for Sync Point at:    0x0c61308
LOGREDO:  Beginning to update the Inode Allocation Map.
LOGREDO:  Done updating the Inode Allocation Map.
LOGREDO:  Beginning to update the Block Map.
LOGREDO:  Done updating the Block Map.
LOGREDO:  End of log found at logend = 0x0c7719c
LOGREDO:  Synch point record number:  0x0c61308
LOGREDO:  Synch point record address:  0x0c00e40
LOGREDO:  Number of log records:    (d) 4038
LOGREDO:  Number of Do blocks:    (d) 530
LOGREDO:  Number of NoDo blocks:    (d) 51
logredo returned rc = 0
Filesystem is clean.
All observed inconsistencies have been repaired.
Filesystem has been marked clean.
**** Filesystem was modified. ****
processing terminated:  4/27/2011 17:24:23  with return code: 0  exit code: 0.

real    2m24.351s
user    0m2.064s
sys     0m4.676s

time jfs_fsck -v /dev/md11
jfs_fsck version 1.1.15.patched.2011.03.07, 04-Mar-2011
processing started: 4/27/2011 17:25:20
Using default parameter: -p
The current device is:  /dev/md11
Open(...READ/WRITE EXCLUSIVE...) returned rc = 0
Primary superblock is valid.
The type of file system for the device is JFS.
Block size in bytes:  4096
Filesystem size in blocks:  6342544000
**Phase 0 - Replay Journal Log
LOGREDO:  Log record for Sync Point at:    0x03b72128
LOGREDO:  Beginning to update the Inode Allocation Map.
LOGREDO:  Done updating the Inode Allocation Map.
LOGREDO:  Beginning to update the Block Map.
LOGREDO:  Done updating the Block Map.
LOGREDO:  End of log found at logend = 0x03b7bfcc
LOGREDO:  Synch point record number:  0x03b72128
LOGREDO:  Synch point record address:  0x03b4c39c
LOGREDO:  Number of log records:    (d) 1786
LOGREDO:  Number of Do blocks:    (d) 58
LOGREDO:  Number of NoDo blocks:    (d) 22
logredo returned rc = 0
Filesystem is clean.
All observed inconsistencies have been repaired.
Filesystem has been marked clean.
**** Filesystem was modified. ****
processing terminated:  4/27/2011 17:27:34  with return code: 0  exit code: 0.

real    2m13.949s
user    0m2.160s
sys     0m4.608s

time jfs_fsck -v /dev/md12
jfs_fsck version 1.1.15.patched.2011.03.07, 04-Mar-2011
processing started: 4/27/2011 17:26:00
Using default parameter: -p
The current device is:  /dev/md12
Open(...READ/WRITE EXCLUSIVE...) returned rc = 0
Primary superblock is valid.
The type of file system for the device is JFS.
Block size in bytes:  4096
Filesystem size in blocks:  6342544000
**Phase 0 - Replay Journal Log
LOGREDO:  Log record for Sync Point at:    0x03410648
LOGREDO:  Beginning to update the Inode Allocation Map.
LOGREDO:  Done updating the Inode Allocation Map.
LOGREDO:  Beginning to update the Block Map.
LOGREDO:  Done updating the Block Map.
LOGREDO:  End of log found at logend = 0x0342efa0
LOGREDO:  Synch point record number:  0x03410648
LOGREDO:  Synch point record address:  0x033ea62c
LOGREDO:  Number of log records:    (d) 2468
LOGREDO:  Number of Do blocks:    (d) 340
LOGREDO:  Number of NoDo blocks:    (d) 37
logredo returned rc = 0
Filesystem is clean.
All observed inconsistencies have been repaired.
Filesystem has been marked clean.
**** Filesystem was modified. ****
processing terminated:  4/27/2011 17:28:37  with return code: 0  exit code: 0.

real    2m37.251s
user    0m2.080s
sys     0m4.680s

Here's the output showing the 3 volumes with corruption..

/sbin/jfs_fsck -n -v /dev/md12 
/sbin/jfs_fsck version 1.1.15.patched.2011.03.07, 04-Mar-2011
processing started: 4/27/2011 21:17:42

FSCK  Device /dev/md12 is currently mounted READ ONLY.
The current device is:  /dev/md12
Open(...READONLY...) returned rc = 0
Primary superblock is valid.
The type of file system for the device is JFS.
Block size in bytes:  4096
Filesystem size in blocks:  6342544000
**Phase 1 - Check Blocks, Files/Directories, and  Directory Entries
**Phase 2 - Count links
**Phase 3 - Duplicate Block Rescan and Directory Connectedness
**Phase 4 - Report Problems
**Phase 5 - Check Connectivity
**Phase 6 - Perform Approved Corrections
**Phase 7 - Verify File/Directory Allocation Maps
Discrepancies detected in the Free Inode List for Allocation Group F290. (3)
Inode Allocation Group F290 is inconsistent.
Discrepancies detected in the Free Inode List for Allocation Group F1324. (3)
Inode Allocation Group F1324 is inconsistent.
Discrepancies detected in the Free Inode List for Allocation Group F3092. (3)
Inode Allocation Group F3092 is inconsistent.
The Free Inode List is inconsistent for Allocation Group F21.
Errors detected in the Fileset File/Directory Allocation Map. (F)
**Phase 8 - Verify Disk Allocation Maps
Filesystem Summary:
Blocks in use for inodes:  2383556
Inode count:  19068448
File count:  16482719
Directory count:  1425986
Block count:  6342544000
Free block count:  567114901
25370176000 kilobytes total disk space.
  8890773 kilobytes in 1425986 directories.
23088220683 kilobytes in 16482719 user files.
        0 kilobytes in extended attributes
        0 kilobytes in access control lists
 22386486 kilobytes reserved for system use.
2268459604 kilobytes are available for use.
File system checked READ ONLY.
Filesystem is dirty.
Filesystem is dirty but is marked clean.  In its present state,
the results of accessing /dev/md12 (except by this utility) are undefined.
processing terminated:  4/28/2011 10:31:53  with return code: 0  exit code: 4.
/sbin/jfs_fsck died with exit status 4

The following 2 volumes are from the second server...

/sbin/jfs_fsck -n -v /dev/md11 
/sbin/jfs_fsck version 1.1.15.patched.2011.03.07, 04-Mar-2011
processing started: 4/27/2011 21:18:40

FSCK  Device /dev/md11 is currently mounted READ ONLY.
The current device is:  /dev/md11
Open(...READONLY...) returned rc = 0
Primary superblock is valid.
The type of file system for the device is JFS.
Block size in bytes:  4096
Filesystem size in blocks:  6342544000
**Phase 1 - Check Blocks, Files/Directories, and  Directory Entries
File system object FF696078 has corrupt data (10).
File system object FF8660023 has corrupt data (10).
**Phase 2 - Count links
**Phase 3 - Duplicate Block Rescan and Directory Connectedness
**Phase 4 - Report Problems
File system object FF696078 is linked as: /20110427/f1/f180a9dafd8d062123f00f1c/008/bzff21f180a9dafd8d062123f00f1c0000000000008477201104272327245000001190592.bzff.1303946848137.tmp
cannot repair the data format error(s) in this file.
cannot repair FF696078.
File system object FF8660023 is linked as: /20110427/d0/d0d082a6eb003e352fe80a1a/001/bzff21d0d082a6eb003e352fe80a1a0000000000001396201104272327480000001190592.bzff.1303946869895.tmp
cannot repair the data format error(s) in this file.
cannot repair FF8660023.
**Phase 5 - Check Connectivity
**Phase 6 - Perform Approved Corrections
**Phase 7 - Verify File/Directory Allocation Maps
**Phase 8 - Verify Disk Allocation Maps
179 consecutive blocks observed available but pmap (222823, 184, 4) indicates they are allocated.
Incorrect number free detected in dmap 222823.
Incorrect internal (0) value detected in DM page 222823.
Incorrect internal (3) value detected in DM page 222823.
Incorrect internal (16) value detected in DM page 222823.
Incorrect internal (67) value detected in DM page 222823.
Incorrect internal (68) value detected in DM page 222823.
Incorrect leaf (269) value detected in DM page 222823.
Incorrect leaf (270) value detected in DM page 222823.
Incorrect leaf (271) value detected in DM page 222823.
Incorrect leaf (273) value detected in DM page 222823.
Incorrect leaf (274) value detected in DM page 222823.
256 consecutive blocks observed available but pmap (222824, 242, 14) indicates they are allocated.
Incorrect number free detected in dmap 222824.
Incorrect internal (0) value detected in DM page 222824.
Incorrect internal (4) value detected in DM page 222824.
Incorrect internal (20) value detected in DM page 222824.
Incorrect internal (81) value detected in DM page 222824.
Incorrect internal (82) value detected in DM page 222824.
Incorrect internal (83) value detected in DM page 222824.
Incorrect leaf (327) value detected in DM page 222824.
Incorrect leaf (328) value detected in DM page 222824.
Incorrect leaf (329) value detected in DM page 222824.
Incorrect leaf (333) value detected in DM page 222824.
Incorrect leaf (335) value detected in DM page 222824.
1 consecutive blocks observed available but pmap (222826, 59, 24) indicates they are allocated.
258 consecutive blocks observed available but pmap (222826, 100, 18) indicates they are allocated.
Incorrect number free detected in dmap 222826.
Incorrect internal (0) value detected in DM page 222826.
Incorrect internal (1) value detected in DM page 222826.
Incorrect internal (2) value detected in DM page 222826.
Incorrect internal (8) value detected in DM page 222826.
Incorrect internal (11) value detected in DM page 222826.
Incorrect internal (35) value detected in DM page 222826.
Incorrect internal (46) value detected in DM page 222826.
Incorrect internal (47) value detected in DM page 222826.
Incorrect internal (48) value detected in DM page 222826.
Incorrect leaf (144) value detected in DM page 222826.
Incorrect leaf (185) value detected in DM page 222826.
Incorrect leaf (186) value detected in DM page 222826.
Incorrect leaf (187) value detected in DM page 222826.
Incorrect leaf (189) value detected in DM page 222826.
Incorrect leaf (193) value detected in DM page 222826.
256 consecutive blocks observed available but pmap (222827, 37, 3) indicates they are allocated.
105 consecutive blocks observed available but pmap (222827, 252, 23) indicates they are allocated.
Incorrect number free detected in dmap 222827.
Incorrect internal (0) value detected in DM page 222827.
Incorrect internal (1) value detected in DM page 222827.
Incorrect internal (4) value detected in DM page 222827.
Incorrect internal (7) value detected in DM page 222827.
Incorrect internal (20) value detected in DM page 222827.
Incorrect internal (30) value detected in DM page 222827.
Incorrect internal (31) value detected in DM page 222827.
Incorrect internal (32) value detected in DM page 222827.
Incorrect internal (84) value detected in DM page 222827.
Incorrect leaf (122) value detected in DM page 222827.
Incorrect leaf (123) value detected in DM page 222827.
Incorrect leaf (125) value detected in DM page 222827.
Incorrect leaf (129) value detected in DM page 222827.
Incorrect leaf (130) value detected in DM page 222827.
Incorrect leaf (337) value detected in DM page 222827.
Incorrect leaf (338) value detected in DM page 222827.
Incorrect leaf (339) value detected in DM page 222827.
85 consecutive blocks observed available but pmap (222828, 0, 0) indicates they are allocated.
24 consecutive blocks observed available but pmap (222828, 10, 21) indicates they are allocated.
19 consecutive blocks observed available but pmap (222828, 11, 24) indicates they are allocated.
23 consecutive blocks observed available but pmap (222828, 44, 14) indicates they are allocated.
Incorrect number free detected in dmap 222828.
Incorrect internal (0) value detected in DM page 222828.
Incorrect internal (1) value detected in DM page 222828.
Incorrect internal (5) value detected in DM page 222828.
Incorrect internal (7) value detected in DM page 222828.
Incorrect internal (21) value detected in DM page 222828.
Incorrect internal (23) value detected in DM page 222828.
Incorrect internal (24) value detected in DM page 222828.
Incorrect internal (32) value detected in DM page 222828.
Incorrect leaf (85) value detected in DM page 222828.
Incorrect leaf (87) value detected in DM page 222828.
Incorrect leaf (95) value detected in DM page 222828.
Incorrect leaf (96) value detected in DM page 222828.
Incorrect leaf (97) value detected in DM page 222828.
Incorrect leaf (129) value detected in DM page 222828.
Incorrect leaf (130) value detected in DM page 222828.
1 consecutive blocks observed available but pmap (222829, 245, 7) indicates they are allocated.
Incorrect number free detected in dmap 222829.
Incorrect internal (0) value detected in DM page 222829.
Incorrect internal (4) value detected in DM page 222829.
Incorrect internal (20) value detected in DM page 222829.
Incorrect internal (82) value detected in DM page 222829.
Incorrect leaf (330) value detected in DM page 222829.
1 consecutive blocks observed available but pmap (222830, 5, 22) indicates they are allocated.
1 consecutive blocks observed available but pmap (222830, 5, 24) indicates they are allocated.
1 consecutive blocks observed available but pmap (222830, 5, 26) indicates they are allocated.
1 consecutive blocks observed available but pmap (222830, 5, 28) indicates they are allocated.
1 consecutive blocks observed available but pmap (222830, 5, 30) indicates they are allocated.
1 consecutive blocks observed available but pmap (222830, 6, 0) indicates they are allocated.
55 consecutive blocks observed available but pmap (222830, 6, 2) indicates they are allocated.
13 consecutive blocks observed available but pmap (222830, 31, 25) indicates they are allocated.
3 consecutive blocks observed available but pmap (222830, 32, 7) indicates they are allocated.
21 consecutive blocks observed available but pmap (222830, 32, 11) indicates they are allocated.
10 consecutive blocks observed available but pmap (222830, 33, 1) indicates they are allocated.
29 consecutive blocks observed available but pmap (222830, 33, 12) indicates they are allocated.
1 consecutive blocks observed available but pmap (222830, 34, 11) indicates they are allocated.
39 consecutive blocks observed available but pmap (222830, 34, 29) indicates they are allocated.
7 consecutive blocks observed available but pmap (222830, 36, 5) indicates they are allocated.
328 consecutive blocks observed available but pmap (222830, 44, 13) indicates they are allocated.
26 consecutive blocks observed available but pmap (222830, 142, 22) indicates they are allocated.
4 consecutive blocks observed available but pmap (222830, 144, 14) indicates they are allocated.
2 consecutive blocks observed available but pmap (222830, 144, 24) indicates they are allocated.
3 consecutive blocks observed available but pmap (222830, 151, 26) indicates they are allocated.
4 consecutive blocks observed available but pmap (222830, 152, 0) indicates they are allocated.
37 consecutive blocks observed available but pmap (222830, 152, 7) indicates they are allocated.
Incorrect number free detected in dmap 222830.
Incorrect internal (0) value detected in DM page 222830.
Incorrect internal (1) value detected in DM page 222830.
Incorrect internal (3) value detected in DM page 222830.
Incorrect internal (5) value detected in DM page 222830.
Incorrect internal (6) value detected in DM page 222830.
Incorrect internal (7) value detected in DM page 222830.
Incorrect internal (8) value detected in DM page 222830.
Incorrect internal (13) value detected in DM page 222830.
Incorrect internal (14) value detected in DM page 222830.
Incorrect internal (22) value detected in DM page 222830.
Incorrect internal (28) value detected in DM page 222830.
Incorrect internal (29) value detected in DM page 222830.
Incorrect internal (30) value detected in DM page 222830.
Incorrect internal (32) value detected in DM page 222830.
Incorrect internal (33) value detected in DM page 222830.
Incorrect internal (34) value detected in DM page 222830.
Incorrect internal (56) value detected in DM page 222830.
Incorrect internal (57) value detected in DM page 222830.
Incorrect internal (58) value detected in DM page 222830.
Incorrect internal (59) value detected in DM page 222830.
Incorrect leaf (90) value detected in DM page 222830.
Incorrect leaf (91) value detected in DM page 222830.
Incorrect leaf (92) value detected in DM page 222830.
Incorrect leaf (116) value detected in DM page 222830.
Incorrect leaf (117) value detected in DM page 222830.
Incorrect leaf (118) value detected in DM page 222830.
Incorrect leaf (119) value detected in DM page 222830.
Incorrect leaf (120) value detected in DM page 222830.
Incorrect leaf (121) value detected in DM page 222830.
Incorrect leaf (129) value detected in DM page 222830.
Incorrect leaf (130) value detected in DM page 222830.
Incorrect leaf (131) value detected in DM page 222830.
Incorrect leaf (133) value detected in DM page 222830.
Incorrect leaf (137) value detected in DM page 222830.
Incorrect leaf (139) value detected in DM page 222830.
Incorrect leaf (227) value detected in DM page 222830.
Incorrect leaf (228) value detected in DM page 222830.
Incorrect leaf (229) value detected in DM page 222830.
Incorrect leaf (236) value detected in DM page 222830.
Incorrect leaf (237) value detected in DM page 222830.
Incorrect leaf (238) value detected in DM page 222830.
256 consecutive blocks observed available but pmap (222832, 19, 4) indicates they are allocated.
Incorrect number free detected in dmap 222832.
Incorrect internal (0) value detected in DM page 222832.
Incorrect internal (1) value detected in DM page 222832.
Incorrect internal (6) value detected in DM page 222832.
Incorrect internal (25) value detected in DM page 222832.
Incorrect internal (26) value detected in DM page 222832.
Incorrect internal (27) value detected in DM page 222832.
Incorrect leaf (104) value detected in DM page 222832.
Incorrect leaf (105) value detected in DM page 222832.
Incorrect leaf (109) value detected in DM page 222832.
Incorrect leaf (111) value detected in DM page 222832.
Incorrect leaf (112) value detected in DM page 222832.
253 consecutive blocks observed available but pmap (222833, 71, 29) indicates they are allocated.
Incorrect number free detected in dmap 222833.
Incorrect internal (0) value detected in DM page 222833.
Incorrect internal (2) value detected in DM page 222833.
Incorrect internal (9) value detected in DM page 222833.
Incorrect internal (38) value detected in DM page 222833.
Incorrect internal (39) value detected in DM page 222833.
Incorrect internal (40) value detected in DM page 222833.
Incorrect leaf (156) value detected in DM page 222833.
Incorrect leaf (157) value detected in DM page 222833.
Incorrect leaf (164) value detected in DM page 222833.
Incorrect internal (14) value detected in L0 page 217.
Incorrect internal (59) value detected in L0 page 217.
Incorrect internal (60) value detected in L0 page 217.
Incorrect internal (238) value detected in L0 page 217.
Incorrect internal (239) value detected in L0 page 217.
Incorrect internal (240) value detected in L0 page 217.
Incorrect internal (241) value detected in L0 page 217.
Incorrect leaf (956) value detected in L0 page 217.
Incorrect leaf (957) value detected in L0 page 217.
Incorrect leaf (959) value detected in L0 page 217.
Incorrect leaf (960) value detected in L0 page 217.
Incorrect leaf (961) value detected in L0 page 217.
Incorrect leaf (962) value detected in L0 page 217.
Incorrect leaf (963) value detected in L0 page 217.
Incorrect leaf (965) value detected in L0 page 217.
Incorrect leaf (966) value detected in L0 page 217.
1 consecutive blocks observed available but pmap (442742, 83, 4) indicates they are allocated.
1 consecutive blocks observed available but pmap (442742, 83, 7) indicates they are allocated.
Incorrect number free detected in dmap 442742.
114 consecutive blocks observed available but pmap (453114, 248, 7) indicates they are allocated.
Incorrect number free detected in dmap 453114.
Incorrect internal (0) value detected in DM page 453114.
Incorrect internal (4) value detected in DM page 453114.
Incorrect internal (20) value detected in DM page 453114.
Incorrect internal (83) value detected in DM page 453114.
Incorrect leaf (333) value detected in DM page 453114.
Incorrect leaf (334) value detected in DM page 453114.
Incorrect leaf (335) value detected in DM page 453114.
Incorrect leaf (336) value detected in DM page 453114.
1 consecutive blocks observed available but pmap (453115, 132, 2) indicates they are allocated.
1 consecutive blocks observed available but pmap (453115, 132, 8) indicates they are allocated.
1 consecutive blocks observed available but pmap (453115, 132, 11) indicates they are allocated.
1 consecutive blocks observed available but pmap (453115, 132, 13) indicates they are allocated.
1 consecutive blocks observed available but pmap (453115, 132, 15) indicates they are allocated.
1 consecutive blocks observed available but pmap (453115, 132, 17) indicates they are allocated.
81 consecutive blocks observed available but pmap (453115, 164, 26) indicates they are allocated.
175 consecutive blocks observed available but pmap (453115, 167, 12) indicates they are allocated.
Incorrect number free detected in dmap 453115.
Incorrect internal (0) value detected in DM page 453115.
Incorrect internal (3) value detected in DM page 453115.
Incorrect internal (13) value detected in DM page 453115.
Incorrect internal (15) value detected in DM page 453115.
Incorrect internal (54) value detected in DM page 453115.
Incorrect internal (62) value detected in DM page 453115.
Incorrect internal (63) value detected in DM page 453115.
Incorrect internal (64) value detected in DM page 453115.
Incorrect leaf (217) value detected in DM page 453115.
Incorrect leaf (249) value detected in DM page 453115.
Incorrect leaf (250) value detected in DM page 453115.
Incorrect leaf (251) value detected in DM page 453115.
Incorrect leaf (252) value detected in DM page 453115.
Incorrect leaf (253) value detected in DM page 453115.
Incorrect leaf (257) value detected in DM page 453115.
6 consecutive blocks observed available but pmap (453116, 32, 7) indicates they are allocated.
1 consecutive blocks observed available but pmap (453116, 129, 12) indicates they are allocated.
58 consecutive blocks observed available but pmap (453116, 133, 12) indicates they are allocated.
120 consecutive blocks observed available but pmap (453116, 135, 7) indicates they are allocated.
24 consecutive blocks observed available but pmap (453116, 149, 11) indicates they are allocated.
37 consecutive blocks observed available but pmap (453116, 150, 6) indicates they are allocated.
13 consecutive blocks observed available but pmap (453116, 159, 11) indicates they are allocated.
7 consecutive blocks observed available but pmap (453116, 160, 31) indicates they are allocated.
122 consecutive blocks observed available but pmap (453116, 244, 3) indicates they are allocated.
Incorrect number free detected in dmap 453116.
Incorrect internal (0) value detected in DM page 453116.
Incorrect internal (1) value detected in DM page 453116.
Incorrect internal (3) value detected in DM page 453116.
Incorrect internal (4) value detected in DM page 453116.
Incorrect internal (7) value detected in DM page 453116.
Incorrect internal (13) value detected in DM page 453116.
Incorrect internal (14) value detected in DM page 453116.
Incorrect internal (15) value detected in DM page 453116.
Incorrect internal (20) value detected in DM page 453116.
Incorrect internal (29) value detected in DM page 453116.
Incorrect internal (53) value detected in DM page 453116.
Incorrect internal (54) value detected in DM page 453116.
Incorrect internal (55) value detected in DM page 453116.
Incorrect internal (58) value detected in DM page 453116.
Incorrect internal (60) value detected in DM page 453116.
Incorrect internal (61) value detected in DM page 453116.
Incorrect internal (82) value detected in DM page 453116.
Incorrect leaf (117) value detected in DM page 453116.
Incorrect leaf (214) value detected in DM page 453116.
Incorrect leaf (218) value detected in DM page 453116.
Incorrect leaf (219) value detected in DM page 453116.
Incorrect leaf (220) value detected in DM page 453116.
Incorrect leaf (221) value detected in DM page 453116.
Incorrect leaf (223) value detected in DM page 453116.
Incorrect leaf (234) value detected in DM page 453116.
Incorrect leaf (235) value detected in DM page 453116.
Incorrect leaf (236) value detected in DM page 453116.
Incorrect leaf (244) value detected in DM page 453116.
Incorrect leaf (245) value detected in DM page 453116.
Incorrect leaf (246) value detected in DM page 453116.
Incorrect leaf (329) value detected in DM page 453116.
Incorrect leaf (330) value detected in DM page 453116.
Incorrect leaf (331) value detected in DM page 453116.
Incorrect leaf (332) value detected in DM page 453116.
9 consecutive blocks observed available but pmap (453117, 12, 31) indicates they are allocated.
85 consecutive blocks observed available but pmap (453117, 98, 18) indicates they are allocated.
105 consecutive blocks observed available but pmap (453117, 173, 30) indicates they are allocated.
1 consecutive blocks observed available but pmap (453117, 214, 26) indicates they are allocated.
9 consecutive blocks observed available but pmap (453117, 228, 12) indicates they are allocated.
5 consecutive blocks observed available but pmap (453117, 247, 6) indicates they are allocated.
Incorrect number free detected in dmap 453117.
Incorrect internal (0) value detected in DM page 453117.
Incorrect internal (1) value detected in DM page 453117.
Incorrect internal (2) value detected in DM page 453117.
Incorrect internal (3) value detected in DM page 453117.
Incorrect internal (4) value detected in DM page 453117.
Incorrect internal (5) value detected in DM page 453117.
Incorrect internal (11) value detected in DM page 453117.
Incorrect internal (15) value detected in DM page 453117.
Incorrect internal (16) value detected in DM page 453117.
Incorrect internal (18) value detected in DM page 453117.
Incorrect internal (19) value detected in DM page 453117.
Incorrect internal (20) value detected in DM page 453117.
Incorrect internal (24) value detected in DM page 453117.
Incorrect internal (45) value detected in DM page 453117.
Incorrect internal (46) value detected in DM page 453117.
Incorrect internal (64) value detected in DM page 453117.
Incorrect internal (65) value detected in DM page 453117.
Incorrect internal (74) value detected in DM page 453117.
Incorrect internal (78) value detected in DM page 453117.
Incorrect internal (82) value detected in DM page 453117.
Incorrect leaf (97) value detected in DM page 453117.
Incorrect leaf (98) value detected in DM page 453117.
Incorrect leaf (183) value detected in DM page 453117.
Incorrect leaf (184) value detected in DM page 453117.
Incorrect leaf (185) value detected in DM page 453117.
Incorrect leaf (186) value detected in DM page 453117.
Incorrect leaf (258) value detected in DM page 453117.
Incorrect leaf (259) value detected in DM page 453117.
Incorrect leaf (261) value detected in DM page 453117.
Incorrect leaf (262) value detected in DM page 453117.
Incorrect leaf (299) value detected in DM page 453117.
Incorrect leaf (313) value detected in DM page 453117.
Incorrect leaf (332) value detected in DM page 453117.
2 consecutive blocks observed available but pmap (453118, 15, 24) indicates they are allocated.
122 consecutive blocks observed available but pmap (453118, 120, 8) indicates they are allocated.
256 consecutive blocks observed available but pmap (453118, 149, 15) indicates they are allocated.
10 consecutive blocks observed available but pmap (453118, 161, 8) indicates they are allocated.
Incorrect number free detected in dmap 453118.
Incorrect internal (0) value detected in DM page 453118.
Incorrect internal (1) value detected in DM page 453118.
Incorrect internal (2) value detected in DM page 453118.
Incorrect internal (3) value detected in DM page 453118.
Incorrect internal (5) value detected in DM page 453118.
Incorrect internal (12) value detected in DM page 453118.
Incorrect internal (14) value detected in DM page 453118.
Incorrect internal (15) value detected in DM page 453118.
Incorrect internal (24) value detected in DM page 453118.
Incorrect internal (51) value detected in DM page 453118.
Incorrect internal (52) value detected in DM page 453118.
Incorrect internal (58) value detected in DM page 453118.
Incorrect internal (59) value detected in DM page 453118.
Incorrect internal (60) value detected in DM page 453118.
Incorrect internal (61) value detected in DM page 453118.
Incorrect leaf (100) value detected in DM page 453118.
Incorrect leaf (205) value detected in DM page 453118.
Incorrect leaf (206) value detected in DM page 453118.
Incorrect leaf (207) value detected in DM page 453118.
Incorrect leaf (209) value detected in DM page 453118.
Incorrect leaf (234) value detected in DM page 453118.
Incorrect leaf (235) value detected in DM page 453118.
Incorrect leaf (237) value detected in DM page 453118.
Incorrect leaf (241) value detected in DM page 453118.
Incorrect leaf (242) value detected in DM page 453118.
Incorrect leaf (246) value detected in DM page 453118.
68 consecutive blocks observed available but pmap (453119, 99, 12) indicates they are allocated.
5 consecutive blocks observed available but pmap (453119, 138, 31) indicates they are allocated.
Incorrect number free detected in dmap 453119.
Incorrect internal (0) value detected in DM page 453119.
Incorrect internal (2) value detected in DM page 453119.
Incorrect internal (3) value detected in DM page 453119.
Incorrect internal (11) value detected in DM page 453119.
Incorrect internal (13) value detected in DM page 453119.
Incorrect internal (45) value detected in DM page 453119.
Incorrect internal (46) value detected in DM page 453119.
Incorrect internal (55) value detected in DM page 453119.
Incorrect leaf (184) value detected in DM page 453119.
Incorrect leaf (185) value detected in DM page 453119.
Incorrect leaf (186) value detected in DM page 453119.
Incorrect leaf (223) value detected in DM page 453119.
Incorrect leaf (224) value detected in DM page 453119.
256 consecutive blocks observed available but pmap (453121, 20, 23) indicates they are allocated.
256 consecutive blocks observed available but pmap (453121, 116, 3) indicates they are allocated.
95 consecutive blocks observed available but pmap (453121, 197, 4) indicates they are allocated.
Incorrect number free detected in dmap 453121.
Incorrect internal (0) value detected in DM page 453121.
Incorrect internal (1) value detected in DM page 453121.
Incorrect internal (2) value detected in DM page 453121.
Incorrect internal (4) value detected in DM page 453121.
Incorrect internal (6) value detected in DM page 453121.
Incorrect internal (12) value detected in DM page 453121.
Incorrect internal (17) value detected in DM page 453121.
Incorrect internal (26) value detected in DM page 453121.
Incorrect internal (27) value detected in DM page 453121.
Incorrect internal (28) value detected in DM page 453121.
Incorrect internal (50) value detected in DM page 453121.
Incorrect internal (51) value detected in DM page 453121.
Incorrect internal (52) value detected in DM page 453121.
Incorrect internal (70) value detected in DM page 453121.
Incorrect internal (71) value detected in DM page 453121.
Incorrect leaf (105) value detected in DM page 453121.
Incorrect leaf (106) value detected in DM page 453121.
Incorrect leaf (107) value detected in DM page 453121.
Incorrect leaf (109) value detected in DM page 453121.
Incorrect leaf (113) value detected in DM page 453121.
Incorrect leaf (201) value detected in DM page 453121.
Incorrect leaf (202) value detected in DM page 453121.
Incorrect leaf (203) value detected in DM page 453121.
Incorrect leaf (205) value detected in DM page 453121.
Incorrect leaf (209) value detected in DM page 453121.
Incorrect leaf (282) value detected in DM page 453121.
Incorrect leaf (283) value detected in DM page 453121.
Incorrect leaf (285) value detected in DM page 453121.
Incorrect leaf (286) value detected in DM page 453121.
Incorrect leaf (287) value detected in DM page 453121.
Incorrect internal (2) value detected in L0 page 442.
Incorrect internal (12) value detected in L0 page 442.
Incorrect internal (52) value detected in L0 page 442.
Incorrect internal (211) value detected in L0 page 442.
Incorrect internal (212) value detected in L0 page 442.
Incorrect leaf (847) value detected in L0 page 442.
Incorrect leaf (848) value detected in L0 page 442.
Incorrect leaf (849) value detected in L0 page 442.
Incorrect leaf (850) value detected in L0 page 442.
Incorrect leaf (851) value detected in L0 page 442.
Incorrect leaf (852) value detected in L0 page 442.
Incorrect leaf (854) value detected in L0 page 442.
Incorrect number of free blocks detected in Block Map Control Page.
Incorrect number of free blocks in AG 27 detected in Block Map Control Page.
Incorrect number of free blocks in AG 54 detected in Block Map Control Page.
Incorrect number of free blocks in AG 55 detected in Block Map Control Page.
Descrepancies detected between observed block allocations and pmaps.
Inconsistencies detected in leaf values (DM).
Inconsistencies detected in internal values (DM).
Incorrect data detected in pages (DM).
Inconsistencies detected in leaf values (L0).
Inconsistencies detected in internal values (L0).
Discrepancies detected in the Block Map Control Page AG free count list.
Incorrect data detected in the Block Map Control Page.
Incorrect data detected in disk allocation structures.
Incorrect data detected in disk allocation control structures.
Filesystem Summary:
Blocks in use for inodes:  2477572
Inode count:  19820576
File count:  17206308
Directory count:  1448003
Block count:  6342544000
Free block count:  556964360
25370176000 kilobytes total disk space.
  9214661 kilobytes in 1448003 directories.
23128494930 kilobytes in 17206308 user files.
        0 kilobytes in extended attributes
        0 kilobytes in access control lists
 23038291 kilobytes reserved for system use.
2227857440 kilobytes are available for use.
File system checked READ ONLY.
ERRORS HAVE BEEN DETECTED.  Run fsck with the -f parameter to repair.
Filesystem is dirty.
Filesystem is dirty but is marked clean.  In its present state,
the results of accessing /dev/md11 (except by this utility) are undefined.
processing terminated:  4/28/2011 9:57:40  with return code: 0  exit code: 4.
/sbin/jfs_fsck died with exit status 4

/sbin/jfs_fsck -n -v /dev/md12 
Wed Apr 27 21:18:40 2011

/sbin/jfs_fsck version 1.1.15.patched.2011.03.07, 04-Mar-2011
processing started: 4/27/2011 21:18:40

FSCK  Device /dev/md12 is currently mounted READ ONLY.
The current device is:  /dev/md12
Open(...READONLY...) returned rc = 0
Primary superblock is valid.
The type of file system for the device is JFS.
Block size in bytes:  4096
Filesystem size in blocks:  6342544000
**Phase 1 - Check Blocks, Files/Directories, and  Directory Entries
File system object FF16186301 has corrupt data (10).
**Phase 2 - Count links
**Phase 3 - Duplicate Block Rescan and Directory Connectedness
**Phase 4 - Report Problems
File system object FF16186301 is linked as: /20110427/41/4100798a0d1d05e829f40c17/013/bzff214100798a0d1d05e829f40c170000000000013b55201104272316545000021190593.bzff.1303946857773.tmp
cannot repair the data format error(s) in this file.
cannot repair FF16186301.
**Phase 5 - Check Connectivity
**Phase 6 - Perform Approved Corrections
**Phase 7 - Verify File/Directory Allocation Maps
**Phase 8 - Verify Disk Allocation Maps
1 consecutive blocks observed available but pmap (204892, 209, 14) indicates they are allocated.
Incorrect number free detected in dmap 204892.
Incorrect internal (0) value detected in DM page 204892.
Incorrect internal (4) value detected in DM page 204892.
Incorrect internal (18) value detected in DM page 204892.
Incorrect internal (73) value detected in DM page 204892.
Incorrect leaf (294) value detected in DM page 204892.
Incorrect internal (26) value detected in L0 page 200.
Incorrect internal (108) value detected in L0 page 200.
Incorrect leaf (433) value detected in L0 page 200.
52 consecutive blocks observed available but pmap (705787, 145, 5) indicates they are allocated.
1 consecutive blocks observed available but pmap (705787, 163, 7) indicates they are allocated.
111 consecutive blocks observed available but pmap (705787, 178, 26) indicates they are allocated.
256 consecutive blocks observed available but pmap (705787, 182, 10) indicates they are allocated.
171 consecutive blocks observed available but pmap (705787, 200, 9) indicates they are allocated.
1 consecutive blocks observed available but pmap (705787, 222, 12) indicates they are allocated.
85 consecutive blocks observed available but pmap (705787, 230, 13) indicates they are allocated.
1 consecutive blocks observed available but pmap (705787, 238, 25) indicates they are allocated.
36 consecutive blocks observed available but pmap (705787, 254, 28) indicates they are allocated.
Incorrect number free detected in dmap 705787.
Incorrect internal (0) value detected in DM page 705787.
Incorrect internal (3) value detected in DM page 705787.
Incorrect internal (4) value detected in DM page 705787.
Incorrect internal (14) value detected in DM page 705787.
Incorrect internal (15) value detected in DM page 705787.
Incorrect internal (16) value detected in DM page 705787.
Incorrect internal (17) value detected in DM page 705787.
Incorrect internal (18) value detected in DM page 705787.
Incorrect internal (19) value detected in DM page 705787.
Incorrect internal (20) value detected in DM page 705787.
Incorrect internal (57) value detected in DM page 705787.
Incorrect internal (61) value detected in DM page 705787.
Incorrect internal (65) value detected in DM page 705787.
Incorrect internal (66) value detected in DM page 705787.
Incorrect internal (67) value detected in DM page 705787.
Incorrect internal (68) value detected in DM page 705787.
Incorrect internal (71) value detected in DM page 705787.
Incorrect internal (72) value detected in DM page 705787.
Incorrect internal (76) value detected in DM page 705787.
Incorrect internal (78) value detected in DM page 705787.
Incorrect internal (79) value detected in DM page 705787.
Incorrect internal (80) value detected in DM page 705787.
Incorrect internal (84) value detected in DM page 705787.
Incorrect leaf (230) value detected in DM page 705787.
Incorrect leaf (231) value detected in DM page 705787.
Incorrect leaf (248) value detected in DM page 705787.
Incorrect leaf (263) value detected in DM page 705787.
Incorrect leaf (264) value detected in DM page 705787.
Incorrect leaf (265) value detected in DM page 705787.
Incorrect leaf (267) value detected in DM page 705787.
Incorrect leaf (268) value detected in DM page 705787.
Incorrect leaf (269) value detected in DM page 705787.
Incorrect leaf (273) value detected in DM page 705787.
Incorrect leaf (275) value detected in DM page 705787.
Incorrect leaf (285) value detected in DM page 705787.
Incorrect leaf (286) value detected in DM page 705787.
Incorrect leaf (287) value detected in DM page 705787.
Incorrect leaf (289) value detected in DM page 705787.
Incorrect leaf (290) value detected in DM page 705787.
Incorrect leaf (307) value detected in DM page 705787.
Incorrect leaf (315) value detected in DM page 705787.
Incorrect leaf (316) value detected in DM page 705787.
Incorrect leaf (317) value detected in DM page 705787.
Incorrect leaf (318) value detected in DM page 705787.
Incorrect leaf (323) value detected in DM page 705787.
Incorrect leaf (339) value detected in DM page 705787.
Incorrect leaf (340) value detected in DM page 705787.
220 consecutive blocks observed available but pmap (705788, 0, 0) indicates they are allocated.
2 consecutive blocks observed available but pmap (705788, 14, 28) indicates they are allocated.
3 consecutive blocks observed available but pmap (705788, 49, 24) indicates they are allocated.
256 consecutive blocks observed available but pmap (705788, 50, 2) indicates they are allocated.
256 consecutive blocks observed available but pmap (705788, 58, 3) indicates they are allocated.
89 consecutive blocks observed available but pmap (705788, 74, 31) indicates they are allocated.
2 consecutive blocks observed available but pmap (705788, 110, 5) indicates they are allocated.
7 consecutive blocks observed available but pmap (705788, 118, 7) indicates they are allocated.
256 consecutive blocks observed available but pmap (705788, 126, 20) indicates they are allocated.
258 consecutive blocks observed available but pmap (705788, 157, 23) indicates they are allocated.
241 consecutive blocks observed available but pmap (705788, 173, 25) indicates they are allocated.
Incorrect number free detected in dmap 705788.
Incorrect internal (1) value detected in DM page 705788.
Incorrect internal (2) value detected in DM page 705788.
Incorrect internal (3) value detected in DM page 705788.
Incorrect internal (5) value detected in DM page 705788.
Incorrect internal (8) value detected in DM page 705788.
Incorrect internal (9) value detected in DM page 705788.
Incorrect internal (11) value detected in DM page 705788.
Incorrect internal (12) value detected in DM page 705788.
Incorrect internal (13) value detected in DM page 705788.
Incorrect internal (14) value detected in DM page 705788.
Incorrect internal (15) value detected in DM page 705788.
Incorrect internal (16) value detected in DM page 705788.
Incorrect internal (21) value detected in DM page 705788.
Incorrect internal (22) value detected in DM page 705788.
Incorrect internal (24) value detected in DM page 705788.
Incorrect internal (33) value detected in DM page 705788.
Incorrect internal (34) value detected in DM page 705788.
Incorrect internal (35) value detected in DM page 705788.
Incorrect internal (36) value detected in DM page 705788.
Incorrect internal (37) value detected in DM page 705788.
Incorrect internal (39) value detected in DM page 705788.
Incorrect internal (40) value detected in DM page 705788.
Incorrect internal (48) value detected in DM page 705788.
Incorrect internal (50) value detected in DM page 705788.
Incorrect internal (52) value detected in DM page 705788.
Incorrect internal (53) value detected in DM page 705788.
Incorrect internal (54) value detected in DM page 705788.
Incorrect internal (60) value detected in DM page 705788.
Incorrect internal (61) value detected in DM page 705788.
Incorrect internal (62) value detected in DM page 705788.
Incorrect internal (64) value detected in DM page 705788.
Incorrect internal (65) value detected in DM page 705788.
Incorrect internal (66) value detected in DM page 705788.
Incorrect leaf (85) value detected in DM page 705788.
Incorrect leaf (89) value detected in DM page 705788.
Incorrect leaf (91) value detected in DM page 705788.
Incorrect leaf (99) value detected in DM page 705788.
Incorrect leaf (134) value detected in DM page 705788.
Incorrect leaf (135) value detected in DM page 705788.
Incorrect leaf (136) value detected in DM page 705788.
Incorrect leaf (137) value detected in DM page 705788.
Incorrect leaf (141) value detected in DM page 705788.
Incorrect leaf (143) value detected in DM page 705788.
Incorrect leaf (144) value detected in DM page 705788.
Incorrect leaf (145) value detected in DM page 705788.
Incorrect leaf (149) value detected in DM page 705788.
Incorrect leaf (151) value detected in DM page 705788.
Incorrect leaf (159) value detected in DM page 705788.
Incorrect leaf (160) value detected in DM page 705788.
Incorrect leaf (161) value detected in DM page 705788.
Incorrect leaf (162) value detected in DM page 705788.
Incorrect leaf (195) value detected in DM page 705788.
Incorrect leaf (203) value detected in DM page 705788.
Incorrect leaf (211) value detected in DM page 705788.
Incorrect leaf (212) value detected in DM page 705788.
Incorrect leaf (213) value detected in DM page 705788.
Incorrect leaf (217) value detected in DM page 705788.
Incorrect leaf (219) value detected in DM page 705788.
Incorrect leaf (242) value detected in DM page 705788.
Incorrect leaf (243) value detected in DM page 705788.
Incorrect leaf (245) value detected in DM page 705788.
Incorrect leaf (249) value detected in DM page 705788.
Incorrect leaf (250) value detected in DM page 705788.
Incorrect leaf (258) value detected in DM page 705788.
Incorrect leaf (259) value detected in DM page 705788.
Incorrect leaf (261) value detected in DM page 705788.
Incorrect leaf (265) value detected in DM page 705788.
Incorrect leaf (266) value detected in DM page 705788.
Incorrect internal (147) value detected in L0 page 689.
Incorrect leaf (592) value detected in L0 page 689.
Incorrect number of free blocks detected in Block Map Control Page.
Incorrect number of free blocks in AG 25 detected in Block Map Control Page.
Incorrect number of free blocks in AG 86 detected in Block Map Control Page.
Descrepancies detected between observed block allocations and pmaps.
Inconsistencies detected in leaf values (DM).
Inconsistencies detected in internal values (DM).
Incorrect data detected in pages (DM).
Inconsistencies detected in leaf values (L0).
Inconsistencies detected in internal values (L0).
Discrepancies detected in the Block Map Control Page AG free count list.
Incorrect data detected in the Block Map Control Page.
Incorrect data detected in disk allocation structures.
Incorrect data detected in disk allocation control structures.
Filesystem Summary:
Blocks in use for inodes:  2389956
Inode count:  19119648
File count:  16559802
Directory count:  1399086
Block count:  6342544000
Free block count:  558538157
25370176000 kilobytes total disk space.
  8856075 kilobytes in 1399086 directories.
23122561789 kilobytes in 16559802 user files.
        0 kilobytes in extended attributes
        0 kilobytes in access control lists
 22317658 kilobytes reserved for system use.
2234152628 kilobytes are available for use.
File system checked READ ONLY.
ERRORS HAVE BEEN DETECTED.  Run fsck with the -f parameter to repair.
Filesystem is dirty.
Filesystem is dirty but is marked clean.  In its present state,
the results of accessing /dev/md12 (except by this utility) are undefined.
processing terminated:  4/28/2011 9:40:19  with return code: 0  exit code: 4.
/sbin/jfs_fsck died with exit status 4

The above problems were easily corrected by a read-write run of jfs_fsck.

Thanks again for the patch.

Tim

On Apr 22, 2011, at 12:55 AM, Sandon Van Ness wrote:

 It didn't appear to be fixed on my machine so I am guessing the same 
will be for you but definitely curious to here what happens.

On 04/22/2011 12:27 AM, Tim Nufire wrote:
Dave,

My spam filter ate the first email you sent on this patch but I got this one.... THANK YOU, THANK YOU, THANK YOU!! :-)

I deployed this on all my servers this afternoon and will let you know the first time it gets tested due to a system crash that would normally have caused the journal replay problem.

Cheers,
Tim

On Apr 20, 2011, at 5:39 AM, Dave Kleikamp wrote:

On 04/20/2011 07:50 AM, Sandon Van Ness wrote:
On 03/07/2011 02:29 PM, Dave Kleikamp wrote:
On Fri, 2011-03-04 at 14:10 -0800, Tim Nufire wrote:
From the changelog it does not look like it... I have been running
patches for all the changes in the changelog and I still have the
logredo problem on volumes>    16TB. Several of the other problems that
I've had *are* fixed here so this release is very welcome news! :-)

Dave, any chance the logredo problem will be fixed? It's easy to
reproduce but I'm assuming it's much harder to fix. Congratulations on
your new gig!
Turned out to be pretty simple once I took the time to track it down.
This patch fixes the problem for me.  Can you try this fix and let me
know if anything else down the line fails?

Thanks,
Shaggy

Index: libfs/log_map.c
===================================================================
RCS file: /cvsroot/jfs/jfsutils/libfs/log_map.c,v
retrieving revision 1.19
retrieving revision 1.20
diff -u -p -r1.19 -r1.20
--- libfs/log_map.c    24 Mar 2008 19:36:57 -0000    1.19
+++ libfs/log_map.c    7 Mar 2011 22:21:57 -0000    1.20
@@ -340,7 +340,8 @@ int bMapInit(int vol,        /* index in vopen
      caddr_t p0 = NULL;
      xtpage_t *xp;
      int i, j, k, w, pgidx;
-    int32_t nbytes, npages, this_page;
+    int64_t nbytes;
+    int32_t npages, this_page;
      uint32_t *pmap, mask;
      pxd_t pxd;
      int64_t xaddr;


Well I had a power-outage today. log-redo succeeded on my small (OS)
volume but again failed on my large 36TB (33TiB):

fsck.jfs version 1.1.15, 04-Mar-2011
This doesn't look like it was built with my patch, which I sent on March 7.

processing started: 4/19/2011 22:04:25
The current device is:  /dev/sdd1
Block size in bytes:  4096
Filesystem size in blocks:  8718748407
**Phase 0 - Replay Journal Log
logredo failed (rc=-220).  fsck continuing.
**Phase 1 - Check Blocks, Files/Directories, and  Directory Entries
**Phase 2 - Count links
**Phase 3 - Duplicate Block Rescan and Directory Connectedness
**Phase 4 - Report Problems
**Phase 5 - Check Connectivity
**Phase 6 - Perform Approved Corrections
**Phase 7 - Rebuild File/Directory Allocation Maps
**Phase 8 - Rebuild Disk Allocation Maps
**Phase 9 - Reformat File System Log
34874993628 kilobytes total disk space.
   1777545 kilobytes in 608674 directories.
25042310260 kilobytes in 6240464 user files.
         0 kilobytes in extended attributes
   9121433 kilobytes reserved for system use.
9825339480 kilobytes are available for use.
Filesystem is
clean.                                                      [ ok ]

Could be my imagination but the fsck did seem to go faster this time as
I checked iostat/uptime right after it finished and was 12 minutes which
means the fsck only took 11 minutes vs the 15-20 minutes I remember it
taking before.
All the recent changes have been bug fixes.  I don't see anything that
would explain a performance gain.  Of course, the run time is related to
the number of files and directories, so changes to the contents of the
file system will have an effect.

  05:16:51 up 12 min,  1 user,  load average: 0.73, 0.98, 0.72
Linux 2.6.33-web100 (dekabutsu)         04/20/2011

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
            1.63    0.00    1.38    9.41    0.00   87.58

------------------------------------------------------------------------------
Benefiting from Server Virtualization: Beyond Initial Workload
Consolidation -- Increasing the use of server virtualization is a top
priority.Virtualization can reduce costs, simplify management, and improve
application availability and disaster protection. Learn more about boosting
the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev
_______________________________________________
Jfs-discussion mailing list
Jfs-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/jfs-discussion


------------------------------------------------------------------------------
Fulfilling the Lean Software Promise
Lean software platforms are now widely adopted and the benefits have been 
demonstrated beyond question. Learn why your peers are replacing JEE 
containers with lightweight application servers - and what you can gain 
from the move. http://p.sf.net/sfu/vmware-sfemails
_______________________________________________
Jfs-discussion mailing list
Jfs-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/jfs-discussion




------------------------------------------------------------------------------
WhatsUp Gold - Download Free Network Management Software
The most intuitive, comprehensive, and cost-effective network 
management toolset available today.  Delivers lowest initial 
acquisition cost and overall TCO of any competing solution.
http://p.sf.net/sfu/whatsupgold-sd


_______________________________________________
Jfs-discussion mailing list
Jfs-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/jfs-discussion