Hello All,
  I am doing some reliability studies on different revisions of overo water COMs and different versions of the kernel on those water COMs.  I have found a few interesting things.  One is the following:  I used linaro media create to create a SD card and got it to boot 100% of the time.  Then I modified the kernel by patching in Sakoman's changes and redid the test.  I rebooted for 1000 times and get about 5 failures that look like the following:


Failure #1:

[    1.170349] VFS: Mounted root (ext3 filesystem) readonly on device 179:2.
[    1.180877] devtmpfs: mounted
[    1.184143] Freeing init memory: 168K
init: ureadahead main process (39) terminated with status 5

[    2.608154] kernel BUG at mm/prio_tree.c:79!
[    2.612670] Unable to handle kernel NULL pointer dereference at virtual address 00000000
[    2.621154] pgd = cab68000
[    2.623992] [00000000] *pgd=00000000
[    2.627777] Internal error: Oops: 805 [#1]
[    2.632049] last sysfs file: /sys/devices/platform/omap/l3_main.0/uevent
[    2.639099] Modules linked in:
[    2.642303] CPU: 0    Not tainted  (2.6.39+ #1)
[    2.647979] PC is at __bug+0x1c/0x28
[    2.651733] LR is at __bug+0x18/0x28
[    2.655487] pc : [<c003a230>]    lr : [<c003a22c>]    psr: 600f0093
[    2.655487] sp : cab65ed8  ip : ca811220  fp : cabe690c
[    2.667541] r10: 00000001  r9 : cab64000  r8 : cabe6910
[    2.673004] r7 : cab48d80  r6 : cab66000  r5 : cabe6948  r4 : 4008f000
[    2.679870] r3 : 00000000  r2 : cab65ecc  r1 : c0447b86  r0 : 00000036
[    2.686706] Flags: nZCv  IRQs off  FIQs on  Mode SVC_32  ISA ARM  Segment user
[    2.694274] Control: 10c5387d  Table: 8ab68019  DAC: 00000015
[    2.700317] Process udevd (pid: 94, stack limit = 0xcab642f0)
[    2.706329] Stack: (0xcab65ed8 to 0xcab66000)
[    2.710906] 5ec0:                                                       00000004 c00de9a4
[    2.719512] 5ee0: cabe2180 c0063040 cabe68f0 cab48db4 cabe21b4 cabe68fc ca804300 caab7440
[    2.728088] 5f00: 01200011 00000000 caab7644 00000000 40051068 cab48d80 c0518bf0 c00638e8
[    2.736663] 5f20: 00000000 ca5cf700 0000000a bef3d8d0 cab65fb0 00000000 ca574500 00000000
[    2.745269] 5f40: 00000013 01200011 00000000 cab65fb0 00000000 bef3d8d0 cab64000 00000000
[    2.753845] 5f60: 0000005e c0064074 40051068 00000000 00000000 00000107 c00376a4 bef3ede8
[    2.762420] 5f80: 00000008 00000000 bef3ede8 40051068 bef3d8d8 40051000 00000078 c00376a4
[    2.771026] 5fa0: 00000000 c0037500 00000000 40051068 01200011 00000000 00000000 00000000
[    2.779602] 5fc0: 40051068 bef3d8d8 40051000 00000078 402cd000 400514c0 0000005e 0000005e
[    2.788177] 5fe0: 00000078 bef3d8d0 4025b02f 402048c6 000f0030 01200011 00000000 00000000
[    2.796813] [<c003a230>] (__bug+0x1c/0x28) from [<c00de9a4>] (vma_prio_tree_add+0x4c/0xbc)
[    2.805511] [<c00de9a4>] (vma_prio_tree_add+0x4c/0xbc) from [<c0063040>] (dup_mm+0x254/0x420)
[    2.814453] [<c0063040>] (dup_mm+0x254/0x420) from [<c00638e8>] (copy_process+0x6ac/0xd24)
[    2.823150] [<c00638e8>] (copy_process+0x6ac/0xd24) from [<c0064074>] (do_fork+0xe8/0x2b8)
[    2.831848] [<c0064074>] (do_fork+0xe8/0x2b8) from [<c0037500>] (ret_fast_syscall+0x0/0x30)
[    2.840606] Code: e59f0010 e1a01003 eb0ccd50 e3a03000 (e5833000) 
[    2.847106] ---[ end trace b17e7fc3d0f6349c ]---
[    2.853240] kernel BUG at mm/prio_tree.c:79!
[    2.857727] Unable to handle kernel NULL pointer dereference at virtual address 00000000
[    2.866241] pgd = caba8000
[    2.869079] [00000000] *pgd=00000000
[    2.872833] Internal error: Oops: 805 [#2]
[    2.877105] last sysfs file: /sys/devices/platform/omap/mpu.0/uevent
[    2.883789] Modules linked in:
[    2.886993] CPU: 0    Tainted: G      D      (2.6.39+ #1)
[    2.893585] PC is at __bug+0x1c/0x28
[    2.897338] LR is at __bug+0x18/0x28
[    2.901092] pc : [<c003a230>]    lr : [<c003a22c>]    psr: 600f0093
[    2.901092] sp : caba3ed8  ip : ca811220  fp : cabe6a14
[    2.913116] r10: 00000001  r9 : caba2000  r8 : cabe6a18
[    2.918609] r7 : caaac300  r6 : cab66f20  r5 : cabe6a50  r4 : 4004b000
[    2.925445] r3 : 00000000  r2 : caba3ecc  r1 : c0447b86  r0 : 00000036
[    2.932312] Flags: nZCv  IRQs off  FIQs on  Mode SVC_32  ISA ARM  Segment user
[    2.939880] Control: 10c5387d  Table: 8aba8019  DAC: 00000015
[    2.945922] Process udevd (pid: 95, stack limit = 0xcaba22f0)
[    2.951934] Stack: (0xcaba3ed8 to 0xcaba4000)
[    2.956512] 3ec0:                                                       00000001 c00de9a4
[    2.965148] 3ee0: cabe2300 c0063040 cabe69f8 caaac334 cabe2334 cabe6a04 ca804300 caab6ac0
[    2.973754] 3f00: 01200011 00000000 caab6cc4 00000000 40051068 caaac300 c0518bf0 c00638e8
[    2.982391] 3f20: 00000000 ca5cf580 0000000a bef3d8d0 caba3fb0 00000000 ca574500 00000000
[    2.990997] 3f40: 0000000f 01200011 00000000 caba3fb0 00000000 bef3d8d0 caba2000 00000000
[    2.999633] 3f60: 0000005f c0064074 40051068 00000000 00000000 00000107 c00376a4 bef3ede8
[    3.008239] 3f80: 00000008 00000000 bef3ede8 40051068 bef3d8d8 40051000 00000078 c00376a4
[    3.016876] 3fa0: 00000000 c0037500 00000000 40051068 01200011 00000000 00000000 00000000
[    3.025482] 3fc0: 40051068 bef3d8d8 40051000 00000078 402cd000 400514c0 0000005f 0000005f
[    3.034118] 3fe0: 00000078 bef3d8d0 4025b02f 402048c6 000f0030 01200011 08021804 0000a120
[    3.042755] [<c003a230>] (__bug+0x1c/0x28) from [<c00de9a4>] (vma_prio_tree_add+0x4c/0xbc)
[    3.051452] [<c00de9a4>] (vma_prio_tree_add+0x4c/0xbc) from [<c0063040>] (dup_mm+0x254/0x420)
[    3.060394] [<c0063040>] (dup_mm+0x254/0x420) from [<c00638e8>] (copy_process+0x6ac/0xd24)
[    3.069091] [<c00638e8>] (copy_process+0x6ac/0xd24) from [<c0064074>] (do_fork+0xe8/0x2b8)
[    3.077758] [<c0064074>] (do_fork+0xe8/0x2b8) from [<c0037500>] (ret_fast_syscall+0x0/0x30)
[    3.086547] Code: e59f0010 e1a01003 eb0ccd50 e3a03000 (e5833000) 
[    3.093017] ---[ end trace b17e7fc3d0f6349d ]---
[    3.113647] Unable to handle kernel paging request at virtual address ffffffed
[    3.121337] pgd = cabd0000
[    3.124176] [ffffffed] *pgd=8affe821, *pte=00000000, *ppte=00000000
[    3.130828] Internal error: Oops: 17 [#3]
[    3.135009] last sysfs file: /sys/devices/platform/serial8250/uevent
[    3.141693] Modules linked in:
[    3.144897] CPU: 0    Tainted: G      D      (2.6.39+ #1)
[    3.151489] PC is at find_vma_prepare+0x18/0x84
[    3.156250] LR is at vma_adjust+0x2a0/0x3a0
[    3.160614] pc : [<c00e822c>]    lr : [<c00e8c7c>]    psr: 20000013
[    3.160644] sp : cabb1e94  ip : 00000001  fp : 00000000
[    3.172668] r10: 00000000  r9 : ca53ca68  r8 : 00000000
[    3.178161] r7 : caba1d34  r6 : caba1d50  r5 : caba1d54  r4 : caba1d50
[    3.184997] r3 : cabb1ed0  r2 : cabb1ed4  r1 : 4026f000  r0 : 00000000
[    3.191864] Flags: nzCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment user
[    3.199340] Control: 10c5387d  Table: 8abd0019  DAC: 00000015
[    3.205352] Process modprobe (pid: 96, stack limit = 0xcabb02f0)
[    3.211669] Stack: (0xcabb1e94 to 0xcabb2000)
[    3.216247] 1e80:                                              cabe6d68 cabe6e18 caaaca80
[    3.224822] 1ea0: cabe6d10 c00e8c7c cabb1ecc 08000075 cabb1ed0 4026f000 ca53ca54 cabfd200
[    3.233398] 1ec0: 4026d000 000000d4 cabe6e18 cabe6a50 cabe6e50 c05b8188 cabe6da0 cabe6e18
[    3.242004] 1ee0: cabe6d68 4026f000 caaaca80 00000000 cabb0000 cabb1f8c 40194b20 c00e8e98
[    3.250579] 1f00: cabe6e18 cabe6d68 cabe6d68 08100071 4026d000 4026f000 00000000 c00eafc0
[    3.259155] 1f20: 08100071 caba1d50 cabfd200 000000d4 00000000 c00e84d8 caaaca80 08100073
[    3.267761] 1f40: 40066000 00000002 40065000 cabe6bcc cabe6bd4 cabe6b00 cab7f440 4026f000
[    3.276336] 1f60: 4026f000 00000001 00000000 cabb0000 cabb0000 00000000 40194b20 c00eb300
[    3.284942] 1f80: 08100071 00002000 00000001 cabe6d68 40080ab8 00000000 00000000 0000007d
[    3.293518] 1fa0: c00376a4 c0037500 40080ab8 00000000 4026d000 00002000 00000001 fffff000
[    3.302093] 1fc0: 40080ab8 00000000 00000000 0000007d 40199bc0 40191000 4026f958 40194b20
[    3.310699] 1fe0: 40194b20 be8ed9f4 40047039 4004eb0c 20000010 4026d000 80102208 04000000
[    3.319305] [<c00e822c>] (find_vma_prepare+0x18/0x84) from [<c00e8c7c>] (vma_adjust+0x2a0/0x3a0)
[    3.328521] [<c00e8c7c>] (vma_adjust+0x2a0/0x3a0) from [<c00e8e98>] (__split_vma+0x11c/0x194)
[    3.337463] [<c00e8e98>] (__split_vma+0x11c/0x194) from [<c00eafc0>] (mprotect_fixup+0x148/0x350)
[    3.346801] [<c00eafc0>] (mprotect_fixup+0x148/0x350) from [<c00eb300>] (sys_mprotect+0x138/0x1b8)
[    3.356201] [<c00eb300>] (sys_mprotect+0x138/0x1b8) from [<c0037500>] (ret_fast_syscall+0x0/0x30)
[    3.365539] Code: e2805004 e1a06004 e1a00004 ea00000b (e51c6014) 
[    3.371978] ---[ end trace b17e7fc3d0f6349e ]---
[    3.377868] Unable to handle kernel paging request at virtual address ffffffed
[    3.385528] Unable to handle kernel NULL pointer dereference at virtual address 00000021
[    3.394012] pgd =   (null)
[    3.396850] Unable to handle kernel NULL pointer dereference at virtual address 00000000
[    3.405334] Unable to handle kernel paging request at virtual address 08000094
[    3.412933] Unable to handle kernel paging request at virtual address 08000094
[    3.420501] Unable to handle kernel paging request at virtual address 08000094
[    3.428070] Unable to handle kernel paging request at virtual address 08000094
[    3.435668] Unable to handle kernel paging request at virtual address 08000094
[    3.443237] Unable to handle kernel paging request at virtual address 08000094
[    3.450805] Unable to handle kernel paging request at virtual address 08000094
[    3.458404] Unable to handle kernel paging request at virtual address 08000094
[    3.465972] Unable to handle kernel paging request at virtual address 08000094
[    3.473541] Unable to handle kernel paging request at virtual address 08000094
[    3.481140] Unable to handle kernel paging request at virtual address 08000094
[    3.488708] Unable to handle kernel paging request at virtual address 08000094
[    3.496307] Unable to handle kernel paging request at virtual address 08000094
[    3.503875] Unable to handle kernel paging request at virtual address 08000094
[    3.511444] Unable to handle kernel paging request at virtual address 08000094
[    3.519042] Unable to handle kernel paging request at virtual address 08000094
[    3.526611] Unable to handle kernel paging request at virtual address 08000094
[    3.534210] Unable to handle kernel NULL pointer dereference at virtual address 000001c8
[    3.542694] pgd = cabde17c
[    3.545532] [000001c8] *pgd=cabde1d5
[    3.549102] Unable to handle kernel paging request at virtual address 0abde000
[    3.556884] pgd = cabde17c
[    3.559722] [0abde000] *pgd=41b9e000
[    3.563262] Unable to handle kernel paging request at virtual address 81b9e778
[    3.571044] pgd = cabde17c
[    3.573883] [81b9e778] *pgd=cabe0330
[    3.577453] Unable to handle kernel paging request at virtual address 0abe0678
[    3.585205] pgd = cabde17c
[    3.588043] [0abe0678] *pgd=41b9e000
[    3.591613] Unable to handle kernel paging request at virtual address 81b9e780
[    3.599365] pgd = cabde17c
[    3.602203] [81b9e780] *pgd=cabe0330
[    3.605773] Unable to handle kernel paging request at virtual address 0abe0678
[    3.613555] pgd = cabde17c
[    3.616394] [0abe0678] *pgd=41b9e000
[    3.619964] Unable to handle kernel paging request at virtual address 81b9e780
[    3.627716] pgd = cabde17c
[    3.630554] [81b9e780] *pgd=cabe0330
[    3.634124] Unable to handle kernel paging request at virtual address 0abe0678
[    3.641876] pgd = cabde17c
[    3.644714] [0abe0678] *pgd=41b9e000
[    3.648284] Unable to handle kernel paging request at virtual address 81b9e780
[    3.656066] pgd = cabde17c
[    3.658905] [81b9e780] *pgd=cabe0330
[    3.662445] Unable to handle kernel paging request at virtual address 0abe0678
[    3.670227] pgd = cabde17c
[    3.673065] [0abe0678] *pgd=41b9e000
[    3.676635] Unable to handle kernel paging request at virtual address 81b9e780
[    3.684387] pgd = cabde17c
[    3.687225] [81b9e780] *pgd=cabe0330
[    3.690795] Unable to handle kernel paging request at virtual address 0abe0678
[    3.698547] pgd = cabde17c
[    3.701385] [0abe0678] *pgd=41b9e000
[    3.704956] Unable to handle kernel paging request at virtual address 81b9e780
[    3.712707] pgd = cabde17c
[    3.715545] [81b9e780] *pgd=cabe0330
[    3.719116] Unable to handle kernel paging request at virtual address 0abe0678
[    3.726898] pgd = cabde17c
[    3.729736] [0abe0678] *pgd=41b9e000
[    3.733276] Unable to handle kernel paging request at virtual address 81b9e780
[    3.741058] pgd = cabde17c
[    3.743896] [81b9e780] *pgd=cabe0330
[    3.747467] Unable to handle kernel paging request at virtual address 0abe0678
[    3.755218] pgd = cabde17c
[    3.758056] [0abe0678] *pgd=41b9e000


Failure #2


[    1.155212] kjournald starting.  Commit interval 5 seconds
[    1.161102] EXT3-fs (mmcblk0p2): mounted filesystem with ordered data mode
[    1.168426] VFS: Mounted root (ext3 filesystem) readonly on device 179:2.
[    1.178985] devtmpfs: mounted
[    1.182250] Freeing init memory: 168K
init: ureadahead main process (39) terminated with status 5

[    3.158874] kernel BUG at mm/prio_tree.c:79!
[    3.163421] Unable to handle kernel NULL pointer dereference at virtual address 00000000
[    3.171905] pgd = caba8000
[    3.174743] [00000000] *pgd=00000000
[    3.178497] Internal error: Oops: 805 [#1]
[    3.182800] last sysfs file: /sys/devices/virtual/block/loop5/removable
[    3.189727] Modules linked in: omap_wdt twl4030_usb leds_gpio
[    3.195770] CPU: 0    Not tainted  (2.6.39+ #1)
[    3.201477] PC is at __bug+0x1c/0x28
[    3.205230] LR is at __bug+0x18/0x28
[    3.208984] pc : [<c003a230>]    lr : [<c003a22c>]    psr: 600f0093
[    3.208984] sp : caba3ed8  ip : ca811220  fp : ca0b4284
[    3.221008] r10: 00000001  r9 : caba2000  r8 : ca0b4288
[    3.226501] r7 : caaac300  r6 : cab9d738  r5 : ca0b42c0  r4 : 400ee000
[    3.233337] r3 : 00000000  r2 : caba3ecc  r1 : c0447b86  r0 : 00000036
[    3.240203] Flags: nZCv  IRQs off  FIQs on  Mode SVC_32  ISA ARM  Segment user
[    3.247772] Control: 10c5387d  Table: 8aba8019  DAC: 00000015
[    3.253784] Process udevd (pid: 95, stack limit = 0xcaba22f0)
[    3.259826] Stack: (0xcaba3ed8 to 0xcaba4000)
[    3.264404] 3ec0:                                                       00000001 c00de9a4
[    3.272979] 3ee0: caaac780 c0063040 ca0b4268 caaac334 caaac7b4 ca0b4274 ca804300 ca02f440
[    3.281585] 3f00: 01200011 00000000 ca02f644 00000000 400f0068 caaac300 c0518bf0 c00638e8
[    3.290161] 3f20: 00000000 caba2000 caba3f90 bec65fd0 caba3fb0 00000000 cab85a88 00000000
[    3.298736] 3f40: 00000000 01200011 00000000 caba3fb0 00000000 bec65fd0 caba2000 00000000
[    3.307342] 3f60: 0000005f c0064074 400f0068 00000000 00000000 0000002a c00376a4 bec668dc
[    3.315917] 3f80: 00000008 00000000 00000000 400f0068 bec65fd8 400f0000 00000078 c00376a4
[    3.324493] 3fa0: 00000000 c0037500 00000000 400f0068 01200011 00000000 00000000 00000000
[    3.333099] 3fc0: 400f0068 bec65fd8 400f0000 00000078 40281000 400f04c0 0000005f 0000005f
[    3.341674] 3fe0: 00000078 bec65fd0 4020f02f 401b88c6 000f0030 01200011 08021000 0000a020
[    3.350280] [<c003a230>] (__bug+0x1c/0x28) from [<c00de9a4>] (vma_prio_tree_add+0x4c/0xbc)
[    3.358978] [<c00de9a4>] (vma_prio_tree_add+0x4c/0xbc) from [<c0063040>] (dup_mm+0x254/0x420)
[    3.367950] [<c0063040>] (dup_mm+0x254/0x420) from [<c00638e8>] (copy_process+0x6ac/0xd24)
[    3.376647] [<c00638e8>] (copy_process+0x6ac/0xd24) from [<c0064074>] (do_fork+0xe8/0x2b8)
[    3.385314] [<c0064074>] (do_fork+0xe8/0x2b8) from [<c0037500>] (ret_fast_syscall+0x0/0x30)
[    3.394104] Code: e59f0010 e1a01003 eb0ccd50 e3a03000 (e5833000) 
[    3.400543] ---[ end trace b17e7fc3d0f6349c ]---
[    3.409393] mm/memory.c:216: bad pmd 8aa0040e.
[    3.414123] Unable to handle kernel NULL pointer dereference at virtual address 0000000f
[    3.422668] pgd = cabdc000
[    3.425537] [0000000f] *pgd=00000000
[    3.429290] Internal error: Oops: 5 [#2]
[    3.433410] last sysfs file: /sys/devices/virtual/block/loop6/removable
[    3.440338] Modules linked in: omap_wdt twl4030_usb leds_gpio
[    3.446411] CPU: 0    Tainted: G      D      (2.6.39+ #1)
[    3.453002] PC is at anon_vma_clone+0x5c/0xac
[    3.457580] LR is at kmem_cache_alloc+0x28/0xf8
[    3.462310] pc : [<c00ed1f0>]    lr : [<c00f6edc>]    psr: a00f0013
[    3.462341] sp : cabd9eb8  ip : 00000008  fp : ca0b443c
[    3.474365] r10: 00000000  r9 : cabd8000  r8 : cabca4cc
[    3.479858] r7 : c05b8188  r6 : ca0b44b0  r5 : cabe0a78  r4 : ca0b4478
[    3.486724] r3 : 00000003  r2 : cab4d188  r1 : cab4d190  r0 : cab4d180
[    3.493591] Flags: NzCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment user
[    3.501098] Control: 10c5387d  Table: 8abdc019  DAC: 00000015
[    3.507141] Process udevd (pid: 100, stack limit = 0xcabd82f0)
[    3.513244] Stack: (0xcabd9eb8 to 0xcabda000)
[    3.517822] 9ea0:                                                       cab4d180 ca0b4478
[    3.526428] 9ec0: cabca494 caaacd80 ca0b4440 c00ed260 cab4d180 ca0b4478 cabca494 caaacd80
[    3.535003] 9ee0: ca0b4440 c0062fa4 ca0b4420 caaacdb4 cab4d1b4 ca0b442c ca804300 ca02f900
[    3.543579] 9f00: 01200011 00000000 ca02fb04 00000000 400f0068 caaacd80 c0518bf0 c00638e8
[    3.552185] 9f20: 00000000 cabd8000 cabd9f90 bec65fd0 cabd9fb0 00000000 caa50c08 00000000
[    3.560760] 9f40: 00000000 01200011 00000000 cabd9fb0 00000000 bec65fd0 cabd8000 00000000
[    3.569366] 9f60: 00000064 c0064074 400f0068 00000000 00000000 0000002a c00376a4 bec668dc
[    3.577941] 9f80: 00000008 00000000 00000000 400f0068 bec65fd8 400f0000 00000078 c00376a4
[    3.586517] 9fa0: 00000000 c0037500 00000000 400f0068 01200011 00000000 00000000 00000000
[    3.595123] 9fc0: 400f0068 bec65fd8 400f0000 00000078 40281000 400f04c0 00000064 00000064
[    3.603698] 9fe0: 00000078 bec65fd0 4020f02f 401b88c6 000f0030 01200011 00102000 04000000
[    3.612304] [<c00ed1f0>] (anon_vma_clone+0x5c/0xac) from [<c00ed260>] (anon_vma_fork+0x20/0x114)
[    3.621551] [<c00ed260>] (anon_vma_fork+0x20/0x114) from [<c0062fa4>] (dup_mm+0x1b8/0x420)
[    3.630218] [<c0062fa4>] (dup_mm+0x1b8/0x420) from [<c00638e8>] (copy_process+0x6ac/0xd24)
[    3.638916] [<c00638e8>] (copy_process+0x6ac/0xd24) from [<c0064074>] (do_fork+0xe8/0x2b8)
[    3.647613] [<c0064074>] (do_fork+0xe8/0x2b8) from [<c0037500>] (ret_fast_syscall+0x0/0x30)
[    3.656372] Code: e5801008 e2801010 e580600c e5842038 (e593200c) 
[    3.662841] ---[ end trace b17e7fc3d0f6349d ]---
[    3.669708] Unable to handle kernel paging request at virtual address 40100000
[    3.677398] pgd = ca004000
[    3.680236] [40100000] *pgd=8a001831, *pte=8ad253cd, *ppte=00000000
[    3.686859] Internal error: Oops: 17 [#3]
[    3.691070] last sysfs file: /sys/devices/virtual/block/loop7/removable
[    3.697998] Modules linked in: omap_wdt twl4030_usb leds_gpio
[    3.704040] CPU: 0    Tainted: G      D      (2.6.39+ #1)
[    3.710632] PC is at rb_insert_color+0x11c/0x12c
[    3.715484] LR is at rb_insert_color+0x100/0x12c
[    3.720306] pc : [<c01f3c5c>]    lr : [<c01f3c40>]    psr: 000f0013
[    3.720336] sp : ca017ed0  ip : ca0b4f95  fp : ca0b44ec
[    3.732360] r10: 00000001  r9 : ca016000  r8 : 00000000
[    3.737854] r7 : ca0c3004  r6 : ca0c301c  r5 : ca0b4f95  r4 : ca0b44ec
[    3.744689] r3 : 40100000  r2 : 00000000  r1 : ca0b4f3c  r0 : ca0b43e4
[    3.751556] Flags: nzcv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment user
[    3.759033] Control: 10c5387d  Table: 8a004019  DAC: 00000015
[    3.765045] Process udevd (pid: 104, stack limit = 0xca0162f0)
[    3.771179] Stack: (0xca017ed0 to 0xca018000)
[    3.775756] 7ec0:                                     ca0c3000 ca0c3000 cabcad10 cabe0300
[    3.784332] 7ee0: ca0b44f0 c0063068 ca0b44d0 cabe0334 ca0c3034 ca0b44dc ca804300 caab6600
[    3.792938] 7f00: 01200011 00000000 caab6804 00000000 400f0068 cabe0300 c0518bf0 c00638e8
[    3.801513] 7f20: 00000000 ca016000 ca017f90 bec65fd0 ca017fb0 00000000 ca012908 00000000
[    3.810089] 7f40: 00000000 01200011 00000000 ca017fb0 00000000 bec65fd0 ca016000 00000000
[    3.818695] 7f60: 00000068 c0064074 400f0068 00000000 00000000 0000002a c00376a4 bec668dc
[    3.827270] 7f80: 00000008 00000000 00000000 400f0068 bec65fd8 400f0000 00000078 c00376a4
[    3.835845] 7fa0: 00000000 c0037500 00000000 400f0068 01200011 00000000 00000000 00000000
[    3.844451] 7fc0: 400f0068 bec65fd8 400f0000 00000078 40281000 400f04c0 00000068 00000068
[    3.853027] 7fe0: 00000078 bec65fd0 4020f02f 401b88c6 000f0030 01200011 01400202 00000220
[    3.861633] [<c01f3c5c>] (rb_insert_color+0x11c/0x12c) from [<c0063068>] (dup_mm+0x27c/0x420)
[    3.870605] [<c0063068>] (dup_mm+0x27c/0x420) from [<c00638e8>] (copy_process+0x6ac/0xd24)
[    3.879272] [<c00638e8>] (copy_process+0x6ac/0xd24) from [<c0064074>] (do_fork+0xe8/0x2b8)
[    3.887969] [<c0064074>] (do_fork+0xe8/0x2b8) from [<c0037500>] (ret_fast_syscall+0x0/0x30)
[    3.896759] Code: e5945000 e3150001 0affffbd e5973000 (e5932000) 
[    3.903198] ---[ end trace b17e7fc3d0f6349e ]---


Failure #3



init: ureadahead main process (39) terminatedfsck from util-linux-ng 2.17.2
e2fsck 1.41.14 (22-Dec-2010)
spare: recovering journal
spare: clean, 1578/131648 files, 50785/526128 blocks
init: udev-fallback-graphics main process (194) terminated with status 1

init: ureadahead-other main process (192) terminated with status 4

init: plymouth main process (40) killed by SEGV signal

init: plymouth-splash main process (206) terminated with status 2

init: plymouth-log main process (217) terminated with status/bin/sh: Illegal option -t
init: rc-sysinit main process (244) terminated with status 2


Failure #4


[    1.168457] VFS: Mounted root (ext3 filesystem) readonly on device 179:2.
[    1.179016] devtmpfs: mounted
[    1.182281] Freeing init memory: 168K
init: ureadahead main process (39) terminatedUsage: mount -V                 : print version
       mount -h                 : print this help
       mount                    : list mounted filesystems
       mount -l                 : idem, including volume labels
So far the informational part. Next the mounting.
The command is `mount [-t fstype] something somewhere'.
Details found in /etc/fstab may be omitted.
       mount -a [-t|-O] ...     : mount all stuff from /etc/fstab
       mount device             : mount device at the known place
       mount directory          : mount known device here
       mount -t type dev dir    : ordinary mount command
Note that one does not really mount a device, one mounts
a filesystem (of the given type) found on the device.
One can also mount an already visible directory tree elsewhere:
       mount --bind olddir newdir
or move a subtree:
       mount --move olddir newdir
One can change the type of mount containing the directory dir:
       mount --make-shared dir
       mount --make-slave dir
       mount --make-private dir
       mount --make-unbindable dir
One can change the type of all the mounts in a mount subtree
containing the directory dir:
       mount --make-rshared dir
       mount --make-rslave dir
       mount --make-rprivate dir
       mount --make-runbindable dir
A device can be given by name, say /dev/hda1 or /dev/cdrom,
or by label, using  -L label  or by uuid, using  -U uuid .
Other options: [-nfFrsvw] [-o options] [-p passwdfd].
For many more details, say  man 8 mount .
mountall: mount /sys/fs/fuse/connections [50] terminated with status 1
mountall: Filesystem could not be mounted: /sys/fs/fuse/connections

Failure #5


[    1.157196] kjournald starting.  Commit interval 5 seconds
[    1.163055] EXT3-fs (mmcblk0p2): mounted filesystem with ordered data mode
[    1.170379] VFS: Mounted root (ext3 filesystem) readonly on device 179:2.
[    1.180938] devtmpfs: mounted
[    1.184204] Freeing init memory: 168K
init: ureadahead main process (39) terminated with status 5

fsck from util-linux-ng 2.17.2
e2fsck 1.41.14 (22-Dec-2010)
spare: recovering journal
spare: clean, 1578/131648 files, 52597/526128 blocks
init: udev-fallback-graphics main process (185) terminated with status 1

init: plymouth main process (40) killed by SEGV signal

init: plymouth-splash main process (194) terminated with status 2

init: ureadahead-other main process (205) terminated with status 4

init: plymouth-log main process (221) terminated with status 1

/bin/sh: Illegal option -t
init: rc-sysinit main process (249) terminated with status 2


I am wondering if there is someone out there that could offer some advice on this.  I think this is only a problem with some of the COMs and some of the revisions.  

Thanks,
Ben