|
From: Toralf F. <tor...@gm...> - 2013-03-12 21:00:06
Attachments:
g7c6baa3.config
|
While trying trinity under a UML I often run into this situation : 2013-03-12T21:54:41.934+01:00 trinity kernel: ------------[ cut here ]------------ 2013-03-12T21:54:41.934+01:00 trinity kernel: WARNING: at mm/page_alloc.c:2386 __alloc_pages_nodemask+0x153/0x750() 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fcfc: [<083426b8>] dump_stack+0x22/0x24 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fd14: [<0807d11a>] warn_slowpath_common+0x5a/0x80 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fd3c: [<0807d1e3>] warn_slowpath_null+0x23/0x30 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fd4c: [<080d2bb3>] __alloc_pages_nodemask+0x153/0x750 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fdd8: [<080d31d8>] __get_free_pages+0x28/0x50 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fdf0: [<080fbe1f>] __kmalloc_track_caller+0x3f/0x180 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fe18: [<080de616>] memdup_user+0x26/0x70 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fe34: [<080de81e>] strndup_user+0x3e/0x60 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837fe50: [<0823c493>] sys_request_key+0x53/0x170 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837feac: [<08062a92>] handle_syscall+0x82/0xb0 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837fef4: [<08074e7d>] userspace+0x46d/0x590 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837ffec: [<0805f7cc>] fork_handler+0x6c/0x70 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837fffc: [<00000000>] 0x0 2013-03-12T21:54:41.935+01:00 trinity kernel: 2013-03-12T21:54:41.935+01:00 trinity kernel: ---[ end trace 2e631e8b4588be93 ]--- 2013-03-12T21:54:41.935+01:00 trinity kernel: VFS: Warning: trinity-child0 using old stat() call. Recompile your binary. 2013-03-12T21:54:41.935+01:00 trinity kernel: VFS: Warning: trinity-child0 using old stat() call. Recompile your binary. >From the author of trinity I was told: Looks like the "tried to kmalloc more than what kmalloc can do" bug. That shows up from time to time in various places. Not sure how this can happen from this trace, because it looks like we clamp everywhere with PAGE_SIZE. Possibly a UML bug, dunno. The host kernel is 3.7.10 at a 32bit stable Gentoo, the UML guest kernels are 3.8.2 and 3.9-rc2--112-g7c6baa3 from the later the config is attached. -- MfG/Sincerely Toralf Förster pgp finger print: 7B1A 07F4 EC82 0F90 D4C2 8936 872A E508 7DB6 9DA3 |
|
From: richard -r. w. <ric...@gm...> - 2013-03-13 10:16:04
|
On Tue, Mar 12, 2013 at 9:59 PM, Toralf Förster <tor...@gm...> wrote: > While trying trinity under a UML I often run into this situation : > > > 2013-03-12T21:54:41.934+01:00 trinity kernel: ------------[ cut here ]------------ > 2013-03-12T21:54:41.934+01:00 trinity kernel: WARNING: at mm/page_alloc.c:2386 __alloc_pages_nodemask+0x153/0x750() > 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fcfc: [<083426b8>] dump_stack+0x22/0x24 > 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fd14: [<0807d11a>] warn_slowpath_common+0x5a/0x80 > 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fd3c: [<0807d1e3>] warn_slowpath_null+0x23/0x30 > 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fd4c: [<080d2bb3>] __alloc_pages_nodemask+0x153/0x750 > 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fdd8: [<080d31d8>] __get_free_pages+0x28/0x50 > 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fdf0: [<080fbe1f>] __kmalloc_track_caller+0x3f/0x180 > 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fe18: [<080de616>] memdup_user+0x26/0x70 > 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fe34: [<080de81e>] strndup_user+0x3e/0x60 > 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837fe50: [<0823c493>] sys_request_key+0x53/0x170 > 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837feac: [<08062a92>] handle_syscall+0x82/0xb0 > 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837fef4: [<08074e7d>] userspace+0x46d/0x590 > 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837ffec: [<0805f7cc>] fork_handler+0x6c/0x70 > 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837fffc: [<00000000>] 0x0 > 2013-03-12T21:54:41.935+01:00 trinity kernel: > 2013-03-12T21:54:41.935+01:00 trinity kernel: ---[ end trace 2e631e8b4588be93 ]--- > 2013-03-12T21:54:41.935+01:00 trinity kernel: VFS: Warning: trinity-child0 using old stat() call. Recompile your binary. > 2013-03-12T21:54:41.935+01:00 trinity kernel: VFS: Warning: trinity-child0 using old stat() call. Recompile your binary. Do you see this with both slub and slab? -- Thanks, //richard |
|
From: Toralf F. <tor...@gm...> - 2013-03-13 19:12:45
|
On 03/13/2013 11:15 AM, richard -rw- weinberger wrote: > On Tue, Mar 12, 2013 at 9:59 PM, Toralf Förster <tor...@gm...> wrote: >> While trying trinity under a UML I often run into this situation : >> >> >> 2013-03-12T21:54:41.934+01:00 trinity kernel: ------------[ cut here ]------------ >> 2013-03-12T21:54:41.934+01:00 trinity kernel: WARNING: at mm/page_alloc.c:2386 __alloc_pages_nodemask+0x153/0x750() >> 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fcfc: [<083426b8>] dump_stack+0x22/0x24 >> 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fd14: [<0807d11a>] warn_slowpath_common+0x5a/0x80 >> 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fd3c: [<0807d1e3>] warn_slowpath_null+0x23/0x30 >> 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fd4c: [<080d2bb3>] __alloc_pages_nodemask+0x153/0x750 >> 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fdd8: [<080d31d8>] __get_free_pages+0x28/0x50 >> 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fdf0: [<080fbe1f>] __kmalloc_track_caller+0x3f/0x180 >> 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fe18: [<080de616>] memdup_user+0x26/0x70 >> 2013-03-12T21:54:41.934+01:00 trinity kernel: 3837fe34: [<080de81e>] strndup_user+0x3e/0x60 >> 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837fe50: [<0823c493>] sys_request_key+0x53/0x170 >> 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837feac: [<08062a92>] handle_syscall+0x82/0xb0 >> 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837fef4: [<08074e7d>] userspace+0x46d/0x590 >> 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837ffec: [<0805f7cc>] fork_handler+0x6c/0x70 >> 2013-03-12T21:54:41.935+01:00 trinity kernel: 3837fffc: [<00000000>] 0x0 >> 2013-03-12T21:54:41.935+01:00 trinity kernel: >> 2013-03-12T21:54:41.935+01:00 trinity kernel: ---[ end trace 2e631e8b4588be93 ]--- >> 2013-03-12T21:54:41.935+01:00 trinity kernel: VFS: Warning: trinity-child0 using old stat() call. Recompile your binary. >> 2013-03-12T21:54:41.935+01:00 trinity kernel: VFS: Warning: trinity-child0 using old stat() call. Recompile your binary. > > Do you see this with both slub and slab? > With SLUB (linux-v3.9-rc2-178-g4febd95) I see that behaviour. A recent UML kernel with SLAB (linux-v3.9-rc2-188-g6c23cbb) holds just here in trinity output : [1050] [2174] getrlimit(resource=3, rlim=1) = -1 (Bad address) [1050] [2175] ustat(dev=4096, ubuf=4) = -1 (Invalid argument) [1050] [2176] mremap(addr=0, old_len=0x80000001, new_len=0xffa2, flags=1, new_addr=0) [watchdog] 2177 iterations. [F:1790 S:386] [watchdog] kernel became tainted! Last seed was 2735014321 after that the system hangs. I can still ssh into it from other console and run "ps -ef" , but even a "ps -ef | grep <bla bla>" then hangs too and can't be stopped via Ctrl.C. Furthermore "gdb -p <pid>" could not be run, b/c in the meanwhile the pids are vanished too (at least from /proc). And the syslog and anything else is empty. Host kernel is always 3.7.10. -- MfG/Sincerely Toralf Förster pgp finger print: 7B1A 07F4 EC82 0F90 D4C2 8936 872A E508 7DB6 9DA3 |
|
From: Toralf F. <tor...@gm...> - 2013-03-13 20:37:10
|
On 03/13/2013 11:15 AM, richard -rw- weinberger wrote: > Do you see this with both slub and slab? With SLAB however (UML kernel v3.9-rc2-188-g6c23cbb-slab) I see those things : 2013-03-13T21:30:01.000+01:00 trinity cron[1142]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons) 2013-03-13T21:32:34.763+01:00 trinity kernel: trinity-watchdo[1165]: segfault at 42c ip 0804c5b6 sp bf90d38c error 4 in trinity[8048000+16000] 2013-03-13T21:34:23.270+01:00 trinity kernel: BUG: Bad page map in process trinity-child0 pte:002fd045 pmd:2ec4c1e1 2013-03-13T21:34:23.270+01:00 trinity kernel: page:0a638fa0 count:1 mapcount:-1 mapping: (null) index:0x0 2013-03-13T21:34:23.270+01:00 trinity kernel: page flags: 0x400(reserved) 2013-03-13T21:34:23.270+01:00 trinity kernel: addr:00100000 vm_flags:00060055 anon_vma: (null) mapping: (null) index:100 2013-03-13T21:34:23.270+01:00 trinity kernel: vma->vm_ops->fault: special_mapping_fault+0x0/0x80 2013-03-13T21:34:23.270+01:00 trinity kernel: 36c9fd1c: [<0833fa68>] dump_stack+0x22/0x24 2013-03-13T21:34:23.270+01:00 trinity kernel: 36c9fd34: [<08340e21>] print_bad_pte+0x17b/0x197 2013-03-13T21:34:23.270+01:00 trinity kernel: 36c9fd78: [<080e5368>] unmap_single_vma+0x268/0x430 2013-03-13T21:34:23.270+01:00 trinity kernel: 36c9fdd8: [<080e5a67>] unmap_vmas+0x37/0x50 2013-03-13T21:34:23.270+01:00 trinity kernel: 36c9fdf4: [<080e8ba0>] unmap_region+0x80/0xe0 2013-03-13T21:34:23.271+01:00 trinity kernel: 36c9fe30: [<080ea8a1>] do_munmap+0x231/0x2a0 2013-03-13T21:34:23.271+01:00 trinity kernel: 36c9fe68: [<080ecd28>] sys_mremap+0x248/0x480 2013-03-13T21:34:23.271+01:00 trinity kernel: 36c9feac: [<08062a82>] handle_syscall+0x82/0xb0 2013-03-13T21:34:23.271+01:00 trinity kernel: 36c9fef4: [<08074d9d>] userspace+0x46d/0x590 2013-03-13T21:34:23.271+01:00 trinity kernel: 36c9ffec: [<0805f7bc>] fork_handler+0x6c/0x70 2013-03-13T21:34:23.271+01:00 trinity kernel: 36c9fffc: [<00000000>] 0x0 2013-03-13T21:34:23.271+01:00 trinity kernel: 2013-03-13T21:34:23.271+01:00 trinity kernel: Disabling lock debugging due to kernel taint 2013-03-13T21:34:23.271+01:00 trinity kernel: BUG: Bad page state in process trinity-child0 pfn:002fd 2013-03-13T21:34:23.271+01:00 trinity kernel: page:0a638fa0 count:0 mapcount:-1 mapping: (null) index:0x0 2013-03-13T21:34:23.272+01:00 trinity kernel: page flags: 0x400(reserved) 2013-03-13T21:34:23.272+01:00 trinity kernel: 36c9fcd8: [<0833fa68>] dump_stack+0x22/0x24 2013-03-13T21:34:23.272+01:00 trinity kernel: 36c9fcf0: [<080d1a05>] bad_page+0xb5/0xe0 2013-03-13T21:34:23.272+01:00 trinity kernel: 36c9fd0c: [<080d1aa3>] free_pages_prepare+0x73/0xb0 2013-03-13T21:34:23.272+01:00 trinity kernel: 36c9fd28: [<080d2ebd>] free_hot_cold_page+0x1d/0xf0 2013-03-13T21:34:23.272+01:00 trinity kernel: 36c9fd4c: [<080d566e>] __put_single_page+0x1e/0x30 2013-03-13T21:34:23.272+01:00 trinity kernel: 36c9fd60: [<080d5967>] put_page+0x27/0x30 2013-03-13T21:34:23.272+01:00 trinity kernel: 36c9fd68: [<080f28dc>] free_page_and_swap_cache+0x3c/0x50 2013-03-13T21:34:23.272+01:00 trinity kernel: 36c9fd78: [<080e5385>] unmap_single_vma+0x285/0x430 2013-03-13T21:34:23.272+01:00 trinity kernel: 36c9fdd8: [<080e5a67>] unmap_vmas+0x37/0x50 2013-03-13T21:34:23.273+01:00 trinity kernel: 36c9fdf4: [<080e8ba0>] unmap_region+0x80/0xe0 2013-03-13T21:34:23.273+01:00 trinity kernel: 36c9fe30: [<080ea8a1>] do_munmap+0x231/0x2a0 2013-03-13T21:34:23.273+01:00 trinity kernel: 36c9fe68: [<080ecd28>] sys_mremap+0x248/0x480 2013-03-13T21:34:23.273+01:00 trinity kernel: 36c9feac: [<08062a82>] handle_syscall+0x82/0xb0 2013-03-13T21:34:23.273+01:00 trinity kernel: 36c9fef4: [<08074d9d>] userspace+0x46d/0x590 2013-03-13T21:34:23.273+01:00 trinity kernel: 36c9ffec: [<0805f7bc>] fork_handler+0x6c/0x70 2013-03-13T21:34:23.273+01:00 trinity kernel: 36c9fffc: [<00000000>] 0x0 2013-03-13T21:34:23.273+01:00 trinity kernel: 2013-03-13T21:34:23.273+01:00 trinity kernel: BUG: Bad page map in process trinity-child0 pte:2ed45045 pmd:2ec4c1e1 2013-03-13T21:34:23.273+01:00 trinity kernel: page:0ac0d8a0 count:1 mapcount:-1 mapping: (null) index:0x0 2013-03-13T21:34:23.275+01:00 trinity kernel: page flags: 0x0() 2013-03-13T21:34:23.275+01:00 trinity kernel: addr:00101000 vm_flags:00060055 anon_vma: (null) mapping: (null) index:101 2013-03-13T21:34:23.275+01:00 trinity kernel: vma->vm_ops->fault: special_mapping_fault+0x0/0x80 2013-03-13T21:34:23.275+01:00 trinity kernel: 36c9fd1c: [<0833fa68>] dump_stack+0x22/0x24 2013-03-13T21:34:23.275+01:00 trinity kernel: 36c9fd34: [<08340e21>] print_bad_pte+0x17b/0x197 2013-03-13T21:34:23.275+01:00 trinity kernel: 36c9fd78: [<080e5368>] unmap_single_vma+0x268/0x430 2013-03-13T21:34:23.275+01:00 trinity kernel: 36c9fdd8: [<080e5a67>] unmap_vmas+0x37/0x50 2013-03-13T21:34:23.275+01:00 trinity kernel: 36c9fdf4: [<080e8ba0>] unmap_region+0x80/0xe0 2013-03-13T21:34:23.275+01:00 trinity kernel: 36c9fe30: [<080ea8a1>] do_munmap+0x231/0x2a0 2013-03-13T21:34:23.275+01:00 trinity kernel: 36c9fe68: [<080ecd28>] sys_mremap+0x248/0x480 2013-03-13T21:34:23.276+01:00 trinity kernel: 36c9feac: [<08062a82>] handle_syscall+0x82/0xb0 2013-03-13T21:34:23.276+01:00 trinity kernel: 36c9fef4: [<08074d9d>] userspace+0x46d/0x590 2013-03-13T21:34:23.276+01:00 trinity kernel: 36c9ffec: [<0805f7bc>] fork_handler+0x6c/0x70 2013-03-13T21:34:23.276+01:00 trinity kernel: 36c9fffc: [<00000000>] 0x0 2013-03-13T21:34:23.276+01:00 trinity kernel: 2013-03-13T21:34:23.276+01:00 trinity kernel: BUG: Bad page state in process trinity-child0 pfn:2ed45 2013-03-13T21:34:23.276+01:00 trinity kernel: page:0ac0d8a0 count:0 mapcount:-1 mapping: (null) index:0x0 2013-03-13T21:34:23.276+01:00 trinity kernel: page flags: 0x0() 2013-03-13T21:34:23.276+01:00 trinity kernel: 36c9fcd8: [<0833fa68>] dump_stack+0x22/0x24 2013-03-13T21:34:23.276+01:00 trinity kernel: 36c9fcf0: [<080d1a05>] bad_page+0xb5/0xe0 2013-03-13T21:34:23.277+01:00 trinity kernel: 36c9fd0c: [<080d1aa3>] free_pages_prepare+0x73/0xb0 2013-03-13T21:34:23.277+01:00 trinity kernel: 36c9fd28: [<080d2ebd>] free_hot_cold_page+0x1d/0xf0 2013-03-13T21:34:23.277+01:00 trinity kernel: 36c9fd4c: [<080d566e>] __put_single_page+0x1e/0x30 2013-03-13T21:34:23.277+01:00 trinity kernel: 36c9fd60: [<080d5967>] put_page+0x27/0x30 2013-03-13T21:34:23.277+01:00 trinity kernel: 36c9fd68: [<080f28dc>] free_page_and_swap_cache+0x3c/0x50 2013-03-13T21:34:23.277+01:00 trinity kernel: 36c9fd78: [<080e5385>] unmap_single_vma+0x285/0x430 2013-03-13T21:34:23.277+01:00 trinity kernel: 36c9fdd8: [<080e5a67>] unmap_vmas+0x37/0x50 2013-03-13T21:34:23.277+01:00 trinity kernel: 36c9fdf4: [<080e8ba0>] unmap_region+0x80/0xe0 2013-03-13T21:34:23.277+01:00 trinity kernel: 36c9fe30: [<080ea8a1>] do_munmap+0x231/0x2a0 2013-03-13T21:34:23.277+01:00 trinity kernel: 36c9fe68: [<080ecd28>] sys_mremap+0x248/0x480 2013-03-13T21:34:23.279+01:00 trinity kernel: 36c9feac: [<08062a82>] handle_syscall+0x82/0xb0 2013-03-13T21:34:23.279+01:00 trinity kernel: 36c9fef4: [<08074d9d>] userspace+0x46d/0x590 2013-03-13T21:34:23.279+01:00 trinity kernel: 36c9ffec: [<0805f7bc>] fork_handler+0x6c/0x70 2013-03-13T21:34:23.279+01:00 trinity kernel: 36c9fffc: [<00000000>] 0x0 2013-03-13T21:34:23.279+01:00 trinity kernel: 2013-03-13T21:34:23.279+01:00 trinity kernel: Stub registers - 2013-03-13T21:34:23.279+01:00 trinity kernel: 0 - 100000 2013-03-13T21:34:23.279+01:00 trinity kernel: 1 - 2000 2013-03-13T21:34:23.279+01:00 trinity kernel: 2 - 0 2013-03-13T21:34:23.279+01:00 trinity kernel: 3 - 0 2013-03-13T21:34:23.280+01:00 trinity kernel: 4 - 0 2013-03-13T21:34:23.280+01:00 trinity kernel: 5 - 0 2013-03-13T21:34:23.280+01:00 trinity kernel: 6 - 0 2013-03-13T21:34:23.280+01:00 trinity kernel: 7 - 7b 2013-03-13T21:34:23.280+01:00 trinity kernel: 8 - 7b 2013-03-13T21:34:23.280+01:00 trinity kernel: 9 - 0 2013-03-13T21:34:23.280+01:00 trinity kernel: 10 - 33 2013-03-13T21:34:23.280+01:00 trinity kernel: 11 - ffffffff 2013-03-13T21:34:23.280+01:00 trinity kernel: 12 - 1000c3 2013-03-13T21:34:23.280+01:00 trinity kernel: 13 - 73 2013-03-13T21:34:23.282+01:00 trinity kernel: 14 - 10206 2013-03-13T21:34:23.282+01:00 trinity kernel: 15 - 101028 2013-03-13T21:34:23.282+01:00 trinity kernel: 16 - 7b 2013-03-13T21:34:23.282+01:00 trinity kernel: wait_stub_done : failed to wait for SIGTRAP, pid = 731, n = 731, errno = 0, status = 0xb7f -- MfG/Sincerely Toralf Förster pgp finger print: 7B1A 07F4 EC82 0F90 D4C2 8936 872A E508 7DB6 9DA3 |