Menu
▾
▴
Re: [Moosefs-users] MooseFS clients on FreeBSD, stability issues
|
From: Michal B. <mic...@ge...> - 2011-02-28 11:42:15
|
Hi! Unfortunately FUSE for FreeBSD has some errors here and there. For the moment we are unable to give any solution. These cases should be reported to the author of the FUSE for FreeBSD. We could suggest downgrade to FreeBSD 7.x or switching to Linux. Unfortunately even on FreeBSD 7.x we hit some strange issues (very seldom, but still). We think there could be some race conditions in FUSE module. Unfortunately these are very rare scenarios, very difficult to repeat. Mfsmount is very stable on Linus and has been thoroughly tested in valgrind against memory problems and race conditions. So we think the below instabilites are not from MooseFS directly. Kind regards Michał Borychowski MooseFS Support Manager _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ Gemius S.A. ul. Wołoska 7, 02-672 Warszawa Budynek MARS, klatka D Tel.: +4822 874-41-00 Fax : +4822 874-41-01 -----Original Message----- From: Raymond Jimenez [mailto:ray...@ca...] Sent: Monday, February 21, 2011 8:33 PM To: moo...@li... Subject: [Moosefs-users] MooseFS clients on FreeBSD, stability issues Hello, We're currently running an MFS client on FreeBSD 8-STABLE, and we're experiencing severe issues with stability. For example, if somebody scp's to the MFS system locally, we have a repeatable crash dump[1]. At other times, Samba will lock up with a page fault; the problem seems deep enough that it sometime refuses to let the kernel dump core. It seems it might be a FUSE issue, since the crash is consistently in the fuse4bsd module, but I'm wondering if you guys know of any workarounds, or if we should simply switch our clients over to Linux. I've looked at several other mailing posts that seem to point towards instabilities[2,3] in fuse4bsd, but it seems either nobody is interested in fixing them, or they don't occur often enough to bother people. Thanks, Raymond Jimenez [1] Key portions of the crash dump are included below; more info available at http://lenin.caltech.edu/~raymondj/core.txt.4 [2] http://lists.freebsd.org/pipermail/freebsd-current/2009-September/011659.htm l [3] http://www.mail-archive.com/fre...@fr.../msg126051.html (IIRC, we did retry rebuilding our module; we think it may be the unmaintained code clashing with new things in 8.2) panic: vm_fault: fault on nofault entry, addr: ffffff843e281000 GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: panic: vm_fault: fault on nofault entry, addr: ffffff843e281000 cpuid = 6 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a kdb_backtrace() at kdb_backtrace+0x37 panic() at panic+0x182 vm_fault() at vm_fault+0x1f38 trap_pfault() at trap_pfault+0x308 trap() at trap+0x32f calltrap() at calltrap+0x8 --- trap 0xc, rip = 0xffffffff8066995b, rsp = 0xffffff8488c8d890, rbp = 0xffffff8488c8d910 --- copyout() at copyout+0x3b fusedev_read() at fusedev_read+0x1b3 devfs_read_f() at devfs_read_f+0x81 dofileread() at dofileread+0x88 kern_readv() at kern_readv+0x52 read() at read+0x4e syscallenter() at syscallenter+0x1d2 syscall() at syscall+0x40 Xfast_syscall() at Xfast_syscall+0xe2 and Loaded symbols for /usr/local/modules/fuse.ko #0 doadump () at pcpu.h:224 224 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump () at pcpu.h:224 #1 0xffffffff8041be83 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:419 #2 0xffffffff8041c2f2 in panic (fmt=Variable "fmt" is not available. ) at /usr/src/sys/kern/kern_shutdown.c:592 #3 0xffffffff806330df in vm_fault (map=0xffffff0001000000, vaddr=18446743542176419840, fault_type=1 '\001', fault_flags=0) at /usr/src/sys/vm/vm_fault.c:283 #4 0xffffffff8066b7d7 in trap_pfault (frame=0xffffff8488c8d7e0, usermode=0) at /usr/src/sys/amd64/amd64/trap.c:688 #5 0xffffffff8066bbcb in trap (frame=0xffffff8488c8d7e0) at /usr/src/sys/amd64/amd64/trap.c:449 #6 0xffffffff80654188 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:224 #7 0xffffffff8066995b in copyout () at /usr/src/sys/amd64/amd64/support.S:258 #8 0xffffffff8042377b in uiomove (cp=0xffffff843e27f000, n=16384, uio=0xffffff8488c8daa0) at /usr/src/sys/kern/kern_subr.c:168 #9 0xffffffff80e23c58 in fusedev_read () from /usr/local/modules/fuse.ko #10 0xffffffff803a1a43 in devfs_read_f (fp=0x1, uio=0xffffff00207da800, cred=Variable "cred" is not available. ) at /usr/src/sys/fs/devfs/devfs_vnops.c:1084 #11 0xffffffff8045e109 in dofileread (td=0xffffff01150e78c0, fd=5, fp=0xffffff011508b0f0, auio=0xffffff8488c8daa0, offset=Variable "offset" is not available. ) at file.h:227 #12 0xffffffff8045e401 in kern_readv (td=0xffffff01150e78c0, fd=5, auio=0xffffff8488c8daa0) at /usr/src/sys/kern/sys_generic.c:238 #13 0xffffffff8045e4d8 in read (td=Variable "td" is not available. ) at /usr/src/sys/kern/sys_generic.c:154 #14 0xffffffff80459b78 in syscallenter (td=0xffffff01150e78c0, sa=0xffffff8488c8dba0) at /usr/src/sys/kern/subr_trap.c:315 #15 0xffffffff8066b81f in syscall (frame=0xffffff8488c8dc40) at /usr/src/sys/amd64/amd64/trap.c:888 #16 0xffffffff80654462 in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:377 #17 0x0000000800b77e9c in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) -- Raymond Jimenez <ray...@ca...> http://shia.wsyntax.com <> http://fusion.wsyntax.com ---------------------------------------------------------------------------- -- The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE: Pinpoint memory and threading errors before they happen. Find and fix more than 250 security defects in the development cycle. Locate bottlenecks in serial and parallel code that limit performance. http://p.sf.net/sfu/intel-dev2devfeb _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
