Menu
▾
▴
moosefs-users — Mailing list for MooseFS Users
You can subscribe to this list here.
| 2009 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
(4) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2010 |
Jan
(20) |
Feb
(11) |
Mar
(11) |
Apr
(9) |
May
(22) |
Jun
(85) |
Jul
(94) |
Aug
(80) |
Sep
(72) |
Oct
(64) |
Nov
(69) |
Dec
(89) |
| 2011 |
Jan
(72) |
Feb
(109) |
Mar
(116) |
Apr
(117) |
May
(117) |
Jun
(102) |
Jul
(91) |
Aug
(72) |
Sep
(51) |
Oct
(41) |
Nov
(55) |
Dec
(74) |
| 2012 |
Jan
(45) |
Feb
(77) |
Mar
(99) |
Apr
(113) |
May
(132) |
Jun
(75) |
Jul
(70) |
Aug
(58) |
Sep
(58) |
Oct
(37) |
Nov
(51) |
Dec
(15) |
| 2013 |
Jan
(28) |
Feb
(16) |
Mar
(25) |
Apr
(38) |
May
(23) |
Jun
(39) |
Jul
(42) |
Aug
(19) |
Sep
(41) |
Oct
(31) |
Nov
(18) |
Dec
(18) |
| 2014 |
Jan
(17) |
Feb
(19) |
Mar
(39) |
Apr
(16) |
May
(10) |
Jun
(13) |
Jul
(17) |
Aug
(13) |
Sep
(8) |
Oct
(53) |
Nov
(23) |
Dec
(7) |
| 2015 |
Jan
(35) |
Feb
(13) |
Mar
(14) |
Apr
(56) |
May
(8) |
Jun
(18) |
Jul
(26) |
Aug
(33) |
Sep
(40) |
Oct
(37) |
Nov
(24) |
Dec
(20) |
| 2016 |
Jan
(38) |
Feb
(20) |
Mar
(25) |
Apr
(14) |
May
(6) |
Jun
(36) |
Jul
(27) |
Aug
(19) |
Sep
(36) |
Oct
(24) |
Nov
(15) |
Dec
(16) |
| 2017 |
Jan
(8) |
Feb
(13) |
Mar
(17) |
Apr
(20) |
May
(28) |
Jun
(10) |
Jul
(20) |
Aug
(3) |
Sep
(18) |
Oct
(8) |
Nov
|
Dec
(5) |
| 2018 |
Jan
(15) |
Feb
(9) |
Mar
(12) |
Apr
(7) |
May
(123) |
Jun
(41) |
Jul
|
Aug
(14) |
Sep
|
Oct
(15) |
Nov
|
Dec
(7) |
| 2019 |
Jan
(2) |
Feb
(9) |
Mar
(2) |
Apr
(9) |
May
|
Jun
|
Jul
(2) |
Aug
|
Sep
(6) |
Oct
(1) |
Nov
(12) |
Dec
(2) |
| 2020 |
Jan
(2) |
Feb
|
Mar
|
Apr
(3) |
May
|
Jun
(4) |
Jul
(4) |
Aug
(1) |
Sep
(18) |
Oct
(2) |
Nov
|
Dec
|
| 2021 |
Jan
|
Feb
(3) |
Mar
|
Apr
|
May
|
Jun
|
Jul
(6) |
Aug
|
Sep
(5) |
Oct
(5) |
Nov
(3) |
Dec
|
| 2022 |
Jan
|
Feb
|
Mar
(3) |
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Germán L. <ger...@tw...> - 2010-10-26 08:47:13
|
Hello, We are choosing a distributed file system to create a scalable HA storage architecture for our solution. We are interested in MooseFS, as it definitely suits our needs. However our applications are Windows-based and will need to access MooseFS to store and retrieve files. How can that be achieved? Thanks very much in advance, Germán. -- Germán Latorre Antín Principal Software Engineer TwinDocs - https://www.twindocs.com (+34) 902 523 232 |
|
From: Reinis R. <r...@ro...> - 2010-10-25 14:33:27
|
> Wouldn't you have more chunks, then you would have sufficient redundancy > to > cover a further failure that the 10 days wouldn't be important ? Of course, but that was not the question - I would just like to know the mechanism/algorithm behind without diving in the source code. Own tests showed that just by adding few more chunkservers the replication speed goes up so it partly answers my own innitial mail (just if possible wanted some detailed clarification from devs). > 1+ million files created must be extreme usage. Yes, we are migrating from a GlusterFS (so far more just in test scenario though) solution - with 200+ million files. rr |
|
From: Steve <st...@bo...> - 2010-10-25 13:11:48
|
Wouldn't you have more chunks, then you would have sufficient redundancy to cover a further failure that the 10 days wouldn't be important ? 1+ million files created must be extreme usage. -------Original Message------- From: Reinis Rozitis Date: 25/10/2010 13:27:03 To: moosefs-users Subject: Re: [Moosefs-users] Replication mechanism/speed > While non-aggressive replication is fine (doesn't degrade the rest of the > system) is there a way to adjust / finetune it (or maybe its done > automatically)? > > Is it somewhat connected to also chunkserver count - like more > chunkservers > = higher replication rates (since the replication is distributed then) or > the goal size (the more file is undergoal (for example 1 copy out of 6) > the > faster it gets replicated) or its just some preset/hardcoded rate? Any info on this? We have simulated a downed node for a day and now the undergoal chunk/file count is like 1+ mil. With the 2 node setup it would take like 10 days to get in sync (while the new file/chunk creation is easily 100x times faster). RR ----------------------------------------------------------------------------- Nokia and AT&T present the 2010 Calling All Innovators-North America contest Create new apps & games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
|
From: Reinis R. <r...@ro...> - 2010-10-25 12:26:35
|
> While non-agressive replication is fine (doesn't degrade the rest of the > system) is there a way to adjust / finetune it (or maybe its done > automatically)? > > Is it somewhat connected to also chunkserver count - like more > chunkservers > = higher replication rates (since the replication is distributed then) or > the goal size (the more file is undergoal (for example 1 copy out of 6) > the > faster it gets replicated) or its just some preset/hardcoded rate? Any info on this? We have simulated a downed node for a day and now the undergoal chunk/file count is like 1+ mil. With the 2 node setup it would take like 10 days to get in sync (while the new file/chunk creation is easily 100x times faster). rr |
|
From: Thomas S H. <tha...@gm...> - 2010-10-22 18:26:55
|
I am using a moosefs mount for kvm virtual machine images. These images are showing somewhat iratic performance profiles, some of them operate at full speed, around 40-60MB/s, but some of them are moving along at only 4-8 MB/s. I am running tests on multiple levels of my system to try and find where the problems are. My question for the list is simply, do you all have any suggestions as to what I can check? I am running Ubuntu 10.04 on all systems (I am planning on trying an Archlinux vm eventually) and moosefs 1.6.17. Thank you for your suggestions! -Tom Hatch |
|
From: Roast <zha...@gm...> - 2010-10-21 11:08:48
|
Hi, all. The "Master Charts" at the cgi script, It shows that "chunk deletions (per minute) " is very high, for about 70, and it continued for about 3 hours. But at the trash directory which mount by " /opt/app/mfs/bin/mfsmount -m /mnt -H 192.150.26.100", It shows only for about only 10 files during the past 3 hours. Also we checked the log of our application, it shows no file deletions at those time. So I wonder why "chunk deletions (per minute) " at the mfs.cgi script report so high. Anybody else has met the same situation? And what happend with MFS? Thanks all. -- The time you enjoy wasting is not wasted time! |
|
From: leon h. <cod...@gm...> - 2010-10-21 02:58:18
|
hello, Michal I try delete some datas in mfsclient, but mfsmaster used ram is not reduced. I had set the trash time is 0 (mfssettrashtime 0 / usr / mfs /), what's the reason？ I try modify in mfsmaster/chunk.c (48 49 50 line) and in mfsmaster/filesystem.c (53 54 line) chunk.c //////////////////////////////////////////////////////////// 48 /*#define USE_SLIST_BUCKETS 1*/ 49 /*#define USE_FLIST_BUCKETS 1*/ 50 /*#define USE_CHUNK_BUCKETS 1*/ filesystem.c /////////////////////////////////////////////////// 53 /*#define USE_FREENODE_BUCKETS 1*/ 54 /*#define USE_CUIDREC_BUCKETS 1*/ But mfsmaster used ram is still not reduced! what's the reason？Is it a memory leak or problem of trash? I am sorry ,my english is not good. thanks Regards -leon hong |
|
From: Anh K. H. <ky...@vi...> - 2010-10-21 02:31:56
|
On Thu, 21 Oct 2010 10:21:01 +0800 leon hong <cod...@gm...> wrote: > I try delete some datas in mfsclient, but mfsmaster used ram is > not reduced. I had set the trash time is 0 (mfssettrashtime 0 / > usr / mfs /), what's the reason？ You may mount your trash bin somewhere (use meta options in `mfsmount`) and clean up your trash. > I am sorry ,my english is not good. /me too :) -- Anh Ky Huynh |
|
From: leon h. <cod...@gm...> - 2010-10-21 02:21:08
|
hello,all！ I try delete some datas in mfsclient, but mfsmaster used ram is not reduced. I had set the trash time is 0 (mfssettrashtime 0 / usr / mfs /), what's the reason？ I am sorry ,my english is not good. -leon hong |
|
From: Thomas S H. <tha...@gm...> - 2010-10-20 14:34:36
|
I am also seeing these log messages, and I am very curious as to what the implications are. Thanks -Tom Hatch On Wed, Oct 20, 2010 at 5:03 AM, Stas Oskin <sta...@gm...> wrote: > Hi. > > We noticed the following message in logs: > file: 28, index: 7, chunk: 992, version: 1 - writeworker: connection with > (C0A8020F:9422) was timed out (unfinished writes: 5; try counter: 1) > > MFS seems to be working and functioning normally. > It seems to be related to write process timing-out, but connection is > normal. > > Can it be caused by slow speed of disks? Also, what counter 1 can do, and > where it can be changed? > Finally, what operation system will return to application - that write > operation has failed? > > Thanks in advance! > > > ------------------------------------------------------------------------------ > Download new Adobe(R) Flash(R) Builder(TM) 4 > The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly > Flex(R) Builder(TM)) enable the development of rich applications that run > across multiple browsers and platforms. Download your free trials today! > http://p.sf.net/sfu/adobe-dev2dev > _______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users > > |
|
From: Reinis R. <r...@ro...> - 2010-10-20 14:06:55
|
Hello, I want to clarify few things regarding MooseFS (didnt find clear answers in the FAQ section): On what principle (speed/rate) does the replication of chunks work? While actively using a MFS attached filesystem (rsyncing to it) switched of one of the chunkservers and of course when bringing it up again bunch of files were undergoal - atm I'm seeing something like 1 file/chunk replicated per second. While non-agressive replication is fine (doesn't degrade the rest of the system) is there a way to adjust / finetune it (or maybe its done automatically)? Is it somewhat connected to also chunkserver count - like more chunkservers = higher replication rates (since the replication is distributed then) or the goal size (the more file is undergoal (for example 1 copy out of 6) the faster it gets replicated) or its just some preset/hardcoded rate? rr |
|
From: leon h. <cod...@gm...> - 2010-10-20 13:46:05
|
when I delete some datas, the ram not decrease!! 2010/10/20 leon hong <cod...@gm...> > hi, all > > mfsmaster in ram is increasing.How to solve this problem? it is not enough > ram in mfsmaster. > mfsmaster is Memory leak?? > |
|
From: leon h. <cod...@gm...> - 2010-10-20 13:45:14
|
hi, all mfsmaster in ram is increasing.How to solve this problem? it is not enough ram in mfsmaster. mfsmaster is Memory leak?? |
|
From: Stas O. <sta...@gm...> - 2010-10-20 11:04:05
|
Hi. We noticed the following message in logs: file: 28, index: 7, chunk: 992, version: 1 - writeworker: connection with (C0A8020F:9422) was timed out (unfinished writes: 5; try counter: 1) MFS seems to be working and functioning normally. It seems to be related to write process timing-out, but connection is normal. Can it be caused by slow speed of disks? Also, what counter 1 can do, and where it can be changed? Finally, what operation system will return to application - that write operation has failed? Thanks in advance! |
|
From: leon h. <cod...@gm...> - 2010-10-20 10:33:57
|
hello, Laurent! Thanks for your email. I am sorry my English is not good. In fact, I had a problem. I know metadata are cached in ram. metada is very big In my applications.metadata in ram is increasing, so I want to delete some datas. my question is: when I delete some datas in client, mfsmaster in ram will is decrease or unchange? 2010/10/20 Laurent Wandrebeck <lw...@hy...> > On Wed, 20 Oct 2010 17:27:06 +0800 > leon hong <cod...@gm...> wrote: > > > hi` all > Hello Leon, > > > > I have two questions about memory of mfsmaster. > > 1. When I increase the write data, read data from mfsmaster, mfsmaster > > memory has always been 78m, why? > I'm unsure to understand your question, doesn't seem correct english to > me :) Will try to answer anyway. > metadata are cached in ram. So, mfsmaster memory consumption > varies with the number of files and directories, not on load. > > > <snip> > > > > 2. When I delete data, mfsmaster memory will be decrease or unchanged? > It will decrease. don't know though if it will once data are in the > trash or really deleted. > See http://www.moosefs.org/reference-guide.html#requirements for some > details. > HTH, > -- > Laurent Wandrebeck > HYGEOS, Earth Observation Department / Observation de la Terre > Euratechnologies > 165 Avenue de Bretagne > 59000 Lille, France > tel: +33 3 20 08 24 98 > http://www.hygeos.com > GPG fingerprint/Empreinte GPG: F5CA 37A4 6D03 A90C 7A1D 2A62 54E6 EF2C > D17C F64C > |
|
From: Laurent W. <lw...@hy...> - 2010-10-20 10:12:43
|
On Wed, 20 Oct 2010 17:27:06 +0800 leon hong <cod...@gm...> wrote: > hi` all Hello Leon, > > I have two questions about memory of mfsmaster. > 1. When I increase the write data, read data from mfsmaster, mfsmaster > memory has always been 78m, why? I'm unsure to understand your question, doesn't seem correct english to me :) Will try to answer anyway. metadata are cached in ram. So, mfsmaster memory consumption varies with the number of files and directories, not on load. > <snip> > > 2. When I delete data, mfsmaster memory will be decrease or unchanged? It will decrease. don't know though if it will once data are in the trash or really deleted. See http://www.moosefs.org/reference-guide.html#requirements for some details. HTH, -- Laurent Wandrebeck HYGEOS, Earth Observation Department / Observation de la Terre Euratechnologies 165 Avenue de Bretagne 59000 Lille, France tel: +33 3 20 08 24 98 http://www.hygeos.com GPG fingerprint/Empreinte GPG: F5CA 37A4 6D03 A90C 7A1D 2A62 54E6 EF2C D17C F64C |
|
From: Anh K. H. <ky...@vi...> - 2010-10-20 09:38:26
|
On Wed, 20 Oct 2010 17:27:06 +0800 leon hong <cod...@gm...> wrote: > I have two questions about memory of mfsmaster. > 1. When I increase the write data, read data from mfsmaster, > mfsmaster memory has always been 78m, why? > > [..] > 2. When I delete data, mfsmaster memory will be decrease or > unchanged? The resource that mfsmaster consumes depends on the number of files on MFS system. If you delete some files, they are still in trash box. You can read more in FAQ section in http://moosefs.org/ Cheers, -- Anh Ky Huynh |
|
From: leon h. <cod...@gm...> - 2010-10-20 09:27:14
|
hi` all I have two questions about memory of mfsmaster. 1. When I increase the write data, read data from mfsmaster, mfsmaster memory has always been 78m, why? top - 17:24:53 up 12 days, 23:57, 13 users, load average: 5.97, 4.88, 2.63 Tasks: 1 total, 0 running, 1 sleeping, 0 stopped, 0 zombie Cpu(s): 0.0%us, 0.3%sy, 0.0%ni, 0.0%id, 96.8%wa, 1.0%hi, 1.8%si, 0.0%st Mem: 1033400k total, 1025976k used, 7424k free, 55752k buffers Swap: 2097144k total, 265344k used, 1831800k free, 444056k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 27909 mfs 0 -19 93760 78m 656 S 0.0 7.8 0:00.05 mfsmaster 2. When I delete data, mfsmaster memory will be decrease or unchanged? thanks! --leon hong |
|
From: Reinis R. <r...@ro...> - 2010-10-19 21:41:57
|
> Is there a way to measure how many metadata lookups are happening per > second? You can get stats from the 'mfscgiserv' ( as example http://control.seycob.es:9425/mfs.cgi?sections=MO ) rr |
|
From: Thomas S H. <tha...@gm...> - 2010-10-19 21:00:57
|
I might be missing something right in front of my face but here goes. Is there a way to measure how many metadata lookups are happening per second? -Tom Hatch |
|
From: leon h. <cod...@gm...> - 2010-10-19 09:13:29
|
We have resolved it, thanks again, 2010/10/19 Michał Borychowski <mic...@ge...> > Hi! > > > > We wonder if you still have the problem with dumping the metadata after > deleting the /var/lib/mfs directory? > > > > We recreated the problem and found the solution. > > > > 1. We delete the directory with metadata and create a new one: > > root@ubuntu10:~/mfs-1.6.18# rm -rf /usr/local/var/mfs/ > > root@ubuntu10:~# mkdir /usr/local/var/mfs > > root@ubuntu10:~# chown nobody:nogroup /usr/local/var/mfs > > root@ubuntu10:~# chmod 755 /usr/local/var/mfs > > > > 2. We check master’s CWD by lsof command: > > root@ubuntu10:~/mfs-1.6.18# lsof | grep ^mfsmaster > > mfsmaster 22351 nobody cwd DIR 251,0 0 > 2624067 /usr/local/var/mfs (deleted) > > (....) > > > > So now we have the same situation as you. And now we start recovering the > master server: > > root@ubuntu10:~/mfs-1.6.18# gdb > > GNU gdb (GDB) 7.2-ubuntu > > Copyright (C) 2010 Free Software Foundation, Inc. > > License GPLv3+: GNU GPL version 3 or later < > http://gnu.org/licenses/gpl.html> > > This is free software: you are free to change and redistribute it. > > There is NO WARRANTY, to the extent permitted by law. Type "show copying" > > and "show warranty" for details. > > This GDB was configured as "x86_64-linux-gnu". > > For bug reporting instructions, please see: > > <http://www.gnu.org/software/gdb/bugs/>. > > > > (gdb) attach 22351 > > Attaching to process 22351 > > Reading symbols from /usr/local/sbin/mfsmaster...done. > > Reading symbols from /lib/libz.so.1...(no debugging symbols found)...done. > > Loaded symbols for /lib/libz.so.1 > > Reading symbols from /lib/libc.so.6...Reading symbols from > /usr/lib/debug/lib/libc-2.12.1.so...done. > > done. > > Loaded symbols for /lib/libc.so.6 > > Reading symbols from /lib64/ld-linux-x86-64.so.2...Reading symbols from > /usr/lib/debug/lib/ld-2.12.1.so...done. > > done. > > Loaded symbols for /lib64/ld-linux-x86-64.so.2 > > Reading symbols from /lib/libnss_compat.so.2...Reading symbols from > /usr/lib/debug/lib/libnss_compat-2.12.1.so...done. > > done. > > Loaded symbols for /lib/libnss_compat.so.2 > > Reading symbols from /lib/libnsl.so.1...Reading symbols from > /usr/lib/debug/lib/libnsl-2.12.1.so...done. > > done. > > Loaded symbols for /lib/libnsl.so.1 > > Reading symbols from /lib/libnss_nis.so.2...Reading symbols from > /usr/lib/debug/lib/libnss_nis-2.12.1.so...done. > > done. > > Loaded symbols for /lib/libnss_nis.so.2 > > Reading symbols from /lib/libnss_files.so.2...Reading symbols from > /usr/lib/debug/lib/libnss_files-2.12.1.so...done. > > done. > > Loaded symbols for /lib/libnss_files.so.2 > > 0x00007f9dc92451a8 in __poll (fds=0x7fff2812d3b0, nfds=6, timeout=<value > optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:83 > > 83 ../sysdeps/unix/sysv/linux/poll.c: No such file or directory. > > in ../sysdeps/unix/sysv/linux/poll.c > > > > (gdb) call chdir("/usr/local/var/mfs") > > $1 = 0 > > (gdb) detach > > Detaching from program: /usr/local/sbin/mfsmaster, process 22351 > > > > (gdb) quit > > > > So that’s all: gdb, attach PID, call chdir(PATH), detach and quit > > > > root@ubuntu10:~/mfs-1.6.18# lsof | grep ^mfsmaster > > mfsmaster 22351 nobody cwd DIR 251,0 4096 > 2624071 /usr/local/var/mfs > > mfsmaster 22351 nobody rtd DIR 251,0 4096 > 2 / > > mfsmaster 22351 nobody txt REG 251,0 937984 > 2503085 /usr/local/sbin/mfsmaster > > mfsmaster 22351 nobody mem REG 251,0 51712 > 524325 /lib/libnss_files-2.12.1.so > > mfsmaster 22351 nobody mem REG 251,0 43552 > 524320 /lib/libnss_nis-2.12.1.so > > mfsmaster 22351 nobody mem REG 251,0 97256 > 524324 /lib/libnsl-2.12.1.so > > mfsmaster 22351 nobody mem REG 251,0 35712 > 524322 /lib/libnss_compat-2.12.1.so > > mfsmaster 22351 nobody mem REG 251,0 1572232 > 524311 /lib/libc-2.12.1.so > > mfsmaster 22351 nobody mem REG 251,0 96816 > 524531 /lib/libz.so.1.2.3.4 > > mfsmaster 22351 nobody mem REG 251,0 141072 > 524319 /lib/ld-2.12.1.so > > mfsmaster 22351 nobody 0u CHR 136,2 0t0 > 5 /dev/pts/2 > > mfsmaster 22351 nobody 1u CHR 136,2 0t0 > 5 /dev/pts/2 > > mfsmaster 22351 nobody 2u CHR 136,2 0t0 > 5 /dev/pts/2 > > mfsmaster 22351 nobody 3u unix 0xffff880030080000 0t0 > 44276 socket > > mfsmaster 22351 nobody 4wW REG 251,0 0 > 2624064 /usr/local/var/mfs/.mfsmaster.lock (deleted) > > mfsmaster 22351 nobody 5u IPv4 44281 0t0 > TCP *:9419 (LISTEN) > > mfsmaster 22351 nobody 6u IPv4 44283 0t0 > TCP *:9420 (LISTEN) > > mfsmaster 22351 nobody 7u IPv4 44285 0t0 > TCP *:9421 (LISTEN) > > mfsmaster 22351 nobody 9u IPv4 44583 0t0 > TCP 10.37.129.202:9419->10.37.129.202:59003 (ESTABLISHED) > > mfsmaster 22351 nobody 10u IPv4 44582 0t0 > TCP 10.37.129.202:9420->10.37.129.202:36911 (ESTABLISHED) > > mfsmaster 22351 nobody 11w REG 251,0 341 > 2624065 /usr/local/var/mfs/changelog.0.mfs (deleted) > > mfsmaster 22351 nobody 12u IPv4 45330 0t0 > TCP localhost:9421->localhost:50494 (ESTABLISHED) > > > > And now it is advisable to mount any client – after mounting the session > file will write to the new directory. So when there is “sessions.mfs” file > in the new directory it is safe to restart the master server. Or you can > wait till the hour on the hour (:00 minutes) and the metadata.mfs.back will > be dumped. > > > > Regarding the restart – there is still a “lockfile” in the old, deleted > folder so the standard “/usr/local/sbin/mfsmaster stop” won’t work, you’ll > need use “kill”: > > root@ubuntu10:~/mfs-1.6.18# kill 22351 > > > > You have to now wait till the metadata file gets dumped to the new > directory and later you start the master in a regular way: > > root@ubuntu10:~/mfs-1.6.18# /usr/local/sbin/mfsmaster start > > > > Of course your PID and your directory would defer from ours. We hope this > helps you recover the metadata file. > > > > > > Kind regards > > Michał > > > > > > *From:* leon hong [mailto:cod...@gm...] > *Sent:* Friday, October 15, 2010 6:05 PM > > *To:* Michał Borychowski > *Cc:* moo...@li... > *Subject:* Re: [Moosefs-users] help!!!!! I met a very serious problem > > > > I know " metadata gets dumped from memory each hour",But to deleted is the > directory "/var/mfs/lib", after mkdir "/var/lib/mfs" directory, the process > will not recognize "/mfs/var", mad brush log.How can I do? > > > > > > Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533404: > 1287153740|UNLOCK(33003916) > > Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533405: > 1287153740|LENGTH(36510654,1024) > > Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533406: > 1287153740|UNLOCK(33003913) > > ................................................................. > > ................................................................ > > > > > > 2010/10/15 Michał Borychowski <mic...@ge...> > > Exactly as I said – metadata gets dumped from memory each hour. Just make > sure /var/lib/mfs is writeable for the master process. > > > > > > Regards > > Michał > > > > *From:* leon hong [mailto:cod...@gm...] > *Sent:* Friday, October 15, 2010 5:35 PM > *To:* Michał Borychowski > *Cc:* moo...@li... > > > *Subject:* Re: [Moosefs-users] help!!!!! I met a very serious problem > > > > but I deleted "/var/lib/mfs/" and I create "/var/lib/mfs", mfsmaster can > not find this files(changelog.0.mfs metadata.mfs.back stats.mfs) > in "/var/lib/mfs". > > How can I do? ? This is the online service, how do I get the > "metadata.mfs.back" out from memory？ > > > > thanks again!!!!!thanks again!!!!! > > 2010/10/15 Michał Borychowski <mic...@ge...> > > The "metadata.mfs.back" gets saved each hour so it should be back there on > the hour with 00 minutes. You should also have a new "changelog.0.mfs” file > > > > > > Regards > > Michał > > > > *From:* leon hong [mailto:cod...@gm...] > *Sent:* Friday, October 15, 2010 4:46 PM > *To:* moo...@li... > *Subject:* Re: [Moosefs-users] help!!!!! I met a very serious problem > > > > As I removed the "/var/lib/mfs" directory, and later create > a "/var/lib/mfs",help!!!!!!!!~ > > > > > > the "/var/log/message": > > > ----------------------------------------------------------------------------------------------------------------------- > > Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533404: > 1287153740|UNLOCK(33003916) > > Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533405: > 1287153740|LENGTH(36510654,1024) > > Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533406: > 1287153740|UNLOCK(33003913) > > ............. > > > > thanks again! > > > > 2010/10/15 leon hong <cod...@gm...> > > hi~ > > > > I accidentally deleted the directory "/var/lib/mfs" > > How do I put the data in the lead out of memory?? > > > > help!!!!!!! > > > > > > thanks!!! > > > > > > > |
|
From: Michał B. <mic...@ge...> - 2010-10-19 07:37:42
|
Hi! We wonder if you still have the problem with dumping the metadata after deleting the /var/lib/mfs directory? We recreated the problem and found the solution. 1. We delete the directory with metadata and create a new one: root@ubuntu10:~/mfs-1.6.18# rm -rf /usr/local/var/mfs/ root@ubuntu10:~# mkdir /usr/local/var/mfs root@ubuntu10:~# chown nobody:nogroup /usr/local/var/mfs root@ubuntu10:~# chmod 755 /usr/local/var/mfs 2. We check master’s CWD by lsof command: root@ubuntu10:~/mfs-1.6.18# lsof | grep ^mfsmaster mfsmaster 22351 nobody cwd DIR 251,0 0 2624067 /usr/local/var/mfs (deleted) (....) So now we have the same situation as you. And now we start recovering the master server: root@ubuntu10:~/mfs-1.6.18# gdb GNU gdb (GDB) 7.2-ubuntu Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. (gdb) attach 22351 Attaching to process 22351 Reading symbols from /usr/local/sbin/mfsmaster...done. Reading symbols from /lib/libz.so.1...(no debugging symbols found)...done. Loaded symbols for /lib/libz.so.1 Reading symbols from /lib/libc.so.6...Reading symbols from /usr/lib/debug/lib/libc-2.12.1.so...done. done. Loaded symbols for /lib/libc.so.6 Reading symbols from /lib64/ld-linux-x86-64.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.12.1.so...done. done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /lib/libnss_compat.so.2...Reading symbols from /usr/lib/debug/lib/libnss_compat-2.12.1.so...done. done. Loaded symbols for /lib/libnss_compat.so.2 Reading symbols from /lib/libnsl.so.1...Reading symbols from /usr/lib/debug/lib/libnsl-2.12.1.so...done. done. Loaded symbols for /lib/libnsl.so.1 Reading symbols from /lib/libnss_nis.so.2...Reading symbols from /usr/lib/debug/lib/libnss_nis-2.12.1.so...done. done. Loaded symbols for /lib/libnss_nis.so.2 Reading symbols from /lib/libnss_files.so.2...Reading symbols from /usr/lib/debug/lib/libnss_files-2.12.1.so...done. done. Loaded symbols for /lib/libnss_files.so.2 0x00007f9dc92451a8 in __poll (fds=0x7fff2812d3b0, nfds=6, timeout=<value optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:83 83 ../sysdeps/unix/sysv/linux/poll.c: No such file or directory. in ../sysdeps/unix/sysv/linux/poll.c (gdb) call chdir("/usr/local/var/mfs") $1 = 0 (gdb) detach Detaching from program: /usr/local/sbin/mfsmaster, process 22351 (gdb) quit So that’s all: gdb, attach PID, call chdir(PATH), detach and quit root@ubuntu10:~/mfs-1.6.18# lsof | grep ^mfsmaster mfsmaster 22351 nobody cwd DIR 251,0 4096 2624071 /usr/local/var/mfs mfsmaster 22351 nobody rtd DIR 251,0 4096 2 / mfsmaster 22351 nobody txt REG 251,0 937984 2503085 /usr/local/sbin/mfsmaster mfsmaster 22351 nobody mem REG 251,0 51712 524325 /lib/libnss_files-2.12.1.so mfsmaster 22351 nobody mem REG 251,0 43552 524320 /lib/libnss_nis-2.12.1.so mfsmaster 22351 nobody mem REG 251,0 97256 524324 /lib/libnsl-2.12.1.so mfsmaster 22351 nobody mem REG 251,0 35712 524322 /lib/libnss_compat-2.12.1.so mfsmaster 22351 nobody mem REG 251,0 1572232 524311 /lib/libc-2.12.1.so mfsmaster 22351 nobody mem REG 251,0 96816 524531 /lib/libz.so.1.2.3.4 mfsmaster 22351 nobody mem REG 251,0 141072 524319 /lib/ld-2.12.1.so mfsmaster 22351 nobody 0u CHR 136,2 0t0 5 /dev/pts/2 mfsmaster 22351 nobody 1u CHR 136,2 0t0 5 /dev/pts/2 mfsmaster 22351 nobody 2u CHR 136,2 0t0 5 /dev/pts/2 mfsmaster 22351 nobody 3u unix 0xffff880030080000 0t0 44276 socket mfsmaster 22351 nobody 4wW REG 251,0 0 2624064 /usr/local/var/mfs/.mfsmaster.lock (deleted) mfsmaster 22351 nobody 5u IPv4 44281 0t0 TCP *:9419 (LISTEN) mfsmaster 22351 nobody 6u IPv4 44283 0t0 TCP *:9420 (LISTEN) mfsmaster 22351 nobody 7u IPv4 44285 0t0 TCP *:9421 (LISTEN) mfsmaster 22351 nobody 9u IPv4 44583 0t0 TCP 10.37.129.202:9419->10.37.129.202:59003 (ESTABLISHED) mfsmaster 22351 nobody 10u IPv4 44582 0t0 TCP 10.37.129.202:9420->10.37.129.202:36911 (ESTABLISHED) mfsmaster 22351 nobody 11w REG 251,0 341 2624065 /usr/local/var/mfs/changelog.0.mfs (deleted) mfsmaster 22351 nobody 12u IPv4 45330 0t0 TCP localhost:9421->localhost:50494 (ESTABLISHED) And now it is advisable to mount any client – after mounting the session file will write to the new directory. So when there is “sessions.mfs” file in the new directory it is safe to restart the master server. Or you can wait till the hour on the hour (:00 minutes) and the metadata.mfs.back will be dumped. Regarding the restart – there is still a “lockfile” in the old, deleted folder so the standard “/usr/local/sbin/mfsmaster stop” won’t work, you’ll need use “kill”: root@ubuntu10:~/mfs-1.6.18# kill 22351 You have to now wait till the metadata file gets dumped to the new directory and later you start the master in a regular way: root@ubuntu10:~/mfs-1.6.18# /usr/local/sbin/mfsmaster start Of course your PID and your directory would defer from ours. We hope this helps you recover the metadata file. Kind regards Michał From: leon hong [mailto:cod...@gm...] Sent: Friday, October 15, 2010 6:05 PM To: Michał Borychowski Cc: moo...@li... Subject: Re: [Moosefs-users] help!!!!! I met a very serious problem I know " metadata gets dumped from memory each hour",But to deleted is the directory "/var/mfs/lib", after mkdir "/var/lib/mfs" directory, the process will not recognize "/mfs/var", mad brush log.How can I do? Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533404: 1287153740|UNLOCK(33003916) Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533405: 1287153740|LENGTH(36510654,1024) Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533406: 1287153740|UNLOCK(33003913) ................................................................. ................................................................ 2010/10/15 Michał Borychowski <mic...@ge...> Exactly as I said – metadata gets dumped from memory each hour. Just make sure /var/lib/mfs is writeable for the master process. Regards Michał From: leon hong [mailto:cod...@gm...] Sent: Friday, October 15, 2010 5:35 PM To: Michał Borychowski Cc: moo...@li... Subject: Re: [Moosefs-users] help!!!!! I met a very serious problem but I deleted "/var/lib/mfs/" and I create "/var/lib/mfs", mfsmaster can not find this files(changelog.0.mfs metadata.mfs.back stats.mfs) in "/var/lib/mfs". How can I do? ? This is the online service, how do I get the "metadata.mfs.back" out from memory？ thanks again!!!!!thanks again!!!!! 2010/10/15 Michał Borychowski <mic...@ge...> The "metadata.mfs.back" gets saved each hour so it should be back there on the hour with 00 minutes. You should also have a new "changelog.0.mfs” file Regards Michał From: leon hong [mailto:cod...@gm...] Sent: Friday, October 15, 2010 4:46 PM To: moo...@li... Subject: Re: [Moosefs-users] help!!!!! I met a very serious problem As I removed the "/var/lib/mfs" directory, and later create a "/var/lib/mfs",help!!!!!!!!~ the "/var/log/message": ----------------------------------------------------------------------------------------------------------------------- Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533404: 1287153740|UNLOCK(33003916) Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533405: 1287153740|LENGTH(36510654,1024) Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533406: 1287153740|UNLOCK(33003913) ............. thanks again! 2010/10/15 leon hong <cod...@gm...> hi~ I accidentally deleted the directory "/var/lib/mfs" How do I put the data in the lead out of memory?? help!!!!!!! thanks!!! |
|
From: jose m. <let...@us...> - 2010-10-15 23:25:41
|
El jue, 14-10-2010 a las 20:57 -0600, Thomas S Hatch escribió: > boy is my face red, mount.fuse was not installed, Thanks Jose! > * On ubuntu * sudo apt-get update && sudo apt-cache search mount.fuse fuse-utils - Filesystem in USErspace (utilities) * sudo apt-get install fuse-utils |
|
From: leon h. <cod...@gm...> - 2010-10-15 16:04:42
|
I know " metadata gets dumped from memory each hour",But to deleted is the directory "/var/mfs/lib", after mkdir "/var/lib/mfs" directory, the process will not recognize "/mfs/var", mad brush log.How can I do? Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533404: 1287153740|UNLOCK(33003916) Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533405: 1287153740|LENGTH(36510654,1024) Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533406: 1287153740|UNLOCK(33003913) ................................................................. ................................................................ 2010/10/15 Michał Borychowski <mic...@ge...> > Exactly as I said – metadata gets dumped from memory each hour. Just make > sure /var/lib/mfs is writeable for the master process. > > > > > > Regards > > Michał > > > > *From:* leon hong [mailto:cod...@gm...] > *Sent:* Friday, October 15, 2010 5:35 PM > *To:* Michał Borychowski > *Cc:* moo...@li... > > *Subject:* Re: [Moosefs-users] help!!!!! I met a very serious problem > > > > but I deleted "/var/lib/mfs/" and I create "/var/lib/mfs", mfsmaster can > not find this files(changelog.0.mfs metadata.mfs.back stats.mfs) > in "/var/lib/mfs". > > How can I do? ? This is the online service, how do I get the > "metadata.mfs.back" out from memory？ > > > > thanks again!!!!!thanks again!!!!! > > 2010/10/15 Michał Borychowski <mic...@ge...> > > The "metadata.mfs.back" gets saved each hour so it should be back there on > the hour with 00 minutes. You should also have a new "changelog.0.mfs” file > > > > > > Regards > > Michał > > > > *From:* leon hong [mailto:cod...@gm...] > *Sent:* Friday, October 15, 2010 4:46 PM > *To:* moo...@li... > *Subject:* Re: [Moosefs-users] help!!!!! I met a very serious problem > > > > As I removed the "/var/lib/mfs" directory, and later create > a "/var/lib/mfs",help!!!!!!!!~ > > > > > > the "/var/log/message": > > > ----------------------------------------------------------------------------------------------------------------------- > > Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533404: > 1287153740|UNLOCK(33003916) > > Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533405: > 1287153740|LENGTH(36510654,1024) > > Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533406: > 1287153740|UNLOCK(33003913) > > ............. > > > > thanks again! > > > > 2010/10/15 leon hong <cod...@gm...> > > hi~ > > > > I accidentally deleted the directory "/var/lib/mfs" > > How do I put the data in the lead out of memory?? > > > > help!!!!!!! > > > > > > thanks!!! > > > > > |
|
From: Michał B. <mic...@ge...> - 2010-10-15 15:44:37
|
Exactly as I said – metadata gets dumped from memory each hour. Just make sure /var/lib/mfs is writeable for the master process. Regards Michał From: leon hong [mailto:cod...@gm...] Sent: Friday, October 15, 2010 5:35 PM To: Michał Borychowski Cc: moo...@li... Subject: Re: [Moosefs-users] help!!!!! I met a very serious problem but I deleted "/var/lib/mfs/" and I create "/var/lib/mfs", mfsmaster can not find this files(changelog.0.mfs metadata.mfs.back stats.mfs) in "/var/lib/mfs". How can I do? ? This is the online service, how do I get the "metadata.mfs.back" out from memory？ thanks again!!!!!thanks again!!!!! 2010/10/15 Michał Borychowski <mic...@ge...> The "metadata.mfs.back" gets saved each hour so it should be back there on the hour with 00 minutes. You should also have a new "changelog.0.mfs” file Regards Michał From: leon hong [mailto:cod...@gm...] Sent: Friday, October 15, 2010 4:46 PM To: moo...@li... Subject: Re: [Moosefs-users] help!!!!! I met a very serious problem As I removed the "/var/lib/mfs" directory, and later create a "/var/lib/mfs",help!!!!!!!!~ the "/var/log/message": ----------------------------------------------------------------------------------------------------------------------- Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533404: 1287153740|UNLOCK(33003916) Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533405: 1287153740|LENGTH(36510654,1024) Oct 15 22:42:20 master1 mfsmaster[3024]: lost MFS change 322533406: 1287153740|UNLOCK(33003913) ............. thanks again! 2010/10/15 leon hong <cod...@gm...> hi~ I accidentally deleted the directory "/var/lib/mfs" How do I put the data in the lead out of memory?? help!!!!!!! thanks!!! |
84 messages has been excluded from this view by a project administrator.
