Re: [Moosefs-users] chunkserver crash/shutdown

[Michał B. <mic...@co...>]

Hi!

 

This behaviour was already talked about on our group:
http://sourceforge.net/mailarchive/forum.php?thread_name=AANLkTi%3DZOuMkbhhE
dN0F672Xev2gaJ0WPdZe-t%3DScSbX%40mail.gmail.com
<http://sourceforge.net/mailarchive/forum.php?thread_name=AANLkTi%3DZOuMkbhh
EdN0F672Xev2gaJ0WPdZe-t%3DScSbX%40mail.gmail.com&forum_name=moosefs-users>
&forum_name=moosefs-users

 

So these errors were caused by a "disconnected" hdd. If you looked in the
cgi monitor you would see a disk with "damaged" status (it happens when
MooseFS encounters 3 errors in one mintue; it doesn't mean that the hdd is
really broken, but for the sake of the whole system, such disk gets
disconnected by the system). 

 

On the other hand we strongly recommend upgrading MooseFS to the latest
version. There are lots of new things and bugfixes. You can wait for 1.6.25
which will be released next week.

 

Kind regards

Michał Borychowski 

MooseFS Support Manager

 

From: Hanser [mailto:se...@gm...] 
Sent: Friday, April 20, 2012 10:03 AM
To: 'moosefs-users'
Subject: [Moosefs-users] chunkserver crash/shutdown

 

Today, one of our chunkserver,  running 1.6.20-2 crashed giving out the
following errors. Going thru the docs and couldn't find anything relevant to
it.

I also noticed 3-errors-in-60 seconds ruleset, is there anyway to increase
the threshold in order to avoid further disruptions ? 

Thanks,

 

 

Apr 20 08:18:08 cluster-4 mfschunkserver[7892]: chunk_readcrc:
file:/mnt/mncloud/75/chunk_00000000005F0475_00000001.mfs - wrong id/version
in header (00000000005F0704_00000001)

Apr 20 08:18:08 cluster-4 mfschunkserver[7892]: hdd_io_begin:
file:/mnt/mncloud/75/chunk_00000000005F0475_00000001.mfs - read error:
Unknown error

Apr 20 08:18:10 cluster-4 mfschunkserver[7892]: testing chunk:
/mnt/mncloud/06/chunk_00000000005F0706_00000001.mfs

Apr 20 08:18:12 cluster-4 mfschunkserver[7892]: testing chunk:
/mnt/mncloud/77/chunk_00000000005F0477_00000001.mfs

Apr 20 08:18:12 cluster-4 mfschunkserver[7892]: chunk_readcrc:
file:/mnt/mncloud/77/chunk_00000000005F0477_00000001.mfs - wrong id/version
in header (00000000005F0706_00000001)

Apr 20 08:18:12 cluster-4 mfschunkserver[7892]: hdd_io_begin:
file:/mnt/mncloud/77/chunk_00000000005F0477_00000001.mfs - read error:
Unknown error

Apr 20 08:18:14 cluster-4 mfschunkserver[7892]: testing chunk:
/mnt/mncloud/08/chunk_00000000005F0708_00000001.mfs

Apr 20 08:18:16 cluster-4 mfschunkserver[7892]: testing chunk:
/mnt/mncloud/79/chunk_00000000005F0479_00000001.mfs

Apr 20 08:18:16 cluster-4 mfschunkserver[7892]: chunk_readcrc:
file:/mnt/mncloud/79/chunk_00000000005F0479_00000001.mfs - wrong id/version
in header (00000000005F0708_00000001)

Apr 20 08:18:16 cluster-4 mfschunkserver[7892]: hdd_io_begin:
file:/mnt/mncloud/79/chunk_00000000005F0479_00000001.mfs - read error:
Unknown error

Apr 20 08:18:17 cluster-4 mfschunkserver[7892]: 3 errors occurred in 60
seconds on folder: /mnt/mncloud/