[MooseFS-Users] Multiple CRC failures

[Gandalf C. <gan...@gm...>]

 I'm getting this:

Jun  8 12:41:16 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 12:41:16 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 12:51:02 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 12:51:02 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 13:00:00 cs02 mfsmaster[21945]: child finished
Jun  8 13:00:00 cs02 mfsmaster[21945]: store process has finished -
store time: 0.213
Jun  8 13:00:36 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 13:00:36 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 13:10:01 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 13:10:01 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 13:17:01 cs02 CRON[12342]: (root) CMD (   cd / && run-parts
--report /etc/cron.hourly)
Jun  8 13:19:31 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 13:19:31 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 13:23:01 cs02 systemd[1]: Starting Daily apt download activities...
Jun  8 13:23:01 cs02 systemd[1]: Started Daily apt download activities.
Jun  8 13:23:01 cs02 systemd[1]: apt-daily.timer: Adding 9h 54min
51.316685s random time.
Jun  8 13:23:01 cs02 systemd[1]: apt-daily.timer: Adding 5h 38min
50.643138s random time.
Jun  8 13:29:06 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 13:29:06 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 13:38:39 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 13:38:39 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 13:48:10 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 13:48:10 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 13:58:16 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 13:58:16 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 14:00:00 cs02 mfsmaster[21945]: child finished
Jun  8 14:00:00 cs02 mfsmaster[21945]: store process has finished -
store time: 0.208
Jun  8 14:08:02 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 14:08:02 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 14:17:01 cs02 CRON[12423]: (root) CMD (   cd / && run-parts
--report /etc/cron.hourly)
Jun  8 14:17:23 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 14:17:23 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 14:26:41 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 14:26:41 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 14:36:15 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 14:36:15 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 14:46:01 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 14:46:01 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 14:55:32 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 14:55:32 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 15:00:00 cs02 mfsmaster[21945]: child finished
Jun  8 15:00:00 cs02 mfsmaster[21945]: store process has finished -
store time: 0.210
Jun  8 15:05:45 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 15:05:45 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 15:15:20 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 15:15:20 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 15:17:01 cs02 CRON[12539]: (root) CMD (   cd / && run-parts
--report /etc/cron.hourly)
Jun  8 15:24:41 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 15:24:41 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 15:34:25 cs02 mfschunkserver[22075]: chunk_readcrc:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)
Jun  8 15:34:25 cs02 mfschunkserver[22075]: hdd_io_begin:
file:/mnt/chunks/chunk0/chunk//01/chunk_00000000006639E9_00000001.mfs
- read error: Success (errno=0)


is this OK ? The file was manually "rotted" by me, is normal that
MooseFS detect corruption at 12:41:16 and did nothing until 15:34:25 ?
 15:34 is also the same time I see in CGI, in last error field