Re: [Moosefs-users] chunkserver can't connect to masterserver

[l. <lwx...@16...>]

with you suggestions, I have fixes the problem.thanks!!!

 


On my product system ,there is a lots of small files (less then 10K), so there are about 5,000,000 chunks with only 1.4T DATA;
I make suggestions :
1, the first way   :you can separate the "registration packet " for serveral times ,every time limit to 500,000; so we will have no limit with the amount of chunks every chunkserver;

2, the second way :  maybe you can store several files in one chunks(every chunk limits to 64M)? so you can reduce the amount of chunks?


Here ,I have another question:
on my chunkserver disk,I have see the smallest file of chunks is 70656, and my smallest source file is only about 4K; why the chunk file size is substantially exceeds the soursefile;


thanks !!

2010-05-13 



lwxian_aha 



发件人： Michał_Borychowski 
发送时间： 2010-05-13  01:41:50 
收件人： 'lwxian_aha'; 'moosefs-users' 
抄送： 
主题： RE: [Moosefs-users] chunkserver can't connect to masterserver 
You have lots of chunks on your chunkservers. Probably the registration packet for the master is too big and the master server rejects it.
 
You need to change in the "matocsserv.c" file in "mfsmaster" folder this line:
#define MaxPacketSize 50000000
 
into this:
#define MaxPacketSize 200000000
 
After changing source you need to recompile the master server and restart it.
 
Generally on one chunkserver there are about 500,000 chunks. For this amount it is necessary to allocate 6 million bytes. Limit of 50 million seemed quite reasonable. But you have about 5,000,000 chunks on one chunkserver which demands about 60 million bytes for sending information about these chunks. And you exceed this limit. That's why we suggest to increase it to 200 million bytes. 
 
Let us know if it fixes your problem.
 
 
Kind regards
Micha?Borychowski 
 
 
 
 
From: lwxian_aha [mailto:lwx...@16...] 
Sent: Tuesday, May 11, 2010 5:34 AM
To: moosefs-users
Subject: [Moosefs-users] chunkserver can't connect to masterserver
 
today I have new trouble with my new MFS system,chunkserver can't connect to masterserver;
 
my MFS system  consist of one masterserver,three chunkserver,every chunkserver with 7.2T diskspace; about 1.4T 
data and about 7 million files ,every file with 2 copies;
MFS version is 1.6.11
OS version CENTOS 5.0
FS is ext3;
 
Following is the error message:
 
[root@localhost mfs]# tail /var/log/messages 
May 11 10:57:00 localhost mfsmaster[25802]: server 1 (ip: 192.168.10.23, port: 9422): usedspace: 33326616576 
(31.04 GiB), totalspace: 140025790464 (130.41 GiB), usage: 23.80%
May 11 10:57:00 localhost mfsmaster[25802]: total: usedspace: 33326616576 (31.04 GiB), totalspace: 140025790464 
(130.41 GiB), usage: 23.80%
May 11 10:57:03 localhost mfsmaster[25802]: CS(192.168.10.21) packet too long (56130653/50000000)
May 11 10:57:03 localhost mfsmaster[25802]: chunkserver disconnected - ip: 192.168.10.21, port: 0, usedspace: 0 
(0.00 GiB), totalspace: 0 (0.00 GiB)
May 11 10:57:08 localhost mfsmaster[25802]: CS(192.168.10.21) packet too long (56130653/50000000)
May 11 10:57:08 localhost mfsmaster[25802]: chunkserver disconnected - ip: 192.168.10.21, port: 0, usedspace: 0 
(0.00 GiB), totalspace: 0 (0.00 GiB)
May 11 10:57:13 localhost mfsmaster[25802]: CS(192.168.10.21) packet too long (56130653/50000000)
May 11 10:57:13 localhost mfsmaster[25802]: chunkserver disconnected - ip: 192.168.10.21, port: 0, usedspace: 0 
(0.00 GiB), totalspace: 0 (0.00 GiB)
May 11 10:57:18 localhost mfsmaster[25802]: CS(192.168.10.21) packet too long (56130653/50000000)
May 11 10:57:18 localhost mfsmaster[25802]: chunkserver disconnected - ip: 192.168.10.21, port: 0, usedspace: 0 
(0.00 GiB), totalspace: 0 (0.00 GiB)
 
 
 
what's happen ?need you help!
thanks a lot's
 
2010-05-05 
________________________________________
lwxian_aha