Re: [Moosefs-users] mfs-master[4166]: CS(10.10.10.10) packet too long (226064141/50000000)

[Michał B. <mic...@ge...>]

Yes, probably these patches would be applied to the new version or we would implement a still better solution for registering large amounts of files.

 

 

Regards

Michal 

 

From: Stas Oskin [mailto:sta...@gm...] 
Sent: Friday, July 09, 2010 2:47 PM
To: Michał Borychowski
Cc: moo...@li...; marco lu
Subject: Re: [Moosefs-users] mfs-master[4166]: CS(10.10.10.10) packet too long (226064141/50000000)

 

Hi.

2010/6/21 Micha Borychowski <mic...@ge...>

We give you here some quick patches you can implement to the master server to improve its performance for that amount of files:

In matocsserv.c in mfsmaster you need to change this line:

#define MaxPacketSize 50000000

into this:

#define MaxPacketSize 500000000

Also we suggest a change in filesystem.c in mfsmaster in "fs_test_files" function. Change this line:

if ((uint32_t)(main_time())<=starttime+150) {

into:

if ((uint32_t)(main_time())<=starttime+900) {

And also changing this line:

for (k=0 ; k<(NODEHASHSIZE/3600) && i<NODEHASHSIZE ; k++,i++) {

into this:

for (k=0 ; k<(NODEHASHSIZE/14400) && i<NODEHASHSIZE ; k++,i++) {

You need to recompile the master server and start it again. The above changes should make the master server work more stable with large amount of files.

 


Can these changes be added to next MFS release?
Or they impact the performance in any way for smaller amounts?

Regards.