[Moosefs-users] [MooseFS-user] Master server is overloaded for storing metadate periodically

[Shen G. <sh...@ui...>]

Hi moosefs developer,

 

The master server is storing metadata periodically. However, after testing
files increases up to 10+ million, this process is becoming so
time-consuming, that the master cannot provides services normally. it is
overloaded by metadate storing. And from the mfscgiserv, as the increasing
files writes into, the spent time of metadata storing is becoming longer. 

 

Besides, during each fs_storeall(), much percentage of fsnodes and chunks
are unchanged, for that most operations are read. Maybe lots of repeated
saving items are not necessary, but I do not know how to reduce them. 

 

I think it may will be better to refresh the metadata in another sub-master
server by combining the original metadata and changlogs, and remove the
periodical storing from the master.

 

Do you have any solutions or opinions about this issue? Thanks!

 

OS: CentOS 5.3

Hardware: CPU xeon 5410 RAM: 6GB

Version: mfs-1.6.15

 

-- 

 

Yours sincerely, Guowen Shen