Re: [Moosefs-users] How to speedup replication from disk marked for removal

[Boris E. <bor...@gm...>]

Davies,

How would you do that? Do you just copy the whole chunk storage directory?

Boris.

On Fri, May 18, 2012 at 9:04 AM, Davies Liu <dav...@gm...> wrote:

> You can use rsync to copy chunk files from old one to new one, then stop
> the
> chunk server, rsync again, add new disc in mfshdd.cfg, remove old one,
> then start chunk server.
>
> On Thu, May 17, 2012 at 11:18 PM, Karol Pasternak
> <kar...@ar...> wrote:
> > Weird, in first order it tries to replicate undergoal files to new disk
> > instead of moving chunks from one disk to another.
> >
> > Any ideas? Is it possible to give higher priority to move chunks from
> disk
> > marked for removal to new one in the same chunkserver?
> >
> > Of course I know that I can change goal to lower but maybe it's other
> > possibility.. .
> >
> >
> > On 05/17/2012 03:44 PM, Karol Pasternak wrote:
> >
> > Hi Steve,
> >
> > thanks for replay. You're right, all disk on this machines was full.
> > I thought, that when I remove this disk, this will replicate to others
> > chunkservers.
> > I added one more disk and it seems that it replicates correctly.
> >
> > Thanks for hint!
> >
> > On 05/17/2012 03:10 PM, Steve Wilson wrote:
> >
> > Hi Karol,
> >
> > I just replaced a 3TB disk that was about 85% full and it took about two
> > days for the chunks to be moved off it.  How full are the other disks in
> > your chunk server?  I assume there's enough space on them to accept the
> > chunks from the disk marked for removal.  Did you restart the mfs-master
> > daemon after changing the mfsmaster.cfg variables?  And did you restart
> the
> > mfs-chunkserver daemon after marking the disk for removal?  I'm sorry to
> be
> > asking such obvious questions but sometimes it's easy to overlook the
> > obvious!
> >
> > Steve
> >
> > On 05/17/2012 08:20 AM, Karol Pasternak wrote:
> >
> > Hi,
> >
> > I've set one 500GB disk for removal 2 weeks ago.
> > After this time, it's still used 74% of it.
> >
> > Week ago I set:
> > CHUNKS_WRITE_REP_LIMIT = 15
> > CHUNKS_READ_REP_LIMIT = 25
> >
> > Why it takes so much long time?
> >
> >
> > br.
> > Karol
> >
> >
> >
> >
> >
> >
> ------------------------------------------------------------------------------
> > Live Security Virtual Conference
> > Exclusive live event will cover all the ways today's security and
> > threat landscape has changed and how IT managers can respond. Discussions
> > will include endpoint security, mobile security and the latest in malware
> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> >
> >
> >
> > _______________________________________________
> > moosefs-users mailing list
> > moo...@li...
> > https://lists.sourceforge.net/lists/listinfo/moosefs-users
> >
> >
> >
> >
> >
> ------------------------------------------------------------------------------
> > Live Security Virtual Conference
> > Exclusive live event will cover all the ways today's security and
> > threat landscape has changed and how IT managers can respond. Discussions
> > will include endpoint security, mobile security and the latest in malware
> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> >
> >
> >
> > _______________________________________________
> > moosefs-users mailing list
> > moo...@li...
> > https://lists.sourceforge.net/lists/listinfo/moosefs-users
> >
> >
> >
> >
> >
> >
> >
> >
> ------------------------------------------------------------------------------
> > Live Security Virtual Conference
> > Exclusive live event will cover all the ways today's security and
> > threat landscape has changed and how IT managers can respond. Discussions
> > will include endpoint security, mobile security and the latest in malware
> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> >
> >
> >
> > _______________________________________________
> > moosefs-users mailing list
> > moo...@li...
> > https://lists.sourceforge.net/lists/listinfo/moosefs-users
> >
> >
> >
> >
> >
> ------------------------------------------------------------------------------
> > Live Security Virtual Conference
> > Exclusive live event will cover all the ways today's security and
> > threat landscape has changed and how IT managers can respond. Discussions
> > will include endpoint security, mobile security and the latest in malware
> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> > _______________________________________________
> > moosefs-users mailing list
> > moo...@li...
> > https://lists.sourceforge.net/lists/listinfo/moosefs-users
> >
>
>
>
> --
>  - Davies
>
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> _______________________________________________
> moosefs-users mailing list
> moo...@li...
> https://lists.sourceforge.net/lists/listinfo/moosefs-users
>