Re: [MooseFS-Users] Optimized copy

[Elliot F. <efi...@gm...>]

mfsmakesnapshot makes a ”real” snapshot (lazy copy, like in case of
mfsappendchunks) of some object(s) or subtree (similarly to cp -r command).
It’s atomic with respect to each SOURCE argument separately. If DESTINATION
points to already existing file, error will be reported unless -o
(overwrite) option is given. Note: if SOURCE is a directory, it’s copied as
a whole; but if it’s followed by trailing slash, only directory content is
copied.

mfsmakesnapshot does a copy-on-write copy... i.e. only the metadata is
copied.  it happens very quickly.  if your tens of thousands of files are
all in a single directory tree, just copy the head directory.


On Wed, Jun 8, 2016 at 7:18 PM, Ben Timby <bt...@gm...> wrote:

> Hi all, I am looking for a way to do a fast file copy with MooseFS. Today
> with fuse mount MFS does copies the usual way. Open source for reading,
> open destination for writing and then loop, reading and writing data
> between the files.
>
> It seems to me that MFS could do a much faster copy operation by not
> involving the client at all and simply asking the mfsmaster for a new
> metadata entry and then cloning chunks.
>
> Am I wrong? Is there a way to do this? I ask because we are copying tens
> of thousands of files and need it to happen very quickly.
>
> Thanks.
>
>
> ------------------------------------------------------------------------------
> What NetFlow Analyzer can do for you? Monitors network bandwidth and
> traffic
> patterns at an interface-level. Reveals which users, apps, and protocols
> are
> consuming the most bandwidth. Provides multi-vendor support for NetFlow,
> J-Flow, sFlow and other flows. Make informed decisions using capacity
> planning reports. https://ad.doubleclick.net/ddm/clk/305295220;132659582;e
> _________________________________________
> moosefs-users mailing list
> moo...@li...
> https://lists.sourceforge.net/lists/listinfo/moosefs-users
>
>