Doesn't rsync calculate checksums even if you set --whole-file? It doesn't calculate block checksums but it still calculates file checksums - and if they match it skips the file (which only happens if you set --checksum-seed because otherwise it uses the current time as checksum-seed)


On Sat, Sep 28, 2013 at 1:56 PM, Chris Adamson <chris.adamson@mcri.edu.au> wrote:
Les,

The only difference I can see is that, as you point out, --one-file-system is purely handled by the sender and doesn't need to be "supported" as such by the receiver. I haven't as yet figured out how to get rsyncd to print out the final set of options it is using when backuppc establishes a connection to it so I don't know whether whole-file is being used directly. However, the full backups are CPU bound for both the rsync and BackupPC_dump processes and if I do a iftop to look at the traffic on the loopback network connection there is hardly anything being transferred over it. This suggests that only checksums are being transferred over the connection rather than the data itself. I will look into getting rsyncd to print out more verbose log files so that I can see if it is indeed using the delta xfer algorithm even though I specify --whole-file.

-----Original Message-----
From: Les Mikesell [mailto:lesmikesell@gmail.com]
Sent: Thursday, 26 September 2013 2:01 PM
To: General list for user discussion, questions and support
Subject: Re: [BackupPC-users] RsyncP and --whole-file

On Tue, Sep 24, 2013 at 6:58 PM, Chris Adamson <chris.adamson@mcri.edu.au> wrote:
> This is /usr/lib/perl5/File/RsyncP.pm
>
> 115     #
>  116     # Since the exclude arguments are no longer needed (they are
>  117     # passed via the socket, not the command-line args), update
>  118     # $rs->{rsyncOpts}
>  119     #
>  120     @{$rs->{rsyncArgs}} = @ARGV;
>  121
>  122     #
>  123     # Now process the rest of the arguments we care about
>  124     #
>  125     return if ( !$p->getoptions($rs->{rsyncOpts},
>  126             "block-size=i",
>  127             "devices|D",
>  128                     "from0|0",
>  129             "group|g",
>  130             "hard-links|H",
>  131             "ignore-times|I",
>  132             "links|l",
>  133             "numeric-ids",
>  134             "owner|o",
>  135             "perms|p",
>  136             "protocol=i",
>  137             "recursive|r",
>  138             "relative|R",
>  139             "timeout",
>  140             "verbose|v+",
>  141         ) );
>
> Note that whole-file is not included in the list of options that it looks for, so it is ignored by RsyncP. This is 0.68 but it is the same deal in 0.70.
>

I don't see --one-file-system in that list either, but I know it is honored because I use it everywhere.  This must be the list that is processed on the receiving side.  Wouldn't whole-file be passed to the sender and handled there?

--
   Les Mikesell
     lesmikesell@gmail.com

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from the latest Intel processors and coprocessors. See abstracts and register > http://pubads.g.doubleclick.net/gampad/clk?id=60133471&iu=/4140/ostg.clktrk
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com

If you have any question, please contact MCRI IT Helpdesk for further assistance.
______________________________________________________________________

______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com
______________________________________________________________________

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60133471&iu=/4140/ostg.clktrk
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/