From: Joe A. <jo...@ne...> - 2010-11-15 08:17:41
|
Joe Auty wrote: > Thanks for this! > > Another problem I'm running into is that if a file is deleted on the > source before it is sent, the sync fails and spews out an error > message. This is a problem with data such as email where an email > message might be deleted in real time, or perhaps a log file turned > over or something. I don't see a way to force the sync job to continue > on these sorts of errors, but I thought I would double check first? > Sorry, this may not have been clear... What I meant here is if the file is deleted on the source *during the sync* process, i.e. prior to actually sending the file from the source to destination, a fatal error is generated. > > > > Michal Ludvig wrote: >> Hi Joe, >> >> currently it isn't possible to skip checksums comparison. >> >> If all your log files are in the same directory or have some common >> name pattern, e.g. *.log, you can exclude them with --exclude \*.log >> or some other variant of --exclude-from/--rexclude/--rexclude-from. >> >> In the future there will be an option to not compare the checksums on >> sync, but I'm not sure if it's a good idea to skip comparing them on >> upload... >> >> Michal >> >> On 11/13/2010 11:26 AM, Joe Auty wrote: >>> Hello, >>> >>> Is there a way to get s3cmd to not fuss over matching checksums on >>> live log files and files that are constantly being written to? I >>> realize that I can exclude them, but there are many of them that are >>> dynamically created, I'd rather not list them individually. >>> >>> What I'm finding is that because more information is being written >>> to the source file by the time the upload is complete, I get stuck >>> in an endless loop of uploading the file over and over again until >>> checksums match. If giving up after x number of failures is a >>> possibility and just accepting what has been uploaded that is cool >>> too, but what would be awesome is to perhaps skip the comparison of >>> final checksums for certain directories. >>> >>> Has anybody else run into this problem? Any suggestions for >>> techniques for working around this sort of problem? >>> >>> >>> -- >>> Joe Auty, NetMusician >>> NetMusician helps musicians, bands and artists create beautiful, >>> professional, custom designed, career-essential websites that are >>> easy to maintain and to integrate with popular social networks. >>> www.netmusician.org <http://www.netmusician.org> >>> jo...@ne... <mailto:jo...@ne...> >>> >>> >>> ------------------------------------------------------------------------------ >>> Centralized Desktop Delivery: Dell and VMware Reference Architecture >>> Simplifying enterprise desktop deployment and management using >>> Dell EqualLogic storage and VMware View: A highly scalable, end-to-end >>> client virtualization framework. Read more! >>> http://p.sf.net/sfu/dell-eql-dev2dev >>> >>> >>> _______________________________________________ >>> S3tools-general mailing list >>> S3t...@li... >>> https://lists.sourceforge.net/lists/listinfo/s3tools-general >> >> >> ------------------------------------------------------------------------------ >> Centralized Desktop Delivery: Dell and VMware Reference Architecture >> Simplifying enterprise desktop deployment and management using >> Dell EqualLogic storage and VMware View: A highly scalable, end-to-end >> client virtualization framework. Read more! >> http://p.sf.net/sfu/dell-eql-dev2dev >> >> >> _______________________________________________ >> S3tools-general mailing list >> S3t...@li... >> https://lists.sourceforge.net/lists/listinfo/s3tools-general > > > -- > Joe Auty, NetMusician > NetMusician helps musicians, bands and artists create beautiful, > professional, custom designed, career-essential websites that are easy > to maintain and to integrate with popular social networks. > www.netmusician.org <http://www.netmusician.org> > jo...@ne... <mailto:jo...@ne...> > > > ------------------------------------------------------------------------------ > Centralized Desktop Delivery: Dell and VMware Reference Architecture > Simplifying enterprise desktop deployment and management using > Dell EqualLogic storage and VMware View: A highly scalable, end-to-end > client virtualization framework. Read more! > http://p.sf.net/sfu/dell-eql-dev2dev > > > _______________________________________________ > S3tools-general mailing list > S3t...@li... > https://lists.sourceforge.net/lists/listinfo/s3tools-general -- Joe Auty, NetMusician NetMusician helps musicians, bands and artists create beautiful, professional, custom designed, career-essential websites that are easy to maintain and to integrate with popular social networks. www.netmusician.org <http://www.netmusician.org> jo...@ne... <mailto:jo...@ne...> |