Re: [S3tools-general] s3cmd sync memory consumption

[Jason Q. <ja...@tc...>]

Diito. I've brought up the issue in a previous posting some time ago, and
I know that memory management is in the works. But do you have a timeline
at all? It's not my intention to rush things, but the memory usage issue is
preventing our application of S3 from working and I've got to either know
that s3cmd will be fixed soon or roll my own solution.

Thanks for all you do by the way..I don't want to sound unappreciative. 

--Jason


On Fri, 29 Apr 2011 05:53:05 -0400, Joe Auty <jo...@ne...> wrote:
> Hello,
> 
> I'm wondering if there are any effective tactics for reducing the memory
> consumption of s3cmd sync jobs of directories with large amounts of
> files? I find that these jobs use an order of magnitude more memory than
> rsync, for instance. I realize that a different set of parameters are
> involved in syncing to an S3 volume as opposed to a more traditional
> file system, but if you have any suggestions I'd like to hear them :)