On Wed, Jul 8, 2009 at 6:19 PM, Michal Ludvig <michal@logix.cz> wrote:
Hi Nigel,

> Perhaps it should be sleeping for .001 seconds upon first retry, instead
> of .01 seconds?  Even better might be to just retry once with no sleep
> and then sleep for .001 seconds per chunk on the second retry.

give the attached patch a try - it'll make the first re-try without
throttle and only subsequent ones would be throttled.
Ideally these times should be configurable in .s3cfg file, for instance
something like:
throttle_retries = [0, 0.001, 0.01, 0.05]
I may add such a config option in one of the upcoming versions.

It's working much better now, thank you!  In my use, the 0.001 throttle is always sufficient to make the transfer work, so I'd vote for either making the settings you mention above the default or configurable.