Help save net neutrality! Learn more.
Close

#114 s3cmd sync fails to upload big files

Malfunction
closed-fixed
nobody
s3cmd (119)
5
2015-02-09
2012-03-11
Anonymous
No

hello.

I am getting errors like this

32370688 of 134217728 24% in 494s 63.92 kB/s failed
WARNING: Upload failed: /svndump3377/git-01/old-data_0001.bundle.part005.rar (The write operation timed out)
WARNING: Retrying on lower speed (throttle=0.00)
WARNING: Waiting 3 sec...

when uploading files (100 MB or more) using s3cmd sync
in a > 50% of cases.

i tried to set socket_timeout to 300. does not help. my system clock is accurate.

I googled for such errors, seems some other users experience same problems.

and yes, other tools like aws always works fine, my internet connection is very stable.

my s3cmd version 1.0.0 from debian repo.
I did try only s3cmd sync.
my upstream is ADSL.

Discussion

  • Matt Domsch

    Matt Domsch - 2015-02-09

    Please try with 1.5.2, which includes multipart upload capability for large files.

     
  • Matt Domsch

    Matt Domsch - 2015-02-09
    • status: open --> closed-fixed
     

Log in to post a comment.