Please try with newer github.com/s3tools/s3cmd master branch.  The socket timeout (which is what appears to be triggering here) was increased from 10 second in v1.0.0 to 5 minutes now.  It's taking S3 longer than 10 seconds to respond to your copy request.

I'm sending this to the general list for two reasons:

1) are all the timeout errors we are seeing recently primarily coming from short socket timeouts, maybe from a legacy .s3cfg file where the socket_timeout value was 10?

2) remote copies are broken for files >5GB.  s3cmd will fail to do a remote copy (from one bucket to another) if the object is >5GB.  To do so, we must use the multipart API, which is not being invoked or remote copy operations at all right now.

Thanks,
Matt




On Thu, Apr 24, 2014 at 5:14 AM, Tal Ben Ami <tal.benami@ravellosystems.com> wrote:

Hi ,

 

I encountered this issue (after new installation from Ubuntu 12.04.4 LTS).

Please advise.

 

s3cmd cp s3://Production_Backups/zabbix_on_cloud_backup/zabbix_DB_backup.sql s3://Production_Backups/zabbix_on_cloud_backup/zabbix_DB_backup_$cmd.sql

WARNING: Retrying failed request: /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read operation timed out)

WARNING: Waiting 3 sec...

WARNING: Retrying failed request: /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read operation timed out)

WARNING: Waiting 6 sec...

WARNING: Retrying failed request: /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read operation timed out)

WARNING: Waiting 9 sec...

WARNING: Retrying failed request: /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read operation timed out)

WARNING: Waiting 12 sec...

WARNING: Retrying failed request: /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read operation timed out)

WARNING: Waiting 15 sec...

 

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

    An unexpected error has occurred.

  Please report the following lines to:

   s3tools-bugs@lists.sourceforge.net

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

 

Problem: S3RequestError: Request failed for: /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql

S3cmd:   1.0.0

 

Traceback (most recent call last):

  File "/usr/bin/s3cmd", line 2006, in <module>

    main()

  File "/usr/bin/s3cmd", line 1950, in main

    cmd_func(args)

  File "/usr/bin/s3cmd", line 614, in cmd_cp

    subcmd_cp_mv(args, s3.object_copy, "copy", "File %(src)s copied to %(dst)s")

  File "/usr/bin/s3cmd", line 607, in subcmd_cp_mv

    response = process_fce(src_uri, dst_uri, extra_headers)

  File "/usr/share/s3cmd/S3/S3.py", line 311, in object_copy

    response = self.send_request(request)

  File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request

    return self.send_request(request, body, retries - 1)

  File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request

    return self.send_request(request, body, retries - 1)

  File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request

    return self.send_request(request, body, retries - 1)

  File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request

    return self.send_request(request, body, retries - 1)

  File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request

    return self.send_request(request, body, retries - 1)

  File "/usr/share/s3cmd/S3/S3.py", line 489, in send_request

    raise S3RequestError("Request failed for: %s" % resource['uri'])

S3RequestError: Request failed for: /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql

 

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

    An unexpected error has occurred.

    Please report the above lines to:

   s3tools-bugs@lists.sourceforge.net

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

 

 

Thanks,

Tal


------------------------------------------------------------------------------
Start Your Social Network Today - Download eXo Platform
Build your Enterprise Intranet with eXo Platform Software
Java Based Open Source Intranet - Social, Extensible, Cloud Ready
Get Started Now And Turn Your Intranet Into A Collaboration Platform
http://p.sf.net/sfu/ExoPlatform