From: Matt D. <ma...@do...> - 2014-04-24 11:34:53
|
Please try with newer github.com/s3tools/s3cmd master branch. The socket timeout (which is what appears to be triggering here) was increased from 10 second in v1.0.0 to 5 minutes now. It's taking S3 longer than 10 seconds to respond to your copy request. I'm sending this to the general list for two reasons: 1) are all the timeout errors we are seeing recently primarily coming from short socket timeouts, maybe from a legacy .s3cfg file where the socket_timeout value was 10? 2) remote copies are broken for files >5GB. s3cmd will fail to do a remote copy (from one bucket to another) if the object is >5GB. To do so, we must use the multipart API, which is not being invoked or remote copy operations at all right now. Thanks, Matt On Thu, Apr 24, 2014 at 5:14 AM, Tal Ben Ami <tal...@ra...>wrote: > Hi , > > > > I encountered this issue (after new installation from Ubuntu 12.04.4 LTS). > > Please advise. > > > > *s3cmd cp > s3://Production_Backups/zabbix_on_cloud_backup/zabbix_DB_backup.sql > s3://Production_Backups/zabbix_on_cloud_backup/zabbix_DB_backup_$cmd.sql* > > *WARNING: Retrying failed request: > /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read > operation timed out)* > > *WARNING: Waiting 3 sec...* > > *WARNING: Retrying failed request: > /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read > operation timed out)* > > *WARNING: Waiting 6 sec...* > > *WARNING: Retrying failed request: > /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read > operation timed out)* > > *WARNING: Waiting 9 sec...* > > *WARNING: Retrying failed request: > /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read > operation timed out)* > > *WARNING: Waiting 12 sec...* > > *WARNING: Retrying failed request: > /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read > operation timed out)* > > *WARNING: Waiting 15 sec...* > > > > *!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!* > > * An unexpected error has occurred.* > > * Please report the following lines to:* > > * s3t...@li... > <s3t...@li...>* > > *!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!* > > > > *Problem: S3RequestError: Request failed for: > /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql* > > *S3cmd: 1.0.0* > > > > *Traceback (most recent call last):* > > * File "/usr/bin/s3cmd", line 2006, in <module>* > > * main()* > > * File "/usr/bin/s3cmd", line 1950, in main* > > * cmd_func(args)* > > * File "/usr/bin/s3cmd", line 614, in cmd_cp* > > * subcmd_cp_mv(args, s3.object_copy, "copy", "File %(src)s copied to > %(dst)s")* > > * File "/usr/bin/s3cmd", line 607, in subcmd_cp_mv* > > * response = process_fce(src_uri, dst_uri, extra_headers)* > > * File "/usr/share/s3cmd/S3/S3.py", line 311, in object_copy* > > * response = self.send_request(request)* > > * File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request* > > * return self.send_request(request, body, retries - 1)* > > * File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request* > > * return self.send_request(request, body, retries - 1)* > > * File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request* > > * return self.send_request(request, body, retries - 1)* > > * File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request* > > * return self.send_request(request, body, retries - 1)* > > * File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request* > > * return self.send_request(request, body, retries - 1)* > > * File "/usr/share/s3cmd/S3/S3.py", line 489, in send_request* > > * raise S3RequestError("Request failed for: %s" % resource['uri'])* > > *S3RequestError: Request failed for: > /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql* > > > > *!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!* > > * An unexpected error has occurred.* > > * Please report the above lines to:* > > * s3t...@li... > <s3t...@li...>* > > *!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!* > > > > > > Thanks, > > Tal > > > ------------------------------------------------------------------------------ > Start Your Social Network Today - Download eXo Platform > Build your Enterprise Intranet with eXo Platform Software > Java Based Open Source Intranet - Social, Extensible, Cloud Ready > Get Started Now And Turn Your Intranet Into A Collaboration Platform > http://p.sf.net/sfu/ExoPlatform > |