From: Sean P. <dl...@li...> - 2009-10-05 11:19:39
|
Hello, I'm having 403 (RequestTimeTooSkewed) error message often. > ERROR: S3 error: 403 (RequestTimeTooSkewed): The difference between the request time and the current time is too large. Do you know why it usually happens? Thank you very much. _________________________________________________________________ Hotmail: Powerful Free email with security by Microsoft. http://clk.atdmt.com/GBL/go/171222986/direct/01/ |
From: Sean P. <dl...@li...> - 2009-10-05 17:58:11
|
Sorry. I should provide more info. I'm using s3cmd-0.9.9 and I received this error messages when tring to upload 2GB files. It is intermmitent issues and sometimes works and sometimes doesn't. s3cmd -v put <filename> s3://bucket/name/<filename> INFO: Compiling list of local files... INFO: Applying --exclude/--include INFO: Summary: 1 local files to upload INFO: Sending file 'filename', please wait... WARNING: Upload failed: /bucket/name/filename ((104, 'Connection reset by peer')) WARNING: Retrying on lower speed (throttle=0.01) WARNING: Waiting 3 sec... INFO: Sending file 'filename', please wait... ERROR: S3 error: 403 (RequestTimeTooSkewed): The difference between the request time and the current time is too large. Is it similar to Timeout? Thank you very much in advance. From: dl...@li... To: s3t...@li... Date: Mon, 5 Oct 2009 07:19:26 -0400 Subject: [S3tools-general] 403 RequestTimeTooSkewed Hello, I'm having 403 (RequestTimeTooSkewed) error message often. > ERROR: S3 error: 403 (RequestTimeTooSkewed): The difference between the request time and the current time is too large. Do you know why it usually happens? Thank you very much. Hotmail: Powerful Free email with security by Microsoft. Get it now. _________________________________________________________________ Your E-mail and More On-the-Go. Get Windows Live Hotmail Free. http://clk.atdmt.com/GBL/go/171222985/direct/01/ |
From: Jeff R. <jr...@op...> - 2009-10-05 19:01:03
Attachments:
jross.vcf
|
Sean Park wrote: > > Sorry. I should provide more info. > > I'm using s3cmd-0.9.9 and I received this error messages when tring to > upload 2GB files. It is intermmitent issues and sometimes works and > sometimes doesn't. > I had a similar problem when I first started using s3cmd. I posted a question on the amazon developers board and was told there that it was "best practice" to, when possible, split your file into more manageable sizes--like what ever you can comfortably push into the cloud in no more than a couple of minutes. You can then reassemble the pieces using an EC instance, if you need the full file intact. I use S3 for our remote backups, so I use split to chunk up the dump files into 10MB hunks. These push up in about 80 seconds on our 1MB up cable connection. Note that this isn't a guarantee of success--I still get instances where the file will not upload first go so after I put all the files up I run a sync to double check that everything has been placed in the bucket. Here's where I think we need a set of exit codes so that I can programatically loop back if the file upload does fail. Right now when a put fails it kicks me out of my upload loop so I am sometimes faces with syncing another couple thousand files. put works better for me because I can pause the upload during business hours, otherwise s3cmd uses a whole lot of our available bandwidth when we have people here trying to work. sync does get the files but I can't check the time before each upload beings like I can in a loop around put. But that's a little off-topic for this message. Hope that helps, Jeff > s3cmd -v put <filename> s3://bucket/name/<filename> > INFO: Compiling list of local files... > INFO: Applying --exclude/--include > INFO: Summary: 1 local files to upload > INFO: Sending file 'filename', please wait... > WARNING: Upload failed: /bucket/name/filename ((104, 'Connection reset > by peer')) > WARNING: Retrying on lower speed (throttle=0.01) > WARNING: Waiting 3 sec... > INFO: Sending file 'filename', please wait... > ERROR: S3 error: 403 (RequestTimeTooSkewed): The difference between the > request time and the current time is too large. > > Is it similar to Timeout? > > Thank you very much in advance. > > > ------------------------------------------------------------------------ > From: dl...@li... > To: s3t...@li... > Date: Mon, 5 Oct 2009 07:19:26 -0400 > Subject: [S3tools-general] 403 RequestTimeTooSkewed > > > Hello, > > I'm having 403 (RequestTimeTooSkewed) error message often. > > > ERROR: S3 error: 403 (RequestTimeTooSkewed): The difference between > the request time and the current time is too large. > > Do you know why it usually happens? > > Thank you very much. > > > ------------------------------------------------------------------------ > Hotmail: Powerful Free email with security by Microsoft. Get it now. > <http://clk.atdmt.com/GBL/go/171222986/direct/01/> > ------------------------------------------------------------------------ > Your E-mail and More On-the-Go. Get Windows Live Hotmail Free. Sign up > now. <http://clk.atdmt.com/GBL/go/171222985/direct/01/> > !DSPAM:4aca33bf26948634750119! > > > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry® Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9-12, 2009. Register now! > http://p.sf.net/sfu/devconf > > !DSPAM:4aca33bf26948634750119! > > > ------------------------------------------------------------------------ > > _______________________________________________ > S3tools-general mailing list > S3t...@li... > https://lists.sourceforge.net/lists/listinfo/s3tools-general > > > !DSPAM:4aca33bf26948634750119! |
From: Michal L. <ml...@lo...> - 2009-10-06 22:29:00
|
Hi Sean, > I'm using s3cmd-0.9.9 and I received this error messages when tring to > upload 2GB files. It is intermittent issues and sometimes works and > sometimes doesn't. I bet it only happens when the upload fails for the first time and s3cmd tries to re-upload the file. Sadly in that case in s3cmd 0.9.9 the signature, which contains a timestamp, is not recomputed and the timestamp expires. Please upgrade to s3cmd 0.9.9.90 - there the problem is fixed and the signature is regenerated with a new timestamp before each retry. Michal |
From: Sean P. <dl...@li...> - 2009-10-06 23:37:19
|
Jeff and Michal, Thank you very much for your replies. It helped a lot, > Date: Wed, 7 Oct 2009 11:29:23 +1300 > From: ml...@lo... > To: s3t...@li... > Subject: Re: [S3tools-general] 403 RequestTimeTooSkewed > > Hi Sean, > > > I'm using s3cmd-0.9.9 and I received this error messages when tring to > > upload 2GB files. It is intermittent issues and sometimes works and > > sometimes doesn't. > > I bet it only happens when the upload fails for the first time and s3cmd > tries to re-upload the file. Sadly in that case in s3cmd 0.9.9 the > signature, which contains a timestamp, is not recomputed and the > timestamp expires. > > Please upgrade to s3cmd 0.9.9.90 - there the problem is fixed and the > signature is regenerated with a new timestamp before each retry. > > Michal > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry(R) Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9 - 12, 2009. Register now! > http://p.sf.net/sfu/devconference > _______________________________________________ > S3tools-general mailing list > S3t...@li... > https://lists.sourceforge.net/lists/listinfo/s3tools-general _________________________________________________________________ Hotmail: Free, trusted and rich email service. http://clk.atdmt.com/GBL/go/171222984/direct/01/ |
From: Sean P. <dl...@li...> - 2009-10-07 13:53:15
|
Hello, I used 0.9.9.90 and had new error message: !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! An unexpected error has occurred. Please report the following lines to: s3t...@li... !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Problem: NameError: global name '_max_retries' is not defined S3cmd: 0.9.9.90 Traceback (most recent call last): File "/s3cmd-0.9.9.90/s3cmd", line 1736, in <module> main() File "/s3cmd-0.9.9.90/s3cmd", line 1681, in main cmd_func(args) File "/s3cmd-0.9.9.90/s3cmd", line 338, in cmd_object_put response = s3.object_put(full_name, uri_final, extra_headers, extra_label = seq_label) File "/s3cmd-0.9.9.90/S3/S3.py", line 256, in object_put response = self.send_file(request, file, labels) File "/s3cmd-0.9.9.90/S3/S3.py", line 507, in send_file if retries < _max_retries: NameError: global name '_max_retries' is not defined !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! An unexpected error has occurred. Please report the above lines to: s3t...@li... !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Thank you. > Date: Wed, 7 Oct 2009 11:29:23 +1300 > From: ml...@lo... > To: s3t...@li... > Subject: Re: [S3tools-general] 403 RequestTimeTooSkewed > > Hi Sean, > > > I'm using s3cmd-0.9.9 and I received this error messages when tring to > > upload 2GB files. It is intermittent issues and sometimes works and > > sometimes doesn't. > > I bet it only happens when the upload fails for the first time and s3cmd > tries to re-upload the file. Sadly in that case in s3cmd 0.9.9 the > signature, which contains a timestamp, is not recomputed and the > timestamp expires. > > Please upgrade to s3cmd 0.9.9.90 - there the problem is fixed and the > signature is regenerated with a new timestamp before each retry. > > Michal > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry(R) Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9 - 12, 2009. Register now! > http://p.sf.net/sfu/devconference > _______________________________________________ > S3tools-general mailing list > S3t...@li... > https://lists.sourceforge.net/lists/listinfo/s3tools-general _________________________________________________________________ Hotmail: Powerful Free email with security by Microsoft. http://clk.atdmt.com/GBL/go/171222986/direct/01/ |