Just use a split command to split the file before upload.
Matt Rogers
Location: UK
UK Cell/SMS: +447958002382
Indian Cell/SMS: +919884690539
Email: matt@aroxo.com
Skype: mattrogers1975
From: Ryan Golhar [mailto:ngsbioinformatics@gmail.com]
Sent: 08 October 2012 16:08
To: s3tools-general@lists.sourceforge.net
Subject: [S3tools-general] multipart upload files with beta 1.1.0-3
Hi all - I have a file that is in excess of 400G. Its actually a compressed directory of files. When I try to upload it with s3tools sync, I get the error:
somefile.tar.gz -> s3://data/somefile.tar.gz [part 10001 of 24481, 15MB]
15728640 of 15728640 100% in 1s 14.93 MB/s done
ERROR: Upload of 'somefile.tar.gz' part 10001 failed. Aborting multipart upload.
ERROR: S3 error: 400 (InvalidArgument): Part number must be an integer between 1 and 10000, inclusive
It looks like the # of parts has to be less then 10,000. Why is this?