[S3tools-commits] [ s3tools-Bugs-3555403 ] Multi-part uploads corrupts md5checksum (etag)

[SourceForge.net <no...@so...>]

Bugs item #3555403, was opened at 2012-08-08 12:29
Message generated for change (Tracker Item Submitted) made by nobody
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=887015&aid=3555403&group_id=178907

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: s3cmd
Group: Malfunction
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Nobody/Anonymous (nobody)
Assigned to: Nobody/Anonymous (nobody)
Summary: Multi-part uploads corrupts md5checksum (etag)

Initial Comment:
Using 1.1.0-beta3

Uploading a large file (120Mb) is causing the md5 (etag) checksum to be a corrupted value..... (eg. 22e201a50836af721e8494198d0bc708-9 below)


First without multi part and everything is fine

-bash-3.2#  s3cmd put --disable-multipart zzzz s3://bityota_test/test/test
WARNING: Module python-magic is not available. Guessing MIME types based on file extensions.
zzzz -> s3://bityota_test/test/test  [1 of 1]
 126213121 of 126213121   100% in   10s    11.45 MB/s  done
-bash-3.2#  s3cmd get s3://bityota_test/test/test yyyy
s3://bityota_test/test/test -> yyyy  [1 of 1]
 126213121 of 126213121   100% in    5s    22.62 MB/s  done


Now as multipart, and the md5sum has a dash (which is invalid for a hex-string)

-bash-3.2#  s3cmd put zzzz s3://bityota_test/test/test
WARNING: Module python-magic is not available. Guessing MIME types based on file extensions.
zzzz -> s3://bityota_test/test/test  [part 1 of 9, 15MB]
 15728640 of 15728640   100% in    1s     9.43 MB/s  done
zzzz -> s3://bityota_test/test/test  [part 2 of 9, 15MB]
 15728640 of 15728640   100% in    1s    13.42 MB/s  done
zzzz -> s3://bityota_test/test/test  [part 3 of 9, 15MB]
 15728640 of 15728640   100% in    1s    13.99 MB/s  done
zzzz -> s3://bityota_test/test/test  [part 4 of 9, 15MB]
 15728640 of 15728640   100% in    4s     3.71 MB/s  done
zzzz -> s3://bityota_test/test/test  [part 5 of 9, 15MB]
 15728640 of 15728640   100% in    3s     4.13 MB/s  done
zzzz -> s3://bityota_test/test/test  [part 6 of 9, 15MB]
 15728640 of 15728640   100% in    0s    15.53 MB/s  done
zzzz -> s3://bityota_test/test/test  [part 7 of 9, 15MB]
 15728640 of 15728640   100% in    1s    12.07 MB/s  done
zzzz -> s3://bityota_test/test/test  [part 8 of 9, 15MB]
 15728640 of 15728640   100% in    1s    14.52 MB/s  done
zzzz -> s3://bityota_test/test/test  [part 9 of 9, 375kB]
 384001 of 384001   100% in    0s     4.11 MB/s  done
-bash-3.2#  s3cmd get s3://bityota_test/test/test xxxx
s3://bityota_test/test/test -> xxxx  [1 of 1]
 126213121 of 126213121   100% in    6s    18.43 MB/s  done
WARNING: MD5 signatures do not match: computed=9e15f4c02f44f8b439a838322793ebd1, received="22e201a50836af721e8494198d0bc708-9"


-bash-3.2# md5sum xxxx yyyy zzzz 
9e15f4c02f44f8b439a838322793ebd1  xxxx
9e15f4c02f44f8b439a838322793ebd1  yyyy
9e15f4c02f44f8b439a838322793ebd1  zzzz

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=887015&aid=3555403&group_id=178907