Menu
▾
▴
[S3tools-general] Not deleting on sync, empty object message
|
From: Russell G. <ru...@gm...> - 2015-05-05 11:17:28
|
/data/WorkInProgressSSD/s3dev/rs3BackupSystem/software $ ./rs3-uploadsoftware DEBUG: ConfigParser: Reading file '/home/jr/.s3cfg' DEBUG: ConfigParser: access_key->AK...17_chars...Q DEBUG: ConfigParser: access_token-> DEBUG: ConfigParser: add_encoding_exts-> DEBUG: ConfigParser: add_headers-> DEBUG: ConfigParser: bucket_location->eu-west DEBUG: ConfigParser: ca_certs_file-> DEBUG: ConfigParser: cache_file-> DEBUG: ConfigParser: check_ssl_certificate->True DEBUG: ConfigParser: cloudfront_host->cloudfront.amazonaws.com DEBUG: ConfigParser: default_mime_type->binary/octet-stream DEBUG: ConfigParser: delay_updates->False DEBUG: ConfigParser: delete_after->False DEBUG: ConfigParser: delete_after_fetch->False DEBUG: ConfigParser: delete_removed->False DEBUG: ConfigParser: dry_run->False DEBUG: ConfigParser: enable_multipart->True DEBUG: ConfigParser: encoding->UTF-8 DEBUG: ConfigParser: encrypt->False DEBUG: ConfigParser: expiry_date-> DEBUG: ConfigParser: expiry_days-> DEBUG: ConfigParser: expiry_prefix-> DEBUG: ConfigParser: follow_symlinks->False DEBUG: ConfigParser: force->False DEBUG: ConfigParser: get_continue->False DEBUG: ConfigParser: gpg_command->/usr/bin/gpg DEBUG: ConfigParser: gpg_decrypt->%(gpg_command)s -d --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s DEBUG: ConfigParser: gpg_encrypt->%(gpg_command)s -c --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s DEBUG: ConfigParser: gpg_passphrase->x8...17_chars...7 DEBUG: ConfigParser: guess_mime_type->True DEBUG: ConfigParser: host_base->s3.amazonaws.com DEBUG: ConfigParser: host_bucket->%(bucket)s.s3.amazonaws.com DEBUG: ConfigParser: human_readable_sizes->False DEBUG: ConfigParser: ignore_failed_copy->False DEBUG: ConfigParser: invalidate_default_index_on_cf->False DEBUG: ConfigParser: invalidate_default_index_root_on_cf->True DEBUG: ConfigParser: invalidate_on_cf->False DEBUG: ConfigParser: list_md5->False DEBUG: ConfigParser: log_target_prefix-> DEBUG: ConfigParser: max_delete->-1 DEBUG: ConfigParser: mime_type-> DEBUG: ConfigParser: multipart_chunk_size_mb->15 DEBUG: ConfigParser: preserve_attrs->True DEBUG: ConfigParser: progress_meter->True DEBUG: ConfigParser: proxy_host-> DEBUG: ConfigParser: proxy_port->0 DEBUG: ConfigParser: put_continue->False DEBUG: ConfigParser: recursive->False DEBUG: ConfigParser: recv_chunk->4096 DEBUG: ConfigParser: reduced_redundancy->False DEBUG: ConfigParser: restore_days->1 DEBUG: ConfigParser: secret_key->tg...37_chars...v DEBUG: ConfigParser: send_chunk->4096 DEBUG: ConfigParser: server_side_encryption->False DEBUG: ConfigParser: signature_v2->False DEBUG: ConfigParser: simpledb_host->sdb.amazonaws.com DEBUG: ConfigParser: skip_existing->False DEBUG: ConfigParser: socket_timeout->300 DEBUG: ConfigParser: urlencoding_mode->normal DEBUG: ConfigParser: use_https->True DEBUG: ConfigParser: use_mime_magic->True DEBUG: ConfigParser: verbosity->WARNING DEBUG: ConfigParser: website_endpoint->http://%(bucket)s.s3-website-%(location)s.amazonaws.com/ DEBUG: ConfigParser: website_error-> DEBUG: ConfigParser: website_index->index.html DEBUG: Updating Config.Config cache_file -> DEBUG: Updating Config.Config follow_symlinks -> False DEBUG: Updating Config.Config verbosity -> 10 DEBUG: Unicodising 'sync' using UTF-8 DEBUG: Unicodising '.' using UTF-8 DEBUG: Unicodising 's3://mybucket/software/' using UTF-8 DEBUG: Command: sync INFO: Compiling list of local files... DEBUG: DeUnicodising u'.' using UTF-8 DEBUG: DeUnicodising u'.' using UTF-8 DEBUG: DeUnicodising u'.' using UTF-8 DEBUG: Unicodising './rs3-auditindex' using UTF-8 DEBUG: Unicodising './rs3-auditindex' using UTF-8 DEBUG: Unicodising './rs3-awsclifns' using UTF-8 DEBUG: Unicodising './rs3-awsclifns' using UTF-8 DEBUG: Unicodising './rs3-declares' using UTF-8 DEBUG: Unicodising './rs3-declares' using UTF-8 DEBUG: Unicodising './rs3-functions' using UTF-8 DEBUG: Unicodising './rs3-functions' using UTF-8 DEBUG: Unicodising './rs3-s3toolsfns' using UTF-8 DEBUG: Unicodising './rs3-s3toolsfns' using UTF-8 DEBUG: Unicodising './rs3-setup' using UTF-8 DEBUG: Unicodising './rs3-setup' using UTF-8 DEBUG: Unicodising './rs3-testexclusions' using UTF-8 DEBUG: Unicodising './rs3-testexclusions' using UTF-8 DEBUG: Unicodising './rs3-uploadsoftware' using UTF-8 DEBUG: Unicodising './rs3-uploadsoftware' using UTF-8 DEBUG: Unicodising './rs3-uploadsoftware~' using UTF-8 DEBUG: Unicodising './rs3-uploadsoftware~' using UTF-8 DEBUG: Unicodising './rs3bu' using UTF-8 DEBUG: Unicodising './rs3bu' using UTF-8 DEBUG: Applying --exclude/--include DEBUG: CHECK: rs3-auditindex DEBUG: PASS: u'rs3-auditindex' DEBUG: CHECK: rs3-awsclifns DEBUG: PASS: u'rs3-awsclifns' DEBUG: CHECK: rs3-declares DEBUG: PASS: u'rs3-declares' DEBUG: CHECK: rs3-functions DEBUG: PASS: u'rs3-functions' DEBUG: CHECK: rs3-s3toolsfns DEBUG: PASS: u'rs3-s3toolsfns' DEBUG: CHECK: rs3-setup DEBUG: PASS: u'rs3-setup' DEBUG: CHECK: rs3-testexclusions DEBUG: PASS: u'rs3-testexclusions' DEBUG: CHECK: rs3-uploadsoftware DEBUG: PASS: u'rs3-uploadsoftware' DEBUG: CHECK: rs3-uploadsoftware~ DEBUG: PASS: u'rs3-uploadsoftware~' DEBUG: CHECK: rs3bu DEBUG: PASS: u'rs3bu' INFO: Running stat() and reading/calculating MD5 values on 10 files, this may take some time... DEBUG: doing file I/O to read md5 of rs3-auditindex DEBUG: doing file I/O to read md5 of rs3-awsclifns DEBUG: doing file I/O to read md5 of rs3-declares DEBUG: doing file I/O to read md5 of rs3-functions DEBUG: doing file I/O to read md5 of rs3-s3toolsfns DEBUG: doing file I/O to read md5 of rs3-setup DEBUG: doing file I/O to read md5 of rs3-testexclusions DEBUG: doing file I/O to read md5 of rs3-uploadsoftware DEBUG: doing file I/O to read md5 of rs3-uploadsoftware~ DEBUG: doing file I/O to read md5 of rs3bu DEBUG: Unicodising 'software/' using UTF-8 DEBUG: Unicodising 'software/' using UTF-8 INFO: Retrieving list of remote files for s3://mybucket/software/ ... DEBUG: String 'software/' encoded to 'software/' DEBUG: CreateRequest: resource[uri]=/ DEBUG: Using signature v4 DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com DEBUG: canonical_headers = host:mybucket.s3.amazonaws.com x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date:20150505T110044Z DEBUG: Canonical Request: GET / prefix=software%2F host:mybucket.s3.amazonaws.com x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date:20150505T110044Z host;x-amz-content-sha256;x-amz-date e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 ---------------------- DEBUG: signature-v4 headers: {'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': 'AWS4-HMAC-SHA256 Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=228a87cbe97d709652338088a8ff0f4d5ac3f495115094c6883f870c67951a7b', 'x-amz-date': '20150505T110044Z'} DEBUG: Processing request, please wait... DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com DEBUG: ConnMan.get(): creating new connection: https://mybucket.s3.amazonaws.com DEBUG: Using ca_certs_file None DEBUG: non-proxied HTTPSConnection(mybucket.s3.amazonaws.com) DEBUG: format_uri(): /?prefix=software/ DEBUG: Sending request method_string='GET', uri='/?prefix=software/', headers={'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': 'AWS4-HMAC-SHA256 Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=228a87cbe97d709652338088a8ff0f4d5ac3f495115094c6883f870c67951a7b', 'x-amz-date': '20150505T110044Z'}, body=(0 bytes) DEBUG: Response: {'status': 400, 'headers': {'x-amz-id-2': 't3kvjHQLLUeWNeQx4ljrMZzKSu6KuP740DBryU07nqij8Pq/HFIeD3SltYN7s2lcx5+Fyd/wPgA=', 'server': 'AmazonS3', 'transfer-encoding': 'chunked', 'connection': 'close', 'x-amz-request-id': 'D93B544A8D6703D3', 'date': 'Tue, 05 May 2015 11:00:45 GMT', 'content-type': 'application/xml'}, 'reason': 'Bad Request', 'data': '<?xml version="1.0" encoding="UTF-8"?>\n<Error><Code>AuthorizationHeaderMalformed</Code><Message>The authorization header is malformed; the region \'eu-west\' is wrong; expecting \'eu-west-1\'</Message><Region>eu-west-1</Region><RequestId>D93B544A8D6703D3</RequestId><HostId>t3kvjHQLLUeWNeQx4ljrMZzKSu6KuP740DBryU07nqij8Pq/HFIeD3SltYN7s2lcx5+Fyd/wPgA=</HostId></Error>'} DEBUG: ConnMan.put(): connection put back to pool (https://mybucket.s3.amazonaws.com#1) INFO: Forwarding request to eu-west-1 DEBUG: Using signature v4 DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com DEBUG: canonical_headers = host:mybucket.s3.amazonaws.com x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date:20150505T110045Z DEBUG: Canonical Request: GET / prefix=software%2F host:mybucket.s3.amazonaws.com x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date:20150505T110045Z host;x-amz-content-sha256;x-amz-date e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 ---------------------- DEBUG: signature-v4 headers: {'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'x-amz-date': '20150505T110045Z', 'Authorization': 'AWS4-HMAC-SHA256 Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=bc8c2ef18893dfb5b2b24a196fc7cf2eea3e3b783fc165c85c2a38c588086921'} DEBUG: Processing request, please wait... DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com DEBUG: ConnMan.get(): re-using connection: https://mybucket.s3.amazonaws.com#1 DEBUG: format_uri(): /?prefix=software/ DEBUG: Sending request method_string='GET', uri='/?prefix=software/', headers={'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'x-amz-date': '20150505T110045Z', 'Authorization': 'AWS4-HMAC-SHA256 Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=bc8c2ef18893dfb5b2b24a196fc7cf2eea3e3b783fc165c85c2a38c588086921'}, body=(0 bytes) DEBUG: Response: {'status': 200, 'headers': {'x-amz-id-2': 'lfupRlqL/RZBU8Gwbuqdhr2DDZRp5hRgHBkkTueQ+UgEBxe7XudYwaNyEHjCI9JTpwZG9SZ8XZE=', 'server': 'AmazonS3', 'transfer-encoding': 'chunked', 'x-amz-request-id': 'E0636ACC0242FFA0', 'date': 'Tue, 05 May 2015 11:00:46 GMT', 'content-type': 'application/xml'}, 'reason': 'OK', 'data': '<?xml version="1.0" encoding="UTF-8"?>\n<ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>mybucket</Name><Prefix>software/</Prefix><Marker></Marker><MaxKeys>1000</MaxKeys><IsTruncated>false</IsTruncated><Contents><Key>software/</Key><LastModified>2015-05-05T10:29:06.000Z</LastModified><ETag>"d41d8cd98f00b204e9800998ecf8427e"</ETag><Size>0</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-auditindex</Key><LastModified>2015-05-05T10:55:00.000Z</LastModified><ETag>"c79d9a4cee48564bc557dddbc321fd83"</ETag><Size>738</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-awsclifns</Key><LastModified>2015-05-05T10:55:00.000Z</LastModified><ETag>"f0580516e1feffd209444d7bd25ec75e"</ETag><Size>4192</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-declares</Key><LastModified>2015-05-05T10:55:00.000Z</LastModified><ETag>"e98d1db7ebe6710e71cbbf9d4502e995"</ETag><Size>5887</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-functions</Key><LastModified>2015-05-05T10:55:00.000Z</LastModified><ETag>"1e301a27a56bff34da962c8ad1aa45d6"</ETag><Size>21991</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-s3toolsfns</Key><LastModified>2015-05-05T10:55:01.000Z</LastModified><ETag>"122b413e9a8a932ccc705e5410211888"</ETag><Size>4486</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-setup</Key><LastModified>2015-05-05T10:55:01.000Z</LastModified><ETag>"2fb5e38d771c217eee7981f608dd87aa"</ETag><Size>904</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-testexclusions</Key><LastModified>2015-05-05T10:55:01.000Z</LastModified><ETag>"08744d0923ece872aee9463b623e1e97"</ETag><Size>404</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-uploadsoftware</Key><LastModified>2015-05-05T10:55:01.000Z</LastModified><ETag>"dd547c81228c8dfeafa014dc1dfd025f"</ETag><Size>380</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-uploadsoftware~</Key><LastModified>2015-05-05T10:55:01.000Z</LastModified><ETag>"a393c628a452038a16a2d4584a40ded0"</ETag><Size>390</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3bu</Key><LastModified>2015-05-05T10:55:01.000Z</LastModified><ETag>"2ce39b2f4b2f448d93db61d654910999"</ETag><Size>6179</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents></ListBucketResult>'} DEBUG: ConnMan.put(): connection put back to pool (https://mybucket.s3.amazonaws.com#2) WARNING: Empty object name on S3 found, ignoring. DEBUG: Applying --exclude/--include DEBUG: CHECK: rs3-auditindex DEBUG: PASS: 'rs3-auditindex' DEBUG: CHECK: rs3-awsclifns DEBUG: PASS: 'rs3-awsclifns' DEBUG: CHECK: rs3-declares DEBUG: PASS: 'rs3-declares' DEBUG: CHECK: rs3-functions DEBUG: PASS: 'rs3-functions' DEBUG: CHECK: rs3-s3toolsfns DEBUG: PASS: 'rs3-s3toolsfns' DEBUG: CHECK: rs3-setup DEBUG: PASS: 'rs3-setup' DEBUG: CHECK: rs3-testexclusions DEBUG: PASS: 'rs3-testexclusions' DEBUG: CHECK: rs3-uploadsoftware DEBUG: PASS: 'rs3-uploadsoftware' DEBUG: CHECK: rs3-uploadsoftware~ DEBUG: PASS: 'rs3-uploadsoftware~' DEBUG: CHECK: rs3bu DEBUG: PASS: 'rs3bu' INFO: Found 10 local files, 10 remote files INFO: Verifying attributes... DEBUG: Comparing filelists (direction: local -> remote) DEBUG: CHECK: rs3-auditindex DEBUG: IGNR: rs3-auditindex (transfer not needed) DEBUG: CHECK: rs3-awsclifns DEBUG: IGNR: rs3-awsclifns (transfer not needed) DEBUG: CHECK: rs3-declares DEBUG: IGNR: rs3-declares (transfer not needed) DEBUG: CHECK: rs3-functions DEBUG: IGNR: rs3-functions (transfer not needed) DEBUG: CHECK: rs3-s3toolsfns DEBUG: IGNR: rs3-s3toolsfns (transfer not needed) DEBUG: CHECK: rs3-setup DEBUG: IGNR: rs3-setup (transfer not needed) DEBUG: CHECK: rs3-testexclusions DEBUG: IGNR: rs3-testexclusions (transfer not needed) DEBUG: CHECK: rs3-uploadsoftware DEBUG: xfer: rs3-uploadsoftware (size mismatch: src=385 dst=380) DEBUG: CHECK: rs3-uploadsoftware~ DEBUG: xfer: rs3-uploadsoftware~ (size mismatch: src=380 dst=390) DEBUG: DST COPY src: rs3-uploadsoftware -> rs3-uploadsoftware~ DEBUG: CHECK: rs3bu DEBUG: IGNR: rs3bu (transfer not needed) INFO: Summary: 1 local files to upload, 1 files to remote copy, 0 remote files to delete DEBUG: attr_header: {'x-amz-meta-s3cmd-attrs': 'uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637'} DEBUG: String 'software/rs3-uploadsoftware' encoded to 'software/rs3-uploadsoftware' DEBUG: CreateRequest: resource[uri]=/software/rs3-uploadsoftware DEBUG: Unicodising './rs3-uploadsoftware' using UTF-8 DEBUG: Using signature v4 DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com DEBUG: canonical_headers = content-length:385 content-type:text/x-shellscript host:mybucket.s3.amazonaws.com x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date:20150505T110045Z x-amz-meta-s3cmd-attrs:uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637 DEBUG: Canonical Request: PUT /software/rs3-uploadsoftware content-length:385 content-type:text/x-shellscript host:mybucket.s3.amazonaws.com x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date:20150505T110045Z x-amz-meta-s3cmd-attrs:uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637 content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 ---------------------- DEBUG: signature-v4 headers: {'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'content-length': 385, 'x-amz-meta-s3cmd-attrs': 'uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637', 'x-amz-date': '20150505T110045Z', 'content-type': 'text/x-shellscript', 'Authorization': 'AWS4-HMAC-SHA256 Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs,Signature=b0fc99e15f10bbe6b3036ddc6103a4768bf71f800a89f795d8994d67d7fb2582'} ./rs3-uploadsoftware -> s3://mybucket/software/rs3-uploadsoftware [1 of 1] DEBUG: Using signature v4 DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com DEBUG: canonical_headers = content-length:385 content-type:text/x-shellscript host:mybucket.s3.amazonaws.com x-amz-content-sha256:baaafe98ff33f7c51999d5bdb166b27ee613c0667df07485fb3f3a39ffd5f55e x-amz-date:20150505T110045Z x-amz-meta-s3cmd-attrs:uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637 DEBUG: Canonical Request: PUT /software/rs3-uploadsoftware content-length:385 content-type:text/x-shellscript host:mybucket.s3.amazonaws.com x-amz-content-sha256:baaafe98ff33f7c51999d5bdb166b27ee613c0667df07485fb3f3a39ffd5f55e x-amz-date:20150505T110045Z x-amz-meta-s3cmd-attrs:uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637 content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs baaafe98ff33f7c51999d5bdb166b27ee613c0667df07485fb3f3a39ffd5f55e ---------------------- DEBUG: signature-v4 headers: {'x-amz-content-sha256': 'baaafe98ff33f7c51999d5bdb166b27ee613c0667df07485fb3f3a39ffd5f55e', 'content-length': 385, 'x-amz-meta-s3cmd-attrs': 'uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637', 'x-amz-date': '20150505T110045Z', 'content-type': 'text/x-shellscript', 'Authorization': 'AWS4-HMAC-SHA256 Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs,Signature=20a2cb2dec6aa86b53374a1311b4f83ab4b8bfc837bec96eac644ac41fca958a'} DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com DEBUG: ConnMan.get(): re-using connection: https://mybucket.s3.amazonaws.com#2 DEBUG: format_uri(): /software/rs3-uploadsoftware 385 of 385 100% in 0s 375.60 kB/sDEBUG: ConnMan.put(): connection put back to pool (https://mybucket.s3.amazonaws.com#3) DEBUG: Response: {'status': 200, 'headers': {'content-length': '0', 'x-amz-id-2': 'kounfoONUx/JIr8AKtPmDysFs29AihS7pRjMpgksXoMCIScZRMip6BjIeVL4hF7eF6CoHK6ob+k=', 'server': 'AmazonS3', 'x-amz-request-id': '8A03C3177FAFB197', 'etag': '"b5618e68f5e33ef69eb77010c8627ab2"', 'date': 'Tue, 05 May 2015 11:00:46 GMT'}, 'reason': 'OK', 'data': '', 'size': 385} 385 of 385 100% in 0s 4.75 kB/s done DEBUG: MD5 sums: computed=b5618e68f5e33ef69eb77010c8627ab2, received="b5618e68f5e33ef69eb77010c8627ab2" DEBUG: Remote Copying from rs3-uploadsoftware to rs3-uploadsoftware~ DEBUG: Unicodising 'software/rs3-uploadsoftware' using UTF-8 DEBUG: Unicodising 'software/rs3-uploadsoftware' using UTF-8 DEBUG: String 'software/rs3-uploadsoftware' encoded to 'software/rs3-uploadsoftware' DEBUG: String 'software/rs3-uploadsoftware~' encoded to 'software/rs3-uploadsoftware%7E' DEBUG: CreateRequest: resource[uri]=/software/rs3-uploadsoftware%7E DEBUG: Using signature v4 DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com DEBUG: canonical_headers = host:mybucket.s3.amazonaws.com x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-copy-source:/mybucket/software/rs3-uploadsoftware x-amz-date:20150505T110045Z x-amz-metadata-directive:COPY x-amz-storage-class:STANDARD DEBUG: Canonical Request: PUT /software/rs3-uploadsoftware~ host:mybucket.s3.amazonaws.com x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-copy-source:/mybucket/software/rs3-uploadsoftware x-amz-date:20150505T110045Z x-amz-metadata-directive:COPY x-amz-storage-class:STANDARD host;x-amz-content-sha256;x-amz-copy-source;x-amz-date;x-amz-metadata-directive;x-amz-storage-class e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 ---------------------- DEBUG: signature-v4 headers: {'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'x-amz-date': '20150505T110045Z', 'x-amz-storage-class': 'STANDARD', 'x-amz-copy-source': '/mybucket/software/rs3-uploadsoftware', 'Authorization': 'AWS4-HMAC-SHA256 Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-copy-source;x-amz-date;x-amz-metadata-directive;x-amz-storage-class,Signature=7215b6c003739ac0575d2afee07a180b4f3c87a50e2d11235b4dbab263ef7554', 'x-amz-metadata-directive': 'COPY'} DEBUG: Processing request, please wait... DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com DEBUG: ConnMan.get(): re-using connection: https://mybucket.s3.amazonaws.com#3 DEBUG: format_uri(): /software/rs3-uploadsoftware%7E DEBUG: Sending request method_string='PUT', uri='/software/rs3-uploadsoftware%7E', headers={'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'x-amz-date': '20150505T110045Z', 'x-amz-storage-class': 'STANDARD', 'x-amz-copy-source': '/mybucket/software/rs3-uploadsoftware', 'Authorization': 'AWS4-HMAC-SHA256 Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-copy-source;x-amz-date;x-amz-metadata-directive;x-amz-storage-class,Signature=7215b6c003739ac0575d2afee07a180b4f3c87a50e2d11235b4dbab263ef7554', 'x-amz-metadata-directive': 'COPY'}, body=(0 bytes) DEBUG: Response: {'status': 200, 'headers': {'content-length': '234', 'x-amz-id-2': 'zbXUfMzN5MUJXWOW81YM+CmeFdxxEQLYIok8klFLY4tNhhTL0jaJj0N/teaMaX9a/klFc/Se6q4=', 'server': 'AmazonS3', 'x-amz-request-id': 'B48FDDA9EF20CA7B', 'date': 'Tue, 05 May 2015 11:00:46 GMT', 'content-type': 'application/xml'}, 'reason': 'OK', 'data': '<?xml version="1.0" encoding="UTF-8"?>\n<CopyObjectResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><LastModified>2015-05-05T11:00:46.000Z</LastModified><ETag>"b5618e68f5e33ef69eb77010c8627ab2"</ETag></CopyObjectResult>'} DEBUG: ConnMan.put(): connection put back to pool (https://mybucket.s3.amazonaws.com#4) DEBUG: String 'software/rs3-uploadsoftware~' encoded to 'software/rs3-uploadsoftware%7E' DEBUG: CreateRequest: resource[uri]=/software/rs3-uploadsoftware%7E DEBUG: Using signature v4 DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com DEBUG: canonical_headers = host:mybucket.s3.amazonaws.com x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date:20150505T110045Z DEBUG: Canonical Request: HEAD /software/rs3-uploadsoftware~ host:mybucket.s3.amazonaws.com x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date:20150505T110045Z host;x-amz-content-sha256;x-amz-date e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 ---------------------- DEBUG: signature-v4 headers: {'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': 'AWS4-HMAC-SHA256 Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=d5b92aafeefe997880a5d54740aaf1a49d212e5ed78842e203072c0f759fbfe8', 'x-amz-date': '20150505T110045Z'} DEBUG: Processing request, please wait... DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com DEBUG: ConnMan.get(): re-using connection: https://mybucket.s3.amazonaws.com#4 DEBUG: format_uri(): /software/rs3-uploadsoftware%7E DEBUG: Sending request method_string='HEAD', uri='/software/rs3-uploadsoftware%7E', headers={'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': 'AWS4-HMAC-SHA256 Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=d5b92aafeefe997880a5d54740aaf1a49d212e5ed78842e203072c0f759fbfe8', 'x-amz-date': '20150505T110045Z'}, body=(0 bytes) DEBUG: Response: {'status': 200, 'headers': {'content-length': '385', 'x-amz-id-2': '29lpe2xGjPb+OtTQj3qKY9K2OuKaS6YSnKzhc9a/J1hlslAfgDBQxYcXGZqKgFB1nXhhZpjnA5k=', 'accept-ranges': 'bytes', 'x-amz-meta-s3cmd-attrs': 'uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637', 'server': 'AmazonS3', 'last-modified': 'Tue, 05 May 2015 11:00:46 GMT', 'x-amz-request-id': '9423561E676E997A', 'etag': '"b5618e68f5e33ef69eb77010c8627ab2"', 'date': 'Tue, 05 May 2015 11:00:46 GMT', 'content-type': 'text/x-shellscript'}, 'reason': 'OK', 'data': '', 's3cmd-attrs': {'uid': '1000', 'gname': 'jr', 'ctime': '1430823637', 'uname': 'jr', 'gid': '1000', 'mode': '33279', 'mtime': '1430823637', 'atime': '1430823637', 'md5': 'b5618e68f5e33ef69eb77010c8627ab2'}} DEBUG: ConnMan.put(): connection put back to pool (https://mybucket.s3.amazonaws.com#5) remote copy: rs3-uploadsoftware -> rs3-uploadsoftware~ DEBUG: Process files that was not remote copied Done. Uploaded 385 bytes in 1.0 seconds, 385.00 B/s. Copied 1 files saving 385 bytes transfer. /data/WorkInProgressSSD/s3dev/rs3BackupSystem/software $ |