.TH s3cmd 1
s3cmd \- tool for managing Amazon S3 storage space
[\fIOPTIONS\fR] \fICOMMAND\fR [\fIPARAMETERS\fR]
is a command line client for copying files to/from
Amazon S3 (Simple Storage Service) and performing other
related tasks, for instance creating and removing buckets,
listing objects, etc.
can do several \fIactions\fR specified by the following \fIcommands\fR.
List objects or buckets
List all object in all buckets
\fBput\fR \fIFILE [FILE...] s3://BUCKET[/PREFIX]\fR
Put file into bucket (i.e. upload to S3)
\fBget\fR \fIs3://BUCKET/OBJECT LOCAL_FILE\fR
Get file from bucket (i.e. download from S3)
Delete file from bucket
\fBsync\fR \fILOCAL_DIR s3://BUCKET[/PREFIX]\fR
Backup a directory tree to S3
\fBsync\fR \fIs3://BUCKET[/PREFIX] LOCAL_DIR\fR
Restore a tree from S3 to local directory
Get various information about a Bucket or Object
Disk usage \- amount of data stored in S3
Some of the below specified options can have their default
values set in
config file (by default $HOME/.s3cmd). As it's a simple text file
feel free to open it with your favorite text editor and do any
changes you like.
Config file related options.
Invoke interactive (re)configuration tool. Don't worry, you won't
lose your settings on subsequent runs.
\fB\-c\fR FILE, \fB\-\-config\fR=FILE
Config file name. Defaults to $HOME/.s3cfg
Dump current configuration after parsing config files
and command line options and exit.
Most options can have a default value set in the above specified config file.
Options specific to \fBsync\fR command:
Delete remote objects with no corresponding local file when \fIsync\fRing \fBto\fR S3 or delete local files with no corresponding object in S3 when \fIsync\fRing \fBfrom\fR S3.
Don't delete remote objects. Default for 'sync' command.
Preserve filesystem attributes (mode, ownership, timestamps). Default for 'sync' command.
Don't store filesystem attributes with uploaded files.
Exclude files matching GLOB (a.k.a. shell-style wildcard) from \fIsync\fI. See SYNC COMMAND section for more information.
Same as \-\-exclude but reads GLOBs from the given FILE instead of expecting them on the command line.
Same as \-\-exclude but works with REGEXPs (Regular expressions).
Same as \-\-exclude\-from but works with REGEXPs.
\fB\-\-debug\-syncmatch\fR or \fB\-\-debug\-exclude\fR (alias)
Display detailed information about matching file names against exclude\-rules as well as information about remote vs local filelists matching. S3cmd exits after performing the match and no actual transfer takes place.
.\"Only show what would be uploaded or downloaded but don't actually do it. May still perform S3 requests to get bucket listings and other information though.
Options common for all commands (where it makes sense indeed):
Force overwrite and other dangerous operations.
Store objects with permissions allowing read for anyone.
Store objects with default ACL allowing access for you only.
Specify datacentre where to create the bucket. Possible values are \fIUS\fR (default) or \fIEU\fR.
Use GPG encryption to protect stored objects from unauthorized access.
\fB\-m\fR MIME/TYPE, \fB\-\-mime\-type\fR=MIME/TYPE
Default MIME\-type to be set for objects stored.
Guess MIME\(hytype of files by their extension. Falls
back to default MIME\(hyType as specified by \fB\-\-mime\-type\fR
Print sizes in human readable form.
.\"Show complete S3 URI in listings.
Enable verbose output.
Enable debug output.
Show the help message and exit
version and exit.
.SH SYNC COMMAND
One of the most powerful commands of \fIs3cmd\fR is \fBs3cmd sync\fR used for
synchronising complete directory trees to or from remote S3 storage.
Basic usage common in backup scenarios is as simple as:
s3cmd sync /local/path s3://test-bucket/backup
This command will find all files under /local/path directory and copy them
to corresponding paths under s3://test-bucket/backup on the remote side.
/local/path\fB/file1.ext\fR \-> s3://test-bucket/backup\fB/file1.ext\fR
/local/path\fB/dir123/file2.bin\fR \-> s3://test-bucket/backup\fB/dir123/file2.bin\fR
To retrieve the files back from S3 use inverted syntax:
s3cmd sync s3://test-bucket/backup/ /tmp/restore
that will download files:
s3://test-bucket/backup\fB/file1.ext\fR \-> /tmp/restore\fB/file1.ext\fR
s3://test-bucket/backup\fB/dir123/file2.bin\fR \-> /tmp/restore\fB/dir123/file2.bin\fR
For the purpose of \fB\-\-exclude\fR and \fB\-\-exclude\-from\fR matching the file name
\fIalways\fR begins with \fB/\fR (slash) and has the local or remote common part removed.
For instance in the previous example the file names tested against \-\-exclude list
will be \fB/\fRfile1.ext and \fB/\fRdir123/file2.bin, that is both with the leading
slash regardless whether you specified s3://test-bucket/backup or
s3://test-bucket/backup/ (note the trailing slash) on the command line.
Both \fB\-\-exclude\fR and \fB\-\-exclude\-from\fR work with shell-style wildcards (a.k.a. GLOB).
For a greater flexibility s3cmd provides Regular-expression versions of the two exclude options
named \fB\-\-rexclude\fR and \fB\-\-rexclude\-from\fR.
Run s3cmd with \fB\-\-debug\-syncmatch\fR to get detailed information
about matching file names against exclude rules.
For example to exclude all files with ".bin" extension with a REGEXP use:
to exclude all hidden files and subdirectories (i.e. those whose name begins with dot ".") use GLOB:
on the other hand to exclude only hidden files but not hidden subdirectories use REGEXP:
Written by Michal Ludvig <firstname.lastname@example.org>
.SH REPORTING BUGS
Report bugs to
Copyright \(co 2007,2008 Michal Ludvig <http://www.logix.cz/michal>
This is free software. You may redistribute copies of it under the terms of
the GNU General Public License version 2 <http://www.gnu.org/licenses/gpl.html>.
There is NO WARRANTY, to the extent permitted by law.
.SH SEE ALSO
For the most up to date list of options run
.B s3cmd \-\-help
For more info about usage, examples and other related info visit project homepage at