Menu
▾
▴
Re: [S3tools-general] empty directories not syncing - known issue
|
From: <j.m...@en...> - 2014-03-12 19:46:44
|
My impression is that there is no such thing as an "empty directory" on S3. There really aren't hierarchical folders/directories -- it is a flat namespace. Using / as a delimiter gives the illusion of a hierarchy, because you can have bucket.s3.com/one/two/file.x bucket.s3.com/one/two/file.y but there really isn't anything about '/one/two/' that makes it a "directory" -- only the fact that there other names that start the same way makes it smell like one. You could in fact store data under the names bucket.s3.com/one bucket.s3.com/one/two (unlike in a hierarchical system) as well as the "children" file.x and file.y. What would / could be stored in s3 to represent an empty directory? bucket.s3.com/four/ You could store a 0-byte datum with that name, and perhaps s3cmd could work to maintain that "a named entry ending / with 0-byte data and no other entries that start with the same thing is the s3 equivalent of an empty directory". However, I'm not sure that s3 handles names that end with / differently than names that are the same without the /. Could you have the entry above and also store data in bucket.s3.com/four ? Only by experimenting could you determine that. J. Merrill -----Original Message----- From: "WagnerOne" <wa...@wa...> Sent: Tuesday, March 11, 2014 9:32am To: S3t...@li... Subject: [S3tools-general] empty directories not syncing - known issue Hi, I noticed empty directories on my source (not s3) side aren't making it to my target, s3 side. I searched the archives and saw this is a known issue. Is there a timeline for when this may be resolved? Also, what is the current behavior if I create the required empty directories in s3 manually and then re-sync with s3cmd --delete-removed? Will those empty folders be removed? I'll do some tests of my own, but thought I'd ask in case you already know. Thanks, Mike -- wa...@wa... "It is nobler to declare oneself wrong than to insist on being right - especially when one is right."-Nietzsche ------------------------------------------------------------------------------ Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/13534_NeoTech _______________________________________________ S3tools-general mailing list S3t...@li... https://lists.sourceforge.net/lists/listinfo/s3tools-general |