DownloadWeed-FS is a simple and highly scalable distributed file system. There are two objectives:
1. to store billions of files!
2. to serve the files fast!
Instead of supporting full POSIX file system semantics, Weed-FS choose to implement only a key~file mapping. Similar to the word "NoSQL", you can call it as "NoFS".
Instead of managing all file metadata in a central master, Weed-FS choose to manages file volumes in the central master, and let storage nodes manage files and the metadata. This relieves concurrency pressure from the central master and spreads file metadata into storage nodes memories, allowing faster file access with just one disk read operation.
Weed-FS models after Facebook's Haystack design paper.
More details can be found on http://weed-fs.googlecode.com
Features
- Distributed Key-to-File Storage
- Data Center and Rack aware replication
- O(1) Disk Access to serve a get file operation