Weed-FS is a simple and highly scalable distributed file system. There are two objectives:

1. to store billions of files!

2. to serve the files fast!

Instead of supporting full POSIX file system semantics, Weed-FS choose to implement only a key~file mapping. Similar to the word "NoSQL", you can call it as "NoFS".

Instead of managing all file metadata in a central master, Weed-FS choose to manages file volumes in the central master, and let storage nodes manage files and the metadata. This relieves concurrency pressure from the central master and spreads file metadata into storage nodes memories, allowing faster file access with just one disk read operation.

Weed-FS models after Facebook's Haystack design paper.

More details can be found on http://weed-fs.googlecode.com

Features

  • Distributed Key-to-File Storage
  • Data Center and Rack aware replication
  • O(1) Disk Access to serve a get file operation

Project Activity

See All Activity >

License

Apache License V2.0

Follow Weed-FS fast distributed key-file store

Weed-FS fast distributed key-file store Web Site

You Might Also Like
Achieve perfect load balancing with a flexible Open Source Load Balancer Icon
Achieve perfect load balancing with a flexible Open Source Load Balancer

Take advantage of Open Source Load Balancer to elevate your business security and IT infrastructure with a custom ADC Solution.

Boost application security and continuity with SKUDONET ADC, our Open Source Load Balancer, that maximizes IT infrastructure flexibility. Additionally, save up to $470 K per incident with AI and SKUDONET solutions, further enhancing your organization’s risk management and cost-efficiency strategies.
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Weed-FS fast distributed key-file store!

Additional Project Details

Operating Systems

Linux, BSD, Mac

Intended Audience

Developers, Architects

Registered

2011-12-30