Search Results for "stores"

...The tool is particularly valuable in data-intensive workflows such as machine learning, where large datasets can be accessed on demand without requiring full local downloads. It supports performance optimizations like file caching, which stores frequently accessed data on local storage to significantly improve throughput and reduce latency. The system integrates with cloud-native environments such as Kubernetes and can be used in distributed architectures where multiple compute nodes access shared datasets.

...Large subset of POSIX including reading/writing files, directories, symlinks, mode, uid/gid, and extended attributes. Compatible with Amazon S3, and other S3-based object stores. Allows random writes and appends, large files via multi-part upload, and renames via server-side copy. User-specified regions, including Amazon GovCloud. Many systems provide pre-built packages. s3fs supports the standard AWS credentials file stored in the credentials folder. Alternatively, s3fs supports a custom passwd file. The default location for the s3fs password file can be created. ...

...It spreads data over several physical servers which are visible to the user as one resource. For standard file operations MooseFS mounted with FUSE acts as other Unix-alike file systems: * A hierarchical structure (directory tree) * Stores POSIX file attributes (permissions, last access and modification times) Supports special files (block and character devices, pipes and sockets) * Symbolic links (file names pointing to target files, not necessarily on MooseFS) and hard links (different names of files which refer to the same data on MooseFS) * Access to the file system can be limited based on IP address and/or password MooseFS on GitHub: https://github.com/moosefs/moosefs Packages repository, download: https://moosefs.com/download Documentation: https://moosefs.com/support Recent changes: https://github.com/moosefs/moosefs/blob/master/NEWS

SNSDB is a simple NSDB, as described in IETF draft draft-ietf-nfsv4-federated-fs-protocol. An NSDB is a namespace database service that stores information about the location and properties of filesets and answers queries about those filesets.

MySQLfs is Linux userspace filesystem which stores data in a MySQL database. It uses FUSE to interface with the kernel.

This program lists all files and folders inside given path and stores in HTML file. Generated HTML uses external java-script and CSS to render it as treeview. Background threading ensures stability while XML gives flexibility to this program.

File dupe-check and semi-automatic pruning. Stores hashes between runs so you needn't rehash every file every time you run the script. Good for large, static file collections.

FSFS is a secure distributed file system in user space built over FUSE and OpenSSL. It stores AND transfers data between clients and server in secure form, leaving most of the cryptography to the clients, thus relieving the server of the additional work.

This software is a distributed replicated blob server (inspired by the google file system paper http://www.cs.rochester.edu/sosp2003/papers/p125-ghemawat.pdf ). It stores your blobs ( <=> files) on a given number of your servers.