Search Results for "performance"

...The tool is particularly valuable in data-intensive workflows such as machine learning, where large datasets can be accessed on demand without requiring full local downloads. It supports performance optimizations like file caching, which stores frequently accessed data on local storage to significantly improve throughput and reduce latency. The system integrates with cloud-native environments such as Kubernetes and can be used in distributed architectures where multiple compute nodes access shared datasets.

...Many systems provide pre-built packages. s3fs supports the standard AWS credentials file stored in the credentials folder. Alternatively, s3fs supports a custom passwd file. The default location for the s3fs password file can be created. Generally S3 cannot offer the same performance or semantics as a local file system.

BackupPC is a high-performance, enterprise-grade backup system for backing up Linux, WinXX PCs, Macs and laptops to a server's disk. Features include clever pooling of identical files, no client-side software, and a powerful Apache/CGI user interface.

...Download pages, repositories, tickets and wiki have been moved to https://github.com/oss-tsukuba/ Download: gfarm: https://github.com/oss-tsukuba/gfarm/releases gfarm2fs: https://github.com/oss-tsukuba/gfarm2fs/releases and more: https://github.com/oss-tsukuba/gfarm/wiki#download Repositories: gfarm: https://github.com/oss-tsukuba/gfarm gfarm2fs: https://github.com/oss-tsukuba/gfarm2fs and more: https://github.com/orgs/oss-tsukuba/repositories Tickets: gfarm: https://github.com/oss-tsukuba/gfarm/issues gfarm2fs: https://github.com/oss-tsukuba/gfarm2fs/issues Wiki: https://github.com/oss-tsukuba/gfarm/wiki Gfarm file system is a network shared file system that supports scalable I/O performance in distributed environment. It can federate local disks of network-connected PCs and compute nodes in several clusters.

Mutil is a set of standard utilities that have been parallelized to maximize performance on modern file systems. These currently include multi-threaded drop-in replacements for cp and md5sum from GNU coreutils, which have achieved 10/30x rates on one/many nodes.

FastDFS is an open source high performance DFS ( distributed file system ). It's major functions include: file storing, file syncing and file accessing, and design for high capacity and load balancing.

Persistent and Protected RAM-based Special Filesystem (PRAMFS) for Linux

Java bindings for FUSE (http://fuse.sourceforge.net). Allows filesystems to be written in a combination of C and Java utilizing the FUSE library, aiming to provide maximum flexibility, ease of use and performance.

The Flexible Filesystem Benchmark (FFSB) is a cross-platform filesystem performance measurement tool. It uses customizable profiles to measure of different workloads, and it supports multiple groups of threads across multiple filesystems.

This project is the Fast File System. This is a mountable file system that will use a fragment of your RAM and/or Swap as a mountable device. All the files has a great performance for read/write, but all what is written will be lost at umount or reboot

Love-Sources is a Linux kernel patchset maintained by a community. Its purpose is to provide a patchset to optimize desktop performance and test new "unstable" features.

Thug - Secure Network File System. Thug is network file system that is based in the Linux Kernel but can be ported to other platforms as well. It strives for security, stability and performance.

Idas (I Don't Accept Seconds) is a high-performance duplicate file detector. Idas plugs into your favorite Unix filter and can tell you exactly which files have been seen before, regardless of whether or not it appears with the same filename.

XFS is a high-performance journalling filesystem developed by SGI and used in SGI's IRIX operating system, now available for Linux. The majority of information about this project, including mailing lists and docs, can be found on the project home page.

The Vinum Volume Manager is a device driver which implements virtual disk drives. It isolates disk hardware from the block device interface and maps data in ways which result in an increase in flexibility, performance and reliability.

CPSM is a CORBA based performance and system management framework. It is based on the MICO CORBA ORB.

A Java based high performance CIFS Proxy Server that provides handlers for each type of CIFS packets to the user. In essence it provides a generic CIFS/SMB packet sniffing, logging and handling ability by providing simple Java APIs to the users.