Search Results for "large files"

...It is developped in C and available under the BSD license. It splits a list of directories and file trees into a certain number of partitions, trying to produce partitions with the same size and number of files. It can also produce partitions with a given number of files or a limited size. Once generated, partitions are either printed as file lists to stdout (default) or to files. Those lists can then be used by third party programs. Fpart also includes a live mode, which allows it to crawl very large filesystems and produce partitions in live. ...

...It supports any POSIX filesystem and implements advanced features for Lustre filesystems (list/purge files per OST or pool, read MDT changelogs...)

cryptmount allows management and user-mode mounting of encrypted filing systems on GNU/Linux systems. Filesystems & crypto-swap can be on either raw block devices or ordinary files, with device-mapper (dm-crypt) and loopback devices setup automatically.

Retools is a set of modifications to the commonly used open source utilities bzip2, gzip, rsync, and tar that automatically selects the Lustre stripe count for created and/or extracted files according to the sizes of the files involved. By striping large files over a higher number of physical disks and small files over a lower number, aggregate I/O bandwidth for large files is maximized and the impact to the file system due to small files is minimized.

Filesystems can avoid fragmentation if they know how large files will be. This library provides a wrapper for the fallocate() syscall (like glibc-2.10+), but also knows the xfs/ocfs2 ioctl and provides fallbacks better than posix_fallocate().

virtual800 is a FUSE based filesystem. It provides a big filesystem with big files for testing of large file transfers.

The Abstract Large File (ALF) project is a portable library for writing files that can be larger than 2GB or contain holes on systems that don't natively support one or both properties.