BackupPC is a high-performance, enterprise-grade backup system for backing up Linux, WinXX PCs, Macs and laptops to a server's disk. Features include clever pooling of identical files, no client-side software, and a powerful Apache/CGI user interface.
FATSort sorts directory structures of FAT file systems
FATSort is a small utilitiy for Linux that sorts directory structures of FAT12, FAT16 and FAT32 file systems. It is written in C and can be run from the command line.
The Sleuth Kit is a C++ library and collection of open source file system forensics tools that allow you to, among other things, view allocated and deleted data from NTFS, FAT, FFS, EXT2, Ext3, HFS+, and ISO9660 images.
AVFS is a system, which enables all programs to look inside gzip, tar, zip, etc. files or view remote (ftp, http, dav, etc.) files, without recompiling the programs.
Sort files and pack them into partitions
Fpart is a tool that helps you sort file trees and pack them into bags (called "partitions"). It is developped in C and available under the BSD license. It splits a list of directories and file trees into a certain number of partitions, trying to produce partitions with the same size and number of files. It can also produce partitions with a given number of files or a limited size. Once generated, partitions are either printed as file lists to stdout (default) or to files. Those lists can then be used by third party programs. Fpart also includes a live mode, which allows it to crawl very large filesystems and produce partitions in live. Hooks are available to act on those partitions (e.g. immediatly start a transfer using rsync(1)) without having to wait for the filesystem traversal job to be finished. Used this way, fpart can be seen as a powerful data migration tool.
Fault tolerant, POSIX-compliant, network distributed filesystem
MooseFS (MFS) is a fault tolerant, highly performing, scaling-out, network distributed file system. It spreads data over several physical servers which are visible to the user as one resource. For standard file operations MooseFS mounted with FUSE acts as other Unix-alike file systems: * A hierarchical structure (directory tree) * Stores POSIX file attributes (permissions, last access and modification times) Supports special files (block and character devices, pipes and sockets) * Symbolic links (file names pointing to target files, not necessarily on MooseFS) and hard links (different names of files which refer to the same data on MooseFS) * Access to the file system can be limited based on IP address and/or password MooseFS on GitHub: https://github.com/moosefs/moosefs Source code, packages repo: https://moosefs.com/download.html Documentation: https://moosefs.com/documentation.html Recent changes: https://moosefs.com/documentation/changes-in-moosefs-3-0.html
Gfarm file system is a network shared file system that supports scalable I/O performance in distributed environment. It can federate local disks of network-connected PCs and compute nodes in several clusters.
mac-robber is a digital forensics and incident response tool that can be used with The Sleuth Kit to create a timeline of file activity for mounted file systems.
Python FAM provides a Python module to use the File Alteration Monitor (http://oss.sgi.com/projects/fam) in Python.
A library and commands for cyclic logfiles. A cyclic log has a fixed size upon creation and pointers that refer to the start and end positions within that fixed size.They are useful for recording server output without losing the most recent data.
Idas (I Don't Accept Seconds) is a high-performance duplicate file detector. Idas plugs into your favorite Unix filter and can tell you exactly which files have been seen before, regardless of whether or not it appears with the same filename.
Its a Java application that can copy/cut a list of source locations to a list of destinations. It can also transfer files over the internet peer2peer. WARNING: Requires Java 7 installed.
The NTFS-3G driver is a safe read/write NTFS driver for Linux, Mac OS X, OpenSolaris, FreeBSD, NetBSD, QNX, Windows and Haiku, providing fast and POSIX handling of the Windows XP, Windows Server 2003, Windows 2000, Windows Vista and Windows 7 file system
Nanotools is a set of Unix style tools and libraries used for helping system's administrators to manage several servers with several operating systems (IBM/Aix, SUN/OS, GNU/Linux). Nanotools is oriented for running in a production environement.
Place filesystems into userland for greater flexibility.
Datamap is a multiplatform disk space and data growth monitoring tool
Datamap is a multiplatform disk space and data growth monitoring tool. Datamap helps manage disk storage on local servers or on the enterprise network. Some of the features included in Datamap: Multiplatform, clients available for Windows, Linux, Solaris and Unix.. Centralized access to all information. Centralized configuration of all nodes. Centralized view of disk usage, current and history views. Centralized view of data growth. Centralized view of data hogging users or applications. Easy identification of "huge files" throughout the network. Flexible grouping of clients and directories. Command line intefrace. Flexible reporting system. Reports can be viewed via a web browser or exported to Excel. Automatic disk space usage and data growth monitoring on client,partitions and filesystems. Disk growth limit monitoring and alert - Never run out of disk space again! Email notifications of alerts. Run custom scripts in response to defined events.