Search Results for "data science"

MooseFS (MFS) is a fault tolerant, highly performing, scaling-out, network distributed file system. It spreads data over several physical servers which are visible to the user as one resource. For standard file operations MooseFS mounted with FUSE acts as other Unix-alike file systems: * A hierarchical structure (directory tree) * Stores POSIX file attributes (permissions, last access and modification times) Supports special files (block and character devices, pipes and sockets) *...

diskover is a file system crawler and disk space usage software that uses Elasticsearch to index your file metadata. diskover crawls and indexes your files on a local computer or remote storage server over network mounts. diskover helps manage your storage by identifying old and unused files and give better insights into data change "hotfiles", file duplication "dupes" and wasted space. It is designed to help deal with managing large amounts of data growth and provide detailed storage...

This modification of the ext2 kernel module allows to create files (cover files) whose block arrangement gets manipulated to represent a binary code, which can be extracted later. The information hiding approach used in this project was introduced by Khan et. al in 'Designing a cluster-based covert channel to evade disk investigation and forensics' (1st approach). Algorithm: When a cover file is written, an even blocknr. (for the 1st datablock) is choosen to represent a 0 or an odd...

Storage Bat - Efficient Data Archiver --------------------------------------------------- Storage Bat is designed to run primarily on x86 Linux. It optimizes storage by removing duplicate blocks across files. The current use cases would be storage and archival for desktop users with a potential to scale.

The program `sql2textfs` is a custom file system based on FUSE that lets the user mount a database and view all its tables as files of a directory of the filesystem in a POSIX system. The databased tables are viewed as files but in a specific format: All table entries are converted into lines in a file of text. Columns are separated by tab, so all the data of the table is in a tab-delimited text file. The file format is a form of CSV format. The table header is in the first line of the file....

Dadisi is an API to create and test data distribution policies in a (simulated) storage environment. With it you can create a virtual storage architecture and fill it with "data" that will be placed according to your description.

This project has moved to github: https://github.com/DNPA/libcarvpath https://github.com/DNPA/carvfs For use in automated forensic data processing you may also consider using MattockFS instead: https://github.com/pibara/MattockFS

Online Hierarchical Storage Manager (OHSM) is the first attempt towards an enterprise level open source data storage manager which automatically moves data between high-cost and low-cost storage media.

This project is about using a SD-card together with an ATMEL ATmega32 microcontroller as mass storage medium. It implements the interface to the SD-card, a simplified FAT16 filesystem and a sample application: a data logger.

This project provides an abstraction layer for archives. This project emerged from route64, and will provide a standalone archive manipulation tool for Eclipse. At first we focus on the folowing archives: zip, war, jar, ear, t64, d64, rar, tar.

KFDI bridges file systems and databases over the Linux VFS layer. Taking advantage of relational database technology and XML, data can be managed and searched based on properties. KFDI also introduces some object-oriented concepts into file organization.

JEPLA - Java Easy Persistent Layer. Provides an easy way to persist objects using persistent collections. The basic idea is provide a way to write programs that use persistent data without break OO concept like RDBMS and without complexity of an OODBMS.

Replacehex is a command line search and replace utility that works with hex codes strings. It can operate on both binary and text files efficiently. A great tool to work on binary data files. First developed to replace mac addresses inside a pcap capture

The PierreFS file system is an effort to create an union file system with low data redundancy to allow easy centralized administration.