Search Results for "large files"

ZipArchive is a popular Objective-C and Swift library for handling ZIP file compression and extraction in iOS and macOS applications. It provides a simple API to create, extract, and manage compressed files.

...It is developped in C and available under the BSD license. It splits a list of directories and file trees into a certain number of partitions, trying to produce partitions with the same size and number of files. It can also produce partitions with a given number of files or a limited size. Once generated, partitions are either printed as file lists to stdout (default) or to files. Those lists can then be used by third party programs. Fpart also includes a live mode, which allows it to crawl very large filesystems and produce partitions in live. ...

Win32 and Win64 DLL to compress files in the standard Gzip format and also the new Gzip2, this format can compress files as large as 9.223.372.036 gigabytes and has also MD5 the integrity check, now also SHA512 too, now with support to multi-threads

...It supports any POSIX filesystem and implements advanced features for Lustre filesystems (list/purge files per OST or pool, read MDT changelogs...)

Retools is a set of modifications to the commonly used open source utilities bzip2, gzip, rsync, and tar that automatically selects the Lustre stripe count for created and/or extracted files according to the sizes of the files involved. By striping large files over a higher number of physical disks and small files over a lower number, aggregate I/O bandwidth for large files is maximized and the impact to the file system due to small files is minimized.

Simple, lightweight, cross-platform (Windows / Linux / ARM6 Linux), cross-arch (x32 / x64), standalone command line file encryption program. GnuPG is probably the best application for cross-platform encryption. However, its usage on Windows PCs may be inconvenient (installation administrator rights; large executable size for perhaps just a one-time file decryption, complicated command-line switches for stronger encryption). NCrypt would fulfill this task, but does not operate on 64-bit...

LANL-Purger is a purging system intended for use on larger parallel filesystems in which notifications or advanced queries are required before file deletion. The parallel code requires MPI and database storage uses a PostgresSQL server.

Finddupe is a VERY FAST command line C program to catalog very large archives, identifying duplicate files even when offline. It has many features. You can easily grep a catalog to find what you have, and locate where it is.

Destral is an open source, multiplatform implementation of the Hacha 3.0, Hacha 3.5 and HJSplit split and join algorithms. These utilities are widely used in forums and news to distribute one large file as many smaller files. A Qt GUI is also planned

Simple command-line file splitter. Split a (binary) file into a given number of slices, or slices of a given size. Output files are automatically numbered, and can be concatenated ("copy", "cat") to recover the original file. Large files supported.

Lossless compression program with various algorithms included. Intended for large XML files, but can compress any files. Best results with block compression (BWT+MTF+RLE) on large block over alphabet of words.

Alexandria is an archive system for large data amounts. Suitable for inhomogenous collections of books, media files, art items and other artifacts. Main focus is on easy usage, small executable file and portability.

fbreak is a console application that allows you to break a large file into multiple smaller files (ie, for distribution on floppy disks).

parchive2 provides PAR 2.0 libraries and tools for creating parity files and recovering data using them. The key advance of PAR 2.0 is that you do not need to break a large file into smaller files before making parity files. See the parchive project for