Search Results for "data file"
Sort By:
Showing 64 open source projects for "data file"
View related business solutions-
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
1
Zstandard
Zstandard - Fast real-time compression algorithm
Zstandard is a fast compression algorithm, providing high compression ratios. It also offers a special mode for small data, called dictionary compression. The reference library offers a very wide range of speed / compression trade-off, and is backed by an extremely fast decoder (see benchmarks below). Zstandard library is provided as open source software using a BSD license. Its format is stable and published as IETF RFC 8478. The negative compression levels, specified with --fast=#, offer... -
2
Zippy
Pure Nim implementation of deflate, zlib, gzip and zip
Zippy is a pure Nim implementation of DEFLATE, ZLIB, GZIP, and ZIP data compression formats, aiming to be small, performant, and dependency-free. -
3
LZ4
Extremely fast compression algorithm
LZ4 is lossless compression algorithm, providing compression speed > 500 MB/s per core (>0.15 Bytes/cycle). It features an extremely fast decoder, with speed in multiple GB/s per core (~1 Byte/cycle). A high compression derivative, called LZ4_HC, is available, trading customizable CPU time for compression ratio. LZ4 library is provided as open-source software using a BSD license. This benchmark simulates simple "static content transfer" scenario such as OS Kernel compression or video game's... -
4
Brotli
Brotli compression format
Version 1.0.9 contains a fix to "integer overflow" problem. This happens when "one-shot" decoding API is used (or input chunk for streaming API is not limited), input size (chunk size) is larger than 2GiB, and input contains uncompressed blocks. After the overflow happens, memcpy is invoked with a gigantic num value, that will likely cause the crash. Brotli is a generic-purpose lossless compression algorithm that compresses data using a combination of a modern variant of the LZ77 algorithm,... -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
5
Snappy
A fast compressor/decompressor
Snappy is a compression/decompression library. It does not aim for maximum compression, or compatibility with any other compression library; instead, it aims for very high speeds and reasonable compression. For instance, compared to the fastest mode of zlib, Snappy is an order of magnitude faster for most inputs, but the resulting compressed files are anywhere from 20% to 100% bigger. Snappy is intended to be fast. On a single core of a Core i7 processor in 64-bit mode, it compresses at... -
6
Areca Backup (fork)
Free open source multiplatform backup solution.
This independent development (fork) of Areca Backup attempts to extend its lifespan by fixing bugs and adding some new features while keeping its simplicity. Areca was originally developed by Olivier PETRUCCI (aventin): https://sourceforge.net/projects/areca/ -
7
g3fc
A modern, fast, and secure file archiver with built-in data resilience
G3FC is a modern, high-performance open-source file archiver using Zstd compression. This project delivers a secure and resilient file container format engineered to replace legacy tools. G3FC excels with its technical features: blazing-fast Zstandard compression, strong AES-256-GCM authenticated encryption, and optional Forward Error Correction (FEC) to prevent data corruption. Its unique footer design allows for instant file indexing and searching, even in massive archives, eliminating the slow scans required by formats like TAR. ... -
8
BWTC32Key
A file compressor with AES256CTR and Base32768 binary-to-text encoding
BWTC32Key is a program I wrote that compresses data, then optionally encrypts it, and then outputs a Base32768 representation as the final output -
9
zpaqfranz
Zpaq compatible archiver for Win, Linux, Free/OpenBSD, Solaris & MacOS
...Get forever storage of your files, managing critical backups with bulletproof archival solutions and enterprise-grade reliability Far more efficient than Time Machine or ZFS snapshots-perfect for VM backups and permanent archiving, effortlessly handling TBs and millions of files Optimized for cloud/NAS/USB with ultra-low bandwidth, military-grade encryption, and 1GB/s+ speeds on modern hardware GUI (Win/Linux/Mac) https://sourceforge.net/projects/catpaq Why choose catpaq/zpaqfranz? ✓ Complete: single/multi-file storage architecture ✓ Modern: SHA-2, SHA-3, BLAKE3, XXH3 and more ✓ Paranoid: anti-ransomware data verification with integrity checks ✓ Runs everywhere: TrueNAS, ARM-powered, even ESXi ✓ Lightning-fast: multi-core processing + hardware acceleration ✓ Deduplicated disk imaging ✓ Battle-tested: 15+ years of active development since 2009 https://github.com/fcorbelli/zpaqfranz https://www.francocorbelli.it/zpaqfranz 100% FOSS • forever free -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
10
Zip-Ada
A standalone, portable Ada library for .zip archives
Zip-Ada is a library for .zip archives. Full sources are in Ada and are unconditionally portable. Input and output can be any stream (file, buffer,...) for archive creation as well as data extraction. Task safe and endian-neutral. More information on: http://unzip-ada.sf.net Alire crate: https://alire.ada.dev/crates/zipada Mirror: https://github.com/zertovitch/zip-ada/ -
11
The Compressor/Decompressor project is a versatile and efficient software solution designed to provide high-performance data compression and decompression capabilities. This project aims to empower users to reduce the size of their data while maintaining its integrity, as well as to efficiently restore compressed data to its original form when needed.
-
12
clzw
Implementation of LZW compression algorithm in C
Simple, fast implementation of LZW (Lempel–Ziv–Welch) data compression algorithm in C. - Console encoder/decoder tools - OS independent - Could be used in embedded projects - Works with raw code-stream LZW features: - Hardcoded dictionary size - Variable code size - Code search is performed by hash table and embedded in dictionary linked lists (encoder) - No dynamic memory allocation -
13
lzhw
LZHW Windows command line lossless compression tool for tabular files
LZHW Command Line Lossless Compression Tool is a Windows command line tool used to compress and decompress files from and to any form, csv, excel etc without any dependencies or installations. Using an optimized algorithm (LZHW) developed from Lempel-Ziv, Huffman and LZ-Welch algorithms. The tool can work in parallel and most of its code is written in Cython, so it is pretty fast. It is based on python lzhw library. Full tool documentation can be found at:... -
14
BeoZip is a Java application that backs up data into ZIP files while also providing additional archiving utilities. This program uses the Java APIs for reading and writing ZIP files.
-
15
NoDoubles
Finds and removes duplicates (hard links)
NoDouble is a duplicate correction tool. It scans your drives for duplicate file. Unlike most tools, it replaces duplicates with hard links. A duplicate file is file with the same content, the same size, but not necessarily the same name or extension. When two duplicates or more are found, at least one of them is replaced with a hard link that points to the same data in the first file. Effectively, a hard link is a file, not a shortcut, and by removing the first file, the second file will still be present with all of its data. ... -
16
Zipios
Zipios is a C++ library for reading and writing 32bit Zip archives.
This project has moved to GitHub https://github.com/Zipios/Zipios Zipios is a C++ library for reading and writing Zip archive files. Access to the data of individual entries is provided through standard C++ iostreams. A simple read-only virtual file system that mounts regular directories and zip files is also provided. -
17
XJSTransform is a transformation and compression tool for XML, JSON and SMILES datasets. XML and JSON data transforms include tag, capital, character n-gram and word n-gram substituions. SMILES data transforms include a domain-specific data transform in addition to capital and character n-gram conversions. These transforms also include a variety of data transform variations. The transformed datasets are then compressed with general-purpose compressors (7Zip, BZip2, GZip, PPMd, PPMVC and...
-
18
FLAC is a free lossless compressed audio format which supports streaming and archival. The FLAC project maintains the format and provides a reference encoder/decoder and input plugins for several popular audio players.
-
19
TER implements the CCSDS Recommendation for Image Data Compression (CCSDS 122.0-B-1). TER also adds new features to the Recommendation. TER is designed and programmed with the aim to provide a good basis to test and develop the CCSDS Recommendation.
-
20
Dropbox Lepton
Lepton is a tool and file format for losslessly compressing JPEGs
...At Dropbox, the security and durability of your data are our highest priorities. As an added security layer, Lepton runs within seccomp to disable all system calls except read and write of already-open file descriptors. Lepton has gone through a rigorous automated testing process. -
21
MicroZip
Create,extract and encrypt ZIP,GZIP,TAR,BZIP2,TAZ files on Java mobile
MicroZip is a powerful file compression and encryption utility for mobile phones which allows you to create and extract compressed archives in multiple formats and encrypt sensitive information with powerful AES-256 encryption. MicroZip can create and extract ZIP,TAR,TGZ,TBZ2 archives and extract many other formats as JAR,GZ,BZ2,TBZ,WAR,BZIP2,GZIP,Z,TAZ,CBZ etc. MicroZip allows you to extract selected files without extracting the whole ZIP archive. MicroZip also supports encrypted ZIP... -
22
Lossless compressor for multichannel 8,16 and 24 bits audio data, with the ability of password data protection. Being 'lossless' means that no data/quality is lost in the compression - when uncompressed, the data will be identical to the original.
-
23
This project has been moved to https://github.com/inikep/XWRT XWRT (XML-WRT) is a high-performance XML compressor (it also works with textual files). It transforms XML to more compressible form and uses zlib (default), LZMA, PPMd, or lpaq6 as back-end compressor. It is similar to XMill, but has many improvements.
-
24
font-spider
Smart webfont compression and format conversion tool
Font-spider is a compress tool for WebFont which can analyze your web-page intelligently to find the fonts out which have been used and then compress them. Font subsetter, our tool is based on HTML and CSS analysis and completely running in local so that. Font converter supports woff2, woff, eot, svg font format generation. -
25
Areca-Backup is a file backup software that supports incremental, image and delta backup on local drives or FTP servers. Areca-Backup also allows you to browse your backups and navigate among different version of the files contained in your archives.
