Search Results for "system data"
Sort By:
Showing 77 open source projects for "system data"
View related business solutions-
AI-generated apps that pass security reviewRetool lets you generate dashboards, admin panels, and workflows directly on your data. Type something like “Build me a revenue dashboard on my Stripe data” and get a working app with security, permissions, and compliance built in from day one. Whether on our cloud or self-hosted, create the internal software your team needs without compromising enterprise standards or control.
-
Build AI Apps with Gemini 3 on Vertex AIVertex AI gives developers access to Gemini 3—Google’s most advanced reasoning and coding model—plus 200+ foundation models including Claude, Llama, and Gemma. Build generative AI apps with Vertex AI Studio, customize with fine-tuning, and deploy to production with enterprise-grade MLOps. New customers get $300 in free credits.
-
1
Zstandard
Zstandard - Fast real-time compression algorithm
Zstandard is a fast compression algorithm, providing high compression ratios. It also offers a special mode for small data, called dictionary compression. The reference library offers a very wide range of speed / compression trade-off, and is backed by an extremely fast decoder (see benchmarks below). Zstandard library is provided as open source software using a BSD license. Its format is stable and published as IETF RFC 8478. The negative compression levels, specified with --fast=#, offer... -
2
LZ4
Extremely fast compression algorithm
LZ4 is lossless compression algorithm, providing compression speed > 500 MB/s per core (>0.15 Bytes/cycle). It features an extremely fast decoder, with speed in multiple GB/s per core (~1 Byte/cycle). A high compression derivative, called LZ4_HC, is available, trading customizable CPU time for compression ratio. LZ4 library is provided as open-source software using a BSD license. This benchmark simulates simple "static content transfer" scenario such as OS Kernel compression or video game's... -
3
Brotli
Brotli compression format
Version 1.0.9 contains a fix to "integer overflow" problem. This happens when "one-shot" decoding API is used (or input chunk for streaming API is not limited), input size (chunk size) is larger than 2GiB, and input contains uncompressed blocks. After the overflow happens, memcpy is invoked with a gigantic num value, that will likely cause the crash. Brotli is a generic-purpose lossless compression algorithm that compresses data using a combination of a modern variant of the LZ77 algorithm,... -
4
Zippy
Pure Nim implementation of deflate, zlib, gzip and zip
Zippy is a pure Nim implementation of DEFLATE, ZLIB, GZIP, and ZIP data compression formats, aiming to be small, performant, and dependency-free. -
Deploy Apps in Seconds with Cloud RunCloud Run is the fastest way to deploy containerized apps. Push your code in Go, Python, Node.js, Java, or any language and Cloud Run builds and deploys it automatically. Get fast autoscaling, pay only when your code runs, and skip the infrastructure headaches. Two million requests free per month. And new customers get $300 in free credit.
-
5
Snappy
A fast compressor/decompressor
Snappy is a compression/decompression library. It does not aim for maximum compression, or compatibility with any other compression library; instead, it aims for very high speeds and reasonable compression. For instance, compared to the fastest mode of zlib, Snappy is an order of magnitude faster for most inputs, but the resulting compressed files are anywhere from 20% to 100% bigger. Snappy is intended to be fast. On a single core of a Core i7 processor in 64-bit mode, it compresses at... -
6
Areca Backup (fork)
Free open source multiplatform backup solution.
This independent development (fork) of Areca Backup attempts to extend its lifespan by fixing bugs and adding some new features while keeping its simplicity. Areca was originally developed by Olivier PETRUCCI (aventin): https://sourceforge.net/projects/areca/ -
7
Zip-Ada
A standalone, portable Ada library for .zip archives
Zip-Ada is a library for .zip archives. Full sources are in Ada and are unconditionally portable. Input and output can be any stream (file, buffer,...) for archive creation as well as data extraction. Task safe and endian-neutral. More information on: http://unzip-ada.sf.net Alire crate: https://alire.ada.dev/crates/zipada Mirror: https://github.com/zertovitch/zip-ada/ -
8
zpaqfranz
Zpaq compatible archiver for Win, Linux, Free/OpenBSD, Solaris & MacOS
...Optimized for cloud/NAS/USB with ultra-low bandwidth, military-grade encryption, and 1GB/s+ speeds on modern hardware. Why Choose zpaqfranz? ✓ Complete: Single/multi-file storage architecture ✓ Modern: SHA-2, SHA-3, BLAKE3, XXH3 and more ✓Paranoid: Antiransomware data verification with integrity checks ✓ Runs everywhere: TrueNAS, ARM-powered, even ESXi ✓ Lightning-fast: Multi-core processing + hardware acceleration ✓ Battle-tested: 15+ years of active development since 2009 Perfect for system administrators managing critical backups and anyone needing bulletproof archival solutions with enterprise-grade reliability. ... -
9
BWTC32Key
A file compressor with AES256CTR and Base32768 binary-to-text encoding
BWTC32Key is a program I wrote that compresses data, then optionally encrypts it, and then outputs a Base32768 representation as the final output -
Go from Data Warehouse to Data and AI platform with BigQueryBigQuery is more than a data warehouse—it's an autonomous data-to-AI platform. Use familiar SQL to train ML models, run time-series forecasts, and generate AI-powered insights with native Gemini integration. Built-in agents handle data engineering and data science workflows automatically. Get $300 in free credit, query 1 TB, and store 10 GB free monthly.
-
10
g3fc
A modern, fast, and secure file archiver with built-in data resilience
G3FC is a modern, high-performance open-source file archiver using Zstd compression. This project delivers a secure and resilient file container format engineered to replace legacy tools. G3FC excels with its technical features: blazing-fast Zstandard compression, strong AES-256-GCM authenticated encryption, and optional Forward Error Correction (FEC) to prevent data corruption. Its unique footer design allows for instant file indexing and searching, even in massive archives, eliminating the... -
11
The Compressor/Decompressor project is a versatile and efficient software solution designed to provide high-performance data compression and decompression capabilities. This project aims to empower users to reduce the size of their data while maintaining its integrity, as well as to efficiently restore compressed data to its original form when needed.
-
12
diffpak
A huge files block differential compressor
A differential compresor (or a binary diff) for huge files. Unlike other tools, e.g. xdelta3, it searches for matching data through the whole source file, even if it weights several gigabytes, while using much less memory (with default configuration approx 25x less than the size of the source file). Output files are not compressed, so you can use any compressor you like with great results. It is quite fast for very similar files (about the speed of hdd, however it reads input files twice)... -
13
clzw
Implementation of LZW compression algorithm in C
Simple, fast implementation of LZW (Lempel–Ziv–Welch) data compression algorithm in C. - Console encoder/decoder tools - OS independent - Could be used in embedded projects - Works with raw code-stream LZW features: - Hardcoded dictionary size - Variable code size - Code search is performed by hash table and embedded in dictionary linked lists (encoder) - No dynamic memory allocation -
14
lzhw
LZHW Windows command line lossless compression tool for tabular files
LZHW Command Line Lossless Compression Tool is a Windows command line tool used to compress and decompress files from and to any form, csv, excel etc without any dependencies or installations. Using an optimized algorithm (LZHW) developed from Lempel-Ziv, Huffman and LZ-Welch algorithms. The tool can work in parallel and most of its code is written in Cython, so it is pretty fast. It is based on python lzhw library. Full tool documentation can be found at:... -
15
BeoZip is a Java application that backs up data into ZIP files while also providing additional archiving utilities. This program uses the Java APIs for reading and writing ZIP files.
-
16
NoDoubles
Finds and removes duplicates (hard links)
NoDouble is a duplicate correction tool. It scans your drives for duplicate file. Unlike most tools, it replaces duplicates with hard links. A duplicate file is file with the same content, the same size, but not necessarily the same name or extension. When two duplicates or more are found, at least one of them is replaced with a hard link that points to the same data in the first file. Effectively, a hard link is a file, not a shortcut, and by removing the first file, the second file will... -
17
Zipios
Zipios is a C++ library for reading and writing 32bit Zip archives.
This project has moved to GitHub https://github.com/Zipios/Zipios Zipios is a C++ library for reading and writing Zip archive files. Access to the data of individual entries is provided through standard C++ iostreams. A simple read-only virtual file system that mounts regular directories and zip files is also provided. -
18
Slim is a data compression system for scientific data sets, a binary and a library with C linkage. Slim works with integer data from one or more channels in a file, which it can compress more effectively and more rapidly than general tools like gzip.
-
19
XJSTransform is a transformation and compression tool for XML, JSON and SMILES datasets. XML and JSON data transforms include tag, capital, character n-gram and word n-gram substituions. SMILES data transforms include a domain-specific data transform in addition to capital and character n-gram conversions. These transforms also include a variety of data transform variations. The transformed datasets are then compressed with general-purpose compressors (7Zip, BZip2, GZip, PPMd, PPMVC and...
-
20
FLAC is a free lossless compressed audio format which supports streaming and archival. The FLAC project maintains the format and provides a reference encoder/decoder and input plugins for several popular audio players.
-
21
gzzzzzz
makes a "big" gzip file
gzzzzzz enlarges a given file 6 times and writes it as a gzip file. It therefor can be "decompressed" (which makes it 6 times smaller) with the standard gzip. This shows that gzip (and deflate and any compression tool that uses one of them) but also, as I expect, any other compression format can be used to augment data significantly. -
22
TER implements the CCSDS Recommendation for Image Data Compression (CCSDS 122.0-B-1). TER also adds new features to the Recommendation. TER is designed and programmed with the aim to provide a good basis to test and develop the CCSDS Recommendation.
-
23
Dropbox Lepton
Lepton is a tool and file format for losslessly compressing JPEGs
...We have used Lepton to encode 16 billion images saved to Dropbox, and are rapidly recoding our older images. Lepton has already saved Dropbox multiple petabytes of space. At Dropbox, the security and durability of your data are our highest priorities. As an added security layer, Lepton runs within seccomp to disable all system calls except read and write of already-open file descriptors. Lepton has gone through a rigorous automated testing process. -
24
MicroZip
Create,extract and encrypt ZIP,GZIP,TAR,BZIP2,TAZ files on Java mobile
MicroZip is a powerful file compression and encryption utility for mobile phones which allows you to create and extract compressed archives in multiple formats and encrypt sensitive information with powerful AES-256 encryption. MicroZip can create and extract ZIP,TAR,TGZ,TBZ2 archives and extract many other formats as JAR,GZ,BZ2,TBZ,WAR,BZIP2,GZIP,Z,TAZ,CBZ etc. MicroZip allows you to extract selected files without extracting the whole ZIP archive. MicroZip also supports encrypted ZIP... -
25
LPC-Rice HDF5 filter
Multi-threaded HDF5 filter implementing the LPC-Rice codec
Multi-threaded HDF5 filter implementing the LPC-Rice codec. This lossless codec is intended to compress correlated signal data, such as image data, stored in HDF5 chunks. The codec/filter is optimized for both compression and decompression speed, but compression ratios are still comparable to JPEG-LS and CCSDS-123 codecs.
