Search Results for "file compression"
Sort By:
Showing 469 open source projects for "file compression"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
1
compression
Node.js compression middleware
compression is a Node.js middleware for Express applications that enables HTTP response compression, improving the performance of web applications by reducing the size of the response body. -
2
Zstandard
Zstandard - Fast real-time compression algorithm
Zstandard is a fast compression algorithm, providing high compression ratios. It also offers a special mode for small data, called dictionary compression. The reference library offers a very wide range of speed / compression trade-off, and is backed by an extremely fast decoder (see benchmarks below). Zstandard library is provided as open source software using a BSD license. Its format is stable and published as IETF RFC 8478. The negative compression levels, specified with --fast=#, offer... -
3
DwarFS
A fast high compression read-only file system for Linux, Windows
The Deduplicating Warp-speed Advanced Read-only File System. A fast high compression read-only file system for Linux and Windows. DwarFS is a read-only file system with a focus on achieving very high compression ratios in particular for very redundant data. This probably doesn't sound very exciting, because if it's redundant, it should compress well. However, I found that other read-only, compressed file systems don't do a very good job at making use of this redundancy. ... -
4
Brotli
Brotli compression format
Version 1.0.9 contains a fix to "integer overflow" problem. This happens when "one-shot" decoding API is used (or input chunk for streaming API is not limited), input size (chunk size) is larger than 2GiB, and input contains uncompressed blocks. After the overflow happens, memcpy is invoked with a gigantic num value, that will likely cause the crash. Brotli is a generic-purpose lossless compression algorithm that compresses data using a combination of a modern variant of the LZ77 algorithm,... -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
5
Zippy
Pure Nim implementation of deflate, zlib, gzip and zip
Zippy is a pure Nim implementation of DEFLATE, ZLIB, GZIP, and ZIP data compression formats, aiming to be small, performant, and dependency-free. -
6
Compressor.js
JavaScript image compressor
Compressor.js is a lightweight JavaScript library for in-browser image compression that allows developers to reduce file sizes before uploading images to a server, improving performance and user experience. It works by taking an input image (such as from a file input) and resizing or reencoding it on the client side according to developer-specified options like maximum width, height, quality, and MIME type. -
7
Borg
Deduplicating archiver with compression and encryption
BorgBackup or Borg for short is a deduplicating backup program that also supports compression and authenticated encryption. It provides a secure and efficient way to backup data, and is ideal for daily backups and backups to not fully tested targets. -
8
Snappy
A fast compressor/decompressor
Snappy is a compression/decompression library. It does not aim for maximum compression, or compatibility with any other compression library; instead, it aims for very high speeds and reasonable compression. For instance, compared to the fastest mode of zlib, Snappy is an order of magnitude faster for most inputs, but the resulting compressed files are anywhere from 20% to 100% bigger. Snappy is intended to be fast. On a single core of a Core i7 processor in 64-bit mode, it compresses at... -
9
Node Archiver
a streaming interface for archive generation
Archiver is a Node.js library that provides a streaming interface for creating archive files in various formats, such as ZIP and TAR, supporting multiple compression methods. -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
10
UglifyJS 3
JavaScript parser, mangler, compressor, beautifier toolkit
UglifyJS is a JavaScript compressor/minifier written in JavaScript. It also contains tools that allow one to automate working with JavaScript code. A parser which produces an abstract syntax tree (AST) from JavaScript code. A code generator which outputs JavaScript code from an AST, also providing the option to get a source map. A compressor (optimizer). it uses the transformer API to optimize an AST into a smaller one. A mangler, reduce names of local variables to (usually) single-letters.... -
11
CompressO
Convert any video/image into a tiny size. 100% free & open-source
compressO is a cross-platform, open-source multimedia compression application designed to reduce the size of videos and images while preserving visual quality. Built using modern frameworks such as Rust and Tauri, it runs locally on the user’s machine, ensuring fast performance and complete privacy without requiring cloud processing. The application supports a variety of media formats and provides controls for adjusting compression levels, resolution, and output quality. In addition to... -
12
SSZipArchive
ZipArchive is a simple utility class for zipping and unzipping files
ZipArchive is a popular Objective-C and Swift library for handling ZIP file compression and extraction in iOS and macOS applications. It provides a simple API to create, extract, and manage compressed files. -
13
asar
Simple extensive tar-like archive format with indexing
Asar is a simple extensive archive format, it works like tar that concatenates all files together without compression while having random access support. You can pass in a transform option, which is a function, that either returns nothing or a stream. Transform. The latter will be used on files that will be in the .asar file to transform them. There is also an unofficial grunt plugin to generate asar archives at bwin/grunt-asar. Asar uses Pickle to safely serialize binary value to file, there is also a node.js binding of Pickle class. ... -
14
HDF5
Official HDF5® Library Repository
HDF5 (Hierarchical Data Format v5) is a widely-used data management library and file format for storing large and complex scientific data sets efficiently. -
15
smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
smart_open is a Python library for streaming very large files from local or remote storage through a familiar file-like interface. It acts as an extended replacement for Python's built-in open function. Supported backends include Amazon S3, Google Cloud Storage, Azure Blob Storage, HDFS, WebHDFS, HTTP, HTTPS, SFTP, and local filesystems. Data can be read or written without first downloading an entire remote object to disk. Transparent compression and decompression are supported for multiple common formats. ... -
16
Caesium Image Compressor
Store, send and share digital pictures, supporting JPG, PNG, WebP
Caesium is an image compression software that helps you store, send, and share digital pictures, supporting JPG, PNG, WebP, and TIFF formats. You can quickly reduce the file size (and resolution, if you want) by preserving the overall quality of the image. -
17
Reliable PostgreSQL Backup & Restore
Reliable PostgreSQL backup and restore
pgBackRest aims to be a reliable, easy-to-use backup and restore solution that can seamlessly scale up to the largest databases and workloads by utilizing algorithms that are optimized for database-specific requirements. Compression is usually the bottleneck during backup operations but, even with now-ubiquitous multi-core servers, most database backup solutions are still single-process. pgBackRest solves the compression bottleneck with parallel processing. Utilizing multiple cores for... -
18
Vortex
The LLVM of columnar file formats
Vortex is a high-performance toolkit designed for working with compressed Apache Arrow arrays, providing functionality for in-memory, on-disk, and over-the-wire data handling. It aims to be an advanced successor to Apache Parquet, offering dramatically faster random access reads and scans, while maintaining similar compression ratios. Vortex's modular design allows for extensibility, enabling developers to implement custom encodings for efficient data management, particularly for large-scale... -
19
gallery-dl
Command-line program to download image galleries and collections
gallery-dl is a powerful command-line tool designed to download image galleries and collections from a wide range of image hosting and media websites. Built with Python, it works across multiple operating systems including Windows, Linux, and macOS. The program allows users to download images, manga chapters, or media collections by simply providing a supported website URL. It includes extensive configuration options that allow users to control download behavior, file naming, and directory... -
20
PyInstaller
Freeze (package) Python programs into stand-alone executables
PyInstaller freezes (packages) Python applications into stand-alone executables, under Windows, GNU/Linux, Mac OS X, FreeBSD, Solaris and AIX. PyInstaller’s main advantages over similar tools are that PyInstaller works with Python 3.5 to 3.9, it builds smaller executables thanks to transparent compression, it is fully multi-platform, and use the OS support to load the dynamic libraries, thus ensuring full compatibility. The main goal of PyInstaller is to be compatible with 3rd-party packages... -
21
libavif
Library for encoding and decoding .avif files
...Recent developments have added experimental support for HDR gain maps, improved color-space handling (including wide color gamut and high bit depth), and better quality tuning modes for encoding, making libavif a cutting-edge tool for high-quality image compression. -
22
Dinky
Dinky makes files smaller
Dinky is a lightweight developer tool designed to simplify interactions with large language models by providing a streamlined interface for prompt execution and experimentation. It focuses on usability, offering a minimal environment where developers can quickly test prompts, iterate on outputs, and refine workflows without complex setup. The project is built with simplicity in mind, making it easy to integrate into existing development processes or use as a standalone experimentation tool.... -
23
IOWOW
A C utility library and persistent key/value storage engine
IOWOW is a lightweight, high-performance key-value store and data storage library written in C, designed for use in embedded systems and high-speed applications that require efficient file-based storage. -
24
JDF.jl
Julia DataFrames serialization format
JDF is a DataFrames serialization format with the following goals, fast save and load times, compressed storage on disk, enabled disk-based data manipulation (not yet achieved), and support for machine learning workloads, e.g. mini-batch, sampling (not yet achieved). JDF stores a DataFrame in a folder with each column stored as a separate file. There is also a metadata.jls file that stores metadata about the original DataFrame. Collectively, the column files, the metadata file, and the folder is called a JDF "file". JDF.jl is a pure-Julia solution and there are a lot of ways to do nifty things like compression and encapsulating the underlying struture of the arrays that's hard to do in R and Python. ... -
25
Gulp Imagemin
Minify PNG, JPEG, GIF and SVG images
A Gulp plugin that optimizes images by reducing file sizes without losing quality, improving web performance and reducing bandwidth usage.