Search Results for "compression" - Page 5
Sort By:
Showing 711 open source projects for "compression"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
1
DOLMA
Data and tools for generating and inspecting OLMo pre-training data
DOLMA (Data Optimization and Learning for Model Alignment) is a framework designed to manage large-scale datasets for training and fine-tuning language models efficiently. -
2
SparseML
Libraries for applying sparsification recipes to neural networks
SparseML is an optimization toolkit for training and deploying deep learning models using sparsification techniques like pruning and quantization to improve efficiency. -
3
GreptimeDB
An open-source, cloud-native, unified time series database for metrics
GreptimeDB treats all time series as contextual events with timestamps, and thus unifies the processing of metrics, logs, and events. It supports analyzing metrics, logs, and events with SQL, PromQL, and streaming with continuous aggregation. GreptimeDB is a time-series database optimized for storing and querying large amounts of time-series data, commonly used in monitoring and IoT applications. -
4
Colibrì
Run frontier MoE models on hardware you already own
...A consistent command-line interface, OpenAI-compatible API, web dashboard, and desktop application support multiple model families, including GLM, DeepSeek, Kimi, Qwen, Inkling, and OLMoE. Colibrì also serves as an open research platform for testing model placement, caching, compression, speculative decoding, storage I/O, & more. -
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
5
Av1an
Cross-platform command-line AV1 / VP9 / HEVC / H264 encoding framework
...The tool is optimized for high-quality encoding while reducing total processing time through multi-core and multi-machine support. It includes scene detection and chunking strategies to improve compression efficiency and visual consistency across segments. Av1an also supports advanced encoding options, allowing users to fine-tune bitrate, quality, and performance settings. It integrates with VapourSynth for preprocessing and filtering, enabling more control over input video quality. Overall, it is widely used by enthusiasts and professionals seeking efficient AV1 encoding workflows. -
6
Drogon
Drogon: A C++14/17/20 based HTTP web application framework
Drogon is a C++14/17-based HTTP application framework. Drogon can be used to easily build various types of web application server programs using C++. Drogon is the name of a dragon in the American TV series "Game of Thrones" that I really like. Drogon is a cross-platform framework, It supports Linux, macOS, FreeBSD, OpenBSD, HaikuOS, and Windows. Use a non-blocking I/O network lib based on epoll (kqueue under macOS/FreeBSD) to provide high-concurrency, high-performance network IO, please... -
7
Axum
Ergonomic and modular web framework built with Tokio, Tower
Axum is a modern, ergonomic web framework for Rust built on top of Tokio, Hyper, and Tower. It emphasizes modularity, minimal boilerplate, and seamless middleware composition via Tower services. It uses declarative extractors for routing, strong async/await support, and integrates well with the Tokio async ecosystem. -
8
django-dbbackup
Management commands to help backup and restore your project database
django-dbbackup is a Django management command extension for backing up and restoring databases and media files. It supports multiple storage backends including local file systems, Amazon S3, and Dropbox. Ideal for automated backup strategies, it simplifies the integration of backup logic into Django projects. -
9
PGHoard
PostgreSQL® backup and restore service
pghoard is a PostgreSQL backup and restore tool that provides encrypted, compressed, and cloud-optimized backups. Developed by Aiven, it supports streaming WAL archiving and full base backups to various cloud storage backends. pghoard is designed for reliability and fast disaster recovery in cloud-native PostgreSQL deployments. -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
10
Barman
Backup and Recovery Manager for PostgreSQL
Barman (Backup and Recovery Manager) is an enterprise-grade tool for managing backups and disaster recovery of PostgreSQL databases. It supports both full and incremental backups, Point-In-Time Recovery (PITR), and remote backup via SSH. Barman is widely used by DBAs to ensure secure, reliable, and consistent backups in production environments. -
11
Get Node.js
Download a specific version of Node.js
Download a specific version of Node.js. The Node.js release is downloaded, uncompressed and untared to an executable file ready to run. node >=14.18.0 must be globally installed. However any Node version can be downloaded. This package is an ES module and must be loaded using an import or import() statement, not require(). Node.js binary's CPU architecture. This is useful for example when you're on x64 but would like to run Node.js x32. -
12
NVIDIA Model Optimizer
A unified library of SOTA model optimization techniques
Model Optimizer is a unified library that provides state-of-the-art techniques for compressing and optimizing deep learning models to improve inference efficiency and deployment performance. It brings together multiple optimization strategies such as quantization, pruning, distillation, and speculative decoding into a single cohesive framework. The library is designed to reduce model size and computational requirements while maintaining accuracy, making it particularly valuable for deploying... -
13
OpenTTD
Open source simulation game based on Transport Tycoon Deluxe
OpenTTD is an open source transport simulation game based on the popular game Transport Tycoon Deluxe by Chris Sawyer, with several additions. OpenTTD is as close to the original as you can get, but has been extended with plenty of great features. These include bigger maps (up to 64 times bigger than the original), stable multiplayer mode that allows for up to 255 players in 15 companies, in-game downloading of heightmaps, AIs, scenarios, and so much more. With its many additions and... -
14
DeepSeek-OCR
Contexts Optical Compression
DeepSeek-OCR is an open-source optical character recognition solution built as part of the broader DeepSeek AI vision-language ecosystem. It is designed to extract text from images, PDFs, and scanned documents, and integrates with multimodal capabilities that understand layout, context, and visual elements beyond raw character recognition. The system treats OCR not simply as “read the text” but as “understand what the text is doing in the image”—for example distinguishing captions from body... -
15
gRPC Elixir
An Elixir implementation of gRPC
The Gun library doesn't have a full 2.0 release yet, so we depend on :grcp_gun 2.0.1 for now. This is the same as :gun 2.0.0-rc.2, but Hex doesn't let us depend on RC versions for releases. Generate Elixir code from the proto file as protobuf-elixir shows(especially the gRPC Support section). Implement the server-side code and remember to return the expected message types. You can start the gRPC server as a supervised process. First, add GRPC.Server.Supervisor to your supervision tree. -
16
MySQLDump - PHP
PHP version of mysqldump cli that comes with MySQL
This is a php version of mysqldump cli that comes with MySQL, without dependencies, output compression and sane defaults. Out of the box, MySQLDump-PHP supports backing up table structures, the data itself, views, triggers and events. MySQLDump-PHP is the only library that supports output binary blobs as hex. Resolves view dependencies (using Stand-In tables). Output compared against original mysqldump. Linked to travis-ci testing system (testing from php 5.3 to 7.3 & hhvm). -
17
ip2region
Ip2region is an offline IP-to-Region localization library and IP data
...It ships with raw IP datasets and optimized XDB database files for city-level region lookup. Returned records can include country, province, city, ISP, and ISO country-code information. The XDB format supports large datasets, deduplication, compression, and customizable region fields. Query implementations are available for many languages, including Go, Java, Python, PHP, Rust, C, C++, JavaScript, C#, Lua, Erlang, and others. Several cache strategies allow applications to trade memory use for faster query performance, with fully cached lookups operating at microsecond-level speeds. ... -
18
FFmpeg Quality Metrics
Calculate quality metrics with FFmpeg (SSIM, PSNR, VMAF, VIF)
...Designed for cross-platform use, it integrates seamlessly into automated workflows and supports JSON or CSV output formats for further analysis. This makes it particularly valuable for engineers working on video compression and streaming systems. -
19
ffmpeg-commander
A web-based GUI for quickly generating common FFmpeg command-line
...Built with modern web technologies, it generates FFmpeg commands dynamically based on user input. The tool focuses on common workflows such as format conversion, compression, and codec selection. It can optionally connect to a backend service to execute commands and stream progress updates in real time. The interface is inspired by tools like HandBrake, aiming to lower the barrier to entry for FFmpeg usage. Overall, it acts as a bridge between ease of use and powerful multimedia processing capabilities. -
20
TurboQuant PyTorch
From-scratch PyTorch implementation of Google's TurboQuant
TurboQuant PyTorch is a specialized deep learning optimization framework designed to accelerate neural network inference and training through advanced quantization techniques within the PyTorch ecosystem. The project focuses on reducing the computational and memory footprint of models by converting floating-point representations into lower-precision formats while preserving performance. It provides tools for experimenting with different quantization strategies, enabling developers to balance... -
21
PHP JWT Framework
JWT Framework
This project is a framework that provides an implementation of JWS JSON Web Signature (RFC 7515), JWE JSON Web Encryption (RFC 7516), JWK JSON Web Key (RFC 7517), JWA JSON Web Algorithms (RFC 7518), JWT JSON Web Token (RFC 7519), JSON Web Key Thumbprint (RFC 7638), Unencoded Payload Option (RFC7797). -
22
RoaringBitmap
A better compressed bitset in Java
...Roaring bitmaps are compressed bitmaps which tend to outperform conventional compressed bitmaps such as WAH, EWAH or Concise. In some instances, roaring bitmaps can be hundreds of times faster and they often offer significantly better compression. They can even be faster than uncompressed bitmaps. -
23
ERNIE
The official repository for ERNIE 4.5 and ERNIEKit
ERNIE is an open-source large-model toolkit and model family from the PaddlePaddle ecosystem that focuses on training, fine-tuning, compression, and practical application of ERNIE large language models. The repository positions ERNIEKit as an industrial-grade development toolkit, emphasizing end-to-end workflows that span high-performance pre-training, supervised fine-tuning, and alignment. It supports both full-parameter training and parameter-efficient approaches so teams can choose between maximum quality and lower-cost adaptation depending on their constraints. ... -
24
turbovec
A vector index built on TurboQuant, written in Rust with Python
turbovec is a Rust-based vector index with Python bindings for fast similarity search. It is built around TurboQuant, a quantization approach designed to reduce vector storage while preserving useful distance information. The project targets workloads where embedding search needs to be compact, efficient, and practical to integrate into Python applications. It avoids a separate training phase for the quantizer, which can simplify setup compared with systems that require codebook learning.... -
25
NCDatasets.jl
Load and create NetCDF files in Julia
NCDatasets allows one to read and create netCDF files. NetCDF data set and attribute list behave like Julia dictionaries and variables like Julia arrays. This package implements the CommonDataModel.jl interface, which means that the datasets can be accessed in the same way as GRIB files opened with GRIBDatasets.jl.
