MNN is a blazing fast, lightweight deep learning framework
High-performance neural network inference framework for mobile
Protect and discover secrets using Gitleaks
A general-purpose probabilistic programming system
Port of OpenAI's Whisper model in C/C++
A Pythonic framework to simplify AI service building
Run Local LLMs on Any Device. Open-source
Powering Amazon custom machine learning chips
Set of comprehensive computer vision & machine intelligence libraries
A unified framework for scalable computing
Library for serving Transformers models on Amazon SageMaker
Unified Model Serving Framework
C++ library for high performance inference on NVIDIA GPUs
LLM training code for MosaicML foundation models
ONNX Runtime: cross-platform, high performance ML inferencing
Open-Source AI Camera. Empower any camera/CCTV
An MLOps framework to package, deploy, monitor and manage models
Neural Network Compression Framework for enhanced OpenVINO
State-of-the-art diffusion models for image and audio generation
Official inference library for Mistral models
Fast inference engine for Transformer models
Superduper: Integrate AI models and machine learning workflows
A library for accelerating Transformer models on NVIDIA GPUs
AIMET is a library that provides advanced quantization and compression
Trainable, memory-efficient, and GPU-friendly PyTorch reproduction