C++ library for high performance inference on NVIDIA GPUs
High-performance neural network inference framework for mobile
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
ONNX Runtime: cross-platform, high performance ML inferencing
AIMET is a library that provides advanced quantization and compression
Protect and discover secrets using Gitleaks
Easy-to-use deep learning framework with 3 key features
Neural Network Compression Framework for enhanced OpenVINO
Set of comprehensive computer vision & machine intelligence libraries
A general-purpose probabilistic programming system
Build Production-ready Agentic Workflow with Natural Language
Deep Learning API and Server in C++14 support for Caffe, PyTorch
OpenMMLab Model Deployment Framework
Deep learning inference framework optimized for mobile platforms
Uniform deep learning inference framework for mobile