High-performance neural network inference framework for mobile
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
ONNX Runtime: cross-platform, high performance ML inferencing
Protect and discover secrets using Gitleaks
AIMET is a library that provides advanced quantization and compression
Easy-to-use deep learning framework with 3 key features
Neural Network Compression Framework for enhanced OpenVINO
Set of comprehensive computer vision & machine intelligence libraries
A general-purpose probabilistic programming system
Build your chatbot within minutes on your favorite device
Build Production-ready Agentic Workflow with Natural Language
Deep Learning API and Server in C++14 support for Caffe, PyTorch
OpenMMLab Model Deployment Framework