A scalable inference server for models optimized with OpenVINO
Run Local LLMs on Any Device. Open-source
Protect and discover secrets using Gitleaks
ONNX Runtime: cross-platform, high performance ML inferencing
Unified Model Serving Framework
A GPU-accelerated library containing highly optimized building blocks
Standardized Serverless ML Inference Platform on Kubernetes
Easy-to-use deep learning framework with 3 key features
OpenMMLab Model Deployment Framework
A computer vision framework to create and deploy apps in minutes
Framework that is dedicated to making neural data processing
Self-contained Machine Learning and Natural Language Processing lib
Uniform deep learning inference framework for mobile