Unified Model Serving Framework
An MLOps framework to package, deploy, monitor and manage models
Official inference library for Mistral models
Deep learning optimization library: makes distributed training easy
Standardized Serverless ML Inference Platform on Kubernetes
A unified framework for scalable computing
AIMET is a library that provides advanced quantization and compression
Deploy a ML inference service on a budget in 10 lines of code