Everything you need to build state-of-the-art foundation models
LLM training code for MosaicML foundation models
Run Local LLMs on Any Device. Open-source
Neural Network Compression Framework for enhanced OpenVINO
Official inference library for Mistral models
A unified framework for scalable computing
A set of Docker images for training and serving models in TensorFlow
Superduper: Integrate AI models and machine learning workflows
Unified Model Serving Framework
Library for serving Transformers models on Amazon SageMaker
Standardized Serverless ML Inference Platform on Kubernetes
Powering Amazon custom machine learning chips
An MLOps framework to package, deploy, monitor and manage models
AIMET is a library that provides advanced quantization and compression
Deep learning optimization library: makes distributed training easy
A GPU-accelerated library containing highly optimized building blocks
Easy-to-use deep learning framework with 3 key features
Images to inference with no labeling
OpenMMLab Model Deployment Framework
Framework that is dedicated to making neural data processing
A computer vision framework to create and deploy apps in minutes
Guide to deploying deep-learning inference networks
Toolkit for allowing inference and serving with MXNet in SageMaker
Deploy a ML inference service on a budget in 10 lines of code