Bring the notion of Model-as-a-Service to life
AIMET is a library that provides advanced quantization and compression
Library for serving Transformers models on Amazon SageMaker
Uncover insights, surface problems, monitor, and fine tune your LLM
Official inference library for Mistral models
PyTorch extensions for fast R&D prototyping and Kaggle farming
Deep learning optimization library: makes distributed training easy
Probabilistic reasoning and statistical analysis in TensorFlow
The official Python client for the Huggingface Hub
A unified framework for scalable computing
A lightweight vision library for performing large object detection
State-of-the-art diffusion models for image and audio generation
Pytorch domain library for recommendation systems
MII makes low-latency and high-throughput inference possible
Replace OpenAI GPT with another LLM in your app
PyTorch library of curated Transformer models and their components
Serve machine learning models within a Docker container
Lightweight anchor-free object detection model
Implementation of model parallel autoregressive transformers on GPUs
Toolkit for allowing inference and serving with MXNet in SageMaker