Powering Amazon custom machine learning chips
Training and deploying machine learning models on Amazon SageMaker
A set of Docker images for training and serving models in TensorFlow
On-device AI across mobile, embedded and edge for PyTorch
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
C++ library for high performance inference on NVIDIA GPUs
Library for serving Transformers models on Amazon SageMaker
Trainable, memory-efficient, and GPU-friendly PyTorch reproduction
LLMs and Machine Learning done easily
OpenMMLab Model Deployment Framework
Guide to deploying deep-learning inference networks
Toolkit for allowing inference and serving with MXNet in SageMaker