Powering Amazon custom machine learning chips
Training and deploying machine learning models on Amazon SageMaker
A set of Docker images for training and serving models in TensorFlow
Library for OCR-related tasks powered by Deep Learning
On-device AI across mobile, embedded and edge for PyTorch
Open-source tool designed to enhance the efficiency of workloads
The Triton Inference Server provides an optimized cloud
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
Library for serving Transformers models on Amazon SageMaker
C++ library for high performance inference on NVIDIA GPUs
Trainable, memory-efficient, and GPU-friendly PyTorch reproduction
LLMs and Machine Learning done easily
OpenMMLab Model Deployment Framework
Guide to deploying deep-learning inference networks
Toolkit for allowing inference and serving with MXNet in SageMaker