Powering Amazon custom machine learning chips
Training and deploying machine learning models on Amazon SageMaker
A set of Docker images for training and serving models in TensorFlow
On-device AI across mobile, embedded and edge for PyTorch
Library for OCR-related tasks powered by Deep Learning
The Triton Inference Server provides an optimized cloud
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
C++ library for high performance inference on NVIDIA GPUs
Library for serving Transformers models on Amazon SageMaker
LLMs and Machine Learning done easily
OpenMMLab Model Deployment Framework
Guide to deploying deep-learning inference networks
Toolkit for allowing inference and serving with MXNet in SageMaker