Library for OCR-related tasks powered by Deep Learning
A Pythonic framework to simplify AI service building
Powering Amazon custom machine learning chips
Run Local LLMs on Any Device. Open-source
A unified framework for scalable computing
Library for serving Transformers models on Amazon SageMaker
Unified Model Serving Framework
LLM training code for MosaicML foundation models
Bring the notion of Model-as-a-Service to life
Ready-to-use OCR with 80+ supported languages
State-of-the-art diffusion models for image and audio generation
A set of Docker images for training and serving models in TensorFlow
Neural Network Compression Framework for enhanced OpenVINO
Trainable, memory-efficient, and GPU-friendly PyTorch reproduction
Official inference library for Mistral models
An MLOps framework to package, deploy, monitor and manage models
A library for accelerating Transformer models on NVIDIA GPUs
Superduper: Integrate AI models and machine learning workflows
The Triton Inference Server provides an optimized cloud
Standardized Serverless ML Inference Platform on Kubernetes
A high-performance ML model serving framework, offers dynamic batching
Lightweight Python library for adding real-time multi-object tracking
Replace OpenAI GPT with another LLM in your app
AIMET is a library that provides advanced quantization and compression
GPU environment management and cluster orchestration