The Triton Inference Server provides an optimized cloud
A high-performance ML model serving framework, offers dynamic batching
Library for OCR-related tasks powered by Deep Learning
20+ high-performance LLMs with recipes to pretrain, finetune at scale
MII makes low-latency and high-throughput inference possible
Standardized Serverless ML Inference Platform on Kubernetes
Lightweight Python library for adding real-time multi-object tracking
Gaussian processes in TensorFlow
Trainable models and NN optimization tools
Pytorch domain library for recommendation systems
Phi-3.5 for Mac: Locally-run Vision and Language Models
An MLOps framework to package, deploy, monitor and manage models
Bring the notion of Model-as-a-Service to life
Create HTML profiling reports from pandas DataFrame objects
Simplifies the local serving of AI models from any source
Multilingual Automatic Speech Recognition with word-level timestamps
Adversarial Robustness Toolbox (ART) - Python Library for ML security
Replace OpenAI GPT with another LLM in your app
Low-latency REST API for serving text-embeddings
AIMET is a library that provides advanced quantization and compression
LLM training code for MosaicML foundation models
Unified Model Serving Framework
State-of-the-art Parameter-Efficient Fine-Tuning
Powering Amazon custom machine learning chips
PyTorch extensions for fast R&D prototyping and Kaggle farming