Training and deploying machine learning models on Amazon SageMaker
Run Local LLMs on Any Device. Open-source
Ready-to-use OCR with 80+ supported languages
Everything you need to build state-of-the-art foundation models
A high-throughput and memory-efficient inference and serving engine
Standardized Serverless ML Inference Platform on Kubernetes
Optimizing inference proxy for LLMs
Library for OCR-related tasks powered by Deep Learning
A set of Docker images for training and serving models in TensorFlow
Deep learning optimization library: makes distributed training easy
Sparsity-aware deep learning inference runtime for CPUs
Bring the notion of Model-as-a-Service to life
Single-cell analysis in Python
A unified framework for scalable computing
A Pythonic framework to simplify AI service building
FlashInfer: Kernel Library for LLM Serving
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Official inference library for Mistral models
Data manipulation and transformation for audio signal processing
Uncover insights, surface problems, monitor, and fine tune your LLM
Trainable, memory-efficient, and GPU-friendly PyTorch reproduction
OpenMMLab Model Deployment Framework
The official Python client for the Huggingface Hub
Adversarial Robustness Toolbox (ART) - Python Library for ML security
Operating LLMs in production