Training and deploying machine learning models on Amazon SageMaker
Run Local LLMs on Any Device. Open-source
Ready-to-use OCR with 80+ supported languages
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
A high-throughput and memory-efficient inference and serving engine
An MLOps framework to package, deploy, monitor and manage models
Sparsity-aware deep learning inference runtime for CPUs
AIMET is a library that provides advanced quantization and compression
FlashInfer: Kernel Library for LLM Serving
Superduper: Integrate AI models and machine learning workflows
Integrate, train and manage any AI models and APIs with your database
Operating LLMs in production
DoWhy is a Python library for causal inference
Library for OCR-related tasks powered by Deep Learning
Uplift modeling and causal inference with machine learning algorithms
Easiest and laziest way for building multi-agent LLMs applications
Large Language Model Text Generation Inference
Multilingual Automatic Speech Recognition with word-level timestamps
OpenMMLab Model Deployment Framework
Deep learning optimization library: makes distributed training easy
A unified framework for scalable computing
Database system for building simpler and faster AI-powered application
PyTorch library of curated Transformer models and their components
Run 100B+ language models at home, BitTorrent-style
Bring the notion of Model-as-a-Service to life