Run Local LLMs on Any Device. Open-source
A lightweight vision library for performing large object detection
Ready-to-use OCR with 80+ supported languages
A high-throughput and memory-efficient inference and serving engine
Everything you need to build state-of-the-art foundation models
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Library for OCR-related tasks powered by Deep Learning
Bring the notion of Model-as-a-Service to life
The Triton Inference Server provides an optimized cloud
A library for accelerating Transformer models on NVIDIA GPUs
A set of Docker images for training and serving models in TensorFlow
Data manipulation and transformation for audio signal processing
Low-latency REST API for serving text-embeddings
An MLOps framework to package, deploy, monitor and manage models
Create HTML profiling reports from pandas DataFrame objects
Official inference library for Mistral models
20+ high-performance LLMs with recipes to pretrain, finetune at scale
DoWhy is a Python library for causal inference
Deep learning optimization library: makes distributed training easy
Replace OpenAI GPT with another LLM in your app
Single-cell analysis in Python
Optimizing inference proxy for LLMs
AIMET is a library that provides advanced quantization and compression
Easiest and laziest way for building multi-agent LLMs applications
A Pythonic framework to simplify AI service building