Run Local LLMs on Any Device. Open-source
A high-throughput and memory-efficient inference and serving engine
Everything you need to build state-of-the-art foundation models
Replace OpenAI GPT with another LLM in your app
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Simplifies the local serving of AI models from any source
Multilingual Automatic Speech Recognition with word-level timestamps
Official inference library for Mistral models
Uplift modeling and causal inference with machine learning algorithms
State-of-the-art Parameter-Efficient Fine-Tuning
Large Language Model Text Generation Inference
Integrate, train and manage any AI models and APIs with your database
Bring the notion of Model-as-a-Service to life
A set of Docker images for training and serving models in TensorFlow
Optimizing inference proxy for LLMs
Library for OCR-related tasks powered by Deep Learning
LLM training code for MosaicML foundation models
Neural Network Compression Framework for enhanced OpenVINO
The official Python client for the Huggingface Hub
MII makes low-latency and high-throughput inference possible
20+ high-performance LLMs with recipes to pretrain, finetune at scale
DoWhy is a Python library for causal inference
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
A high-performance ML model serving framework, offers dynamic batching
Unified Model Serving Framework