Run Local LLMs on Any Device. Open-source
The official Python client for the Huggingface Hub
Operating LLMs in production
Standardized Serverless ML Inference Platform on Kubernetes
Unified Model Serving Framework
An MLOps framework to package, deploy, monitor and manage models
Superduper: Integrate AI models and machine learning workflows
20+ high-performance LLMs with recipes to pretrain, finetune at scale
Easy-to-use Speech Toolkit including Self-Supervised Learning model
LLM training code for MosaicML foundation models
OpenMMLab Model Deployment Framework