Run Local LLMs on Any Device. Open-source
The official Python client for the Huggingface Hub
Operating LLMs in production
Unified Model Serving Framework
Easy-to-use deep learning framework with 3 key features
OpenMLDB is an open-source machine learning database
Standardized Serverless ML Inference Platform on Kubernetes
An MLOps framework to package, deploy, monitor and manage models
20+ high-performance LLMs with recipes to pretrain, finetune at scale
Superduper: Integrate AI models and machine learning workflows
LLM training code for MosaicML foundation models
OpenMMLab Model Deployment Framework
Guide to deploying deep-learning inference networks