ONNX Runtime: cross-platform, high performance ML inferencing
High-performance neural network inference framework for mobile
User-friendly AI Interface
Run Local LLMs on Any Device. Open-source
The free, Open Source alternative to OpenAI, Claude and others
Standardized Serverless ML Inference Platform on Kubernetes
OpenMLDB is an open-source machine learning database
PArallel Distributed Deep LEarning: Machine Learning Framework
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
The official Python client for the Huggingface Hub
Deep Learning API and Server in C++14 support for Caffe, PyTorch
Unified Model Serving Framework
Operating LLMs in production
Run serverless GPU workloads with fast cold starts on bare-metal
An MLOps framework to package, deploy, monitor and manage models
AI interface for tinkerers (Ollama, Haystack RAG, Python)
Easy-to-use Speech Toolkit including Self-Supervised Learning model
20+ high-performance LLMs with recipes to pretrain, finetune at scale
Private Open AI on Kubernetes
Superduper: Integrate AI models and machine learning workflows
LLM training code for MosaicML foundation models
Easy-to-use deep learning framework with 3 key features
Open platform for training, serving, and evaluating language models
OpenMMLab Model Deployment Framework
The deep learning toolkit for speech-to-text