ONNX Runtime: cross-platform, high performance ML inferencing
High-performance neural network inference framework for mobile
User-friendly AI Interface
The free, Open Source alternative to OpenAI, Claude and others
Run Local LLMs on Any Device. Open-source
OpenMLDB is an open-source machine learning database
PArallel Distributed Deep LEarning: Machine Learning Framework
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
Standardized Serverless ML Inference Platform on Kubernetes
The official Python client for the Huggingface Hub
Deep Learning API and Server in C++14 support for Caffe, PyTorch
Unified Model Serving Framework
Operating LLMs in production
Run serverless GPU workloads with fast cold starts on bare-metal
An MLOps framework to package, deploy, monitor and manage models
AI interface for tinkerers (Ollama, Haystack RAG, Python)
MNN is a blazing fast, lightweight deep learning framework
Easy-to-use Speech Toolkit including Self-Supervised Learning model
20+ high-performance LLMs with recipes to pretrain, finetune at scale
Private Open AI on Kubernetes
Superduper: Integrate AI models and machine learning workflows
LLM training code for MosaicML foundation models
Easy-to-use deep learning framework with 3 key features
Open Source and Lightweight Local LLM Platform
Open platform for training, serving, and evaluating language models