User-friendly AI Interface
Openai style api for open large language models
Port of OpenAI's Whisper model in C/C++
Run Local LLMs on Any Device. Open-source
Port of Facebook's LLaMA model in C/C++
ONNX Runtime: cross-platform, high performance ML inferencing
The free, Open Source alternative to OpenAI, Claude and others
A high-throughput and memory-efficient inference and serving engine
OpenVINO™ Toolkit repository
FlashInfer: Kernel Library for LLM Serving
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Protect and discover secrets using Gitleaks
Open standard for machine learning interoperability
Everything you need to build state-of-the-art foundation models
Ready-to-use OCR with 80+ supported languages
High-performance neural network inference framework for mobile
An MLOps framework to package, deploy, monitor and manage models
Open-Source AI Camera. Empower any camera/CCTV
Optimizing inference proxy for LLMs
Simplifies the local serving of AI models from any source
Operating LLMs in production
LLM training code for MosaicML foundation models
LLM.swift is a simple and readable library
Neural Network Compression Framework for enhanced OpenVINO
OpenMLDB is an open-source machine learning database