Port of OpenAI's Whisper model in C/C++
Run Local LLMs on Any Device. Open-source
Port of Facebook's LLaMA model in C/C++
User-friendly AI Interface
OpenVINO™ Toolkit repository
High-performance neural network inference framework for mobile
The free, Open Source alternative to OpenAI, Claude and others
Ready-to-use OCR with 80+ supported languages
ONNX Runtime: cross-platform, high performance ML inferencing
MNN is a blazing fast, lightweight deep learning framework
C++ library for high performance inference on NVIDIA GPUs
A high-throughput and memory-efficient inference and serving engine
Protect and discover secrets using Gitleaks
Everything you need to build state-of-the-art foundation models
Library for OCR-related tasks powered by Deep Learning
Pure C++ implementation of several models for real-time chatting
Open standard for machine learning interoperability
Data manipulation and transformation for audio signal processing
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Bring the notion of Model-as-a-Service to life
Open-Source AI Camera. Empower any camera/CCTV
Deep learning optimization library: makes distributed training easy
A Pythonic framework to simplify AI service building
The Triton Inference Server provides an optimized cloud
FlashInfer: Kernel Library for LLM Serving