Port of OpenAI's Whisper model in C/C++
Port of Facebook's LLaMA model in C/C++
Run Local LLMs on Any Device. Open-source
Fast inference engine for Transformer models
MNN is a blazing fast, lightweight deep learning framework
ONNX Runtime: cross-platform, high performance ML inferencing
Ready-to-use OCR with 80+ supported languages
Deep Learning API and Server in C++14 support for Caffe, PyTorch
State-of-the-art diffusion models for image and audio generation
A Pythonic framework to simplify AI service building
A general-purpose probabilistic programming system
OpenVINO™ Toolkit repository
High-performance neural network inference framework for mobile
Open-Source AI Camera. Empower any camera/CCTV
C++ library for high performance inference on NVIDIA GPUs
LLM training code for MosaicML foundation models
Protect and discover secrets using Gitleaks
Open standard for machine learning interoperability
Serving system for machine learning models
Bring the notion of Model-as-a-Service to life
Library for OCR-related tasks powered by Deep Learning
Set of comprehensive computer vision & machine intelligence libraries
A library for accelerating Transformer models on NVIDIA GPUs
Pure C++ implementation of several models for real-time chatting
Replace OpenAI GPT with another LLM in your app