Port of OpenAI's Whisper model in C/C++
Run Local LLMs on Any Device. Open-source
Distribute and run LLMs with a single file
C++ library for Telegram bot API
Agentic browser; privacy-first alternative to ChatGPT Atlas
Deep Learning API and Server in C++14 support for Caffe, PyTorch
RAPIDS Machine Learning Library
TT-NN operator library, and TT-Metalium low level kernel programming
Open-source simulator for autonomous driving research.
C++ image processing and machine learning library with using of SIMD
Doom-based AI research platform for reinforcement learning
LiteRT, successor to TensorFlow Lite
Fast LLM speculative inference server for consumer hardware
Low-latency machine code generation
LLM inference in C/C++
Declarative way to run AI models in React Native on device
ONNX-TensorRT: TensorRT backend for ONNX
Fast, Sharp & Reliable Agentic Intelligence
Low-latency AI inference engine optimized for mobile devices
A GPU-accelerated library containing highly optimized building blocks
C++-based high-performance parallel environment execution engine
A general, three-party dependency-free, cross-platform
mlpack: a scalable C++ machine learning library
Environments and algorithms for research in general reinforcement
FlashMLA: Efficient Multi-head Latent Attention Kernels