An Open-Source Programming Framework for Agentic AI
Port of OpenAI's Whisper model in C/C++
High-performance neural network inference framework for mobile
C++ library for high performance inference on NVIDIA GPUs
PArallel Distributed Deep LEarning: Machine Learning Framework
A library for accelerating Transformer models on NVIDIA GPUs
MNN is a blazing fast, lightweight deep learning framework
Powering Amazon custom machine learning chips
Bolt is a deep learning library with high performance
Set of comprehensive computer vision & machine intelligence libraries
Easy-to-use deep learning framework with 3 key features
llama.go is like llama.cpp in pure Golang
The deep learning toolkit for speech-to-text
Deep learning inference framework optimized for mobile platforms
Uniform deep learning inference framework for mobile
Fast and user-friendly runtime for transformer inference