ONNX Runtime: cross-platform, high performance ML inferencing
OpenMLDB is an open-source machine learning database
Open standard for machine learning interoperability
PArallel Distributed Deep LEarning: Machine Learning Framework
Easy-to-use deep learning framework with 3 key features
A GPU-accelerated library containing highly optimized building blocks
Lightweight inference library for ONNX files, written in C++
Serving system for machine learning models
C++ library for high performance inference on NVIDIA GPUs
OpenVINO™ Toolkit repository
Deep Learning API and Server in C++14 support for Caffe, PyTorch
On-device AI across mobile, embedded and edge for PyTorch
MNN is a blazing fast, lightweight deep learning framework
Port of OpenAI's Whisper model in C/C++
Set of comprehensive computer vision & machine intelligence libraries
Easy-to-use Speech Toolkit including Self-Supervised Learning model
Fast inference engine for Transformer models
The deep learning toolkit for speech-to-text
Guide to deploying deep-learning inference networks
Deep learning inference framework optimized for mobile platforms
Uniform deep learning inference framework for mobile