ONNX Runtime: cross-platform, high performance ML inferencing
Port of OpenAI's Whisper model in C/C++
PArallel Distributed Deep LEarning: Machine Learning Framework
MNN is a blazing fast, lightweight deep learning framework
Deep Learning API and Server in C++14 support for Caffe, PyTorch
A scalable inference server for models optimized with OpenVINO
A GPU-accelerated library containing highly optimized building blocks
Easy-to-use deep learning framework with 3 key features
The deep learning toolkit for speech-to-text
Uniform deep learning inference framework for mobile