C++ library for high performance inference on NVIDIA GPUs
PArallel Distributed Deep LEarning: Machine Learning Framework
OpenVINO™ Toolkit repository
Open standard for machine learning interoperability
MNN is a blazing fast, lightweight deep learning framework
ONNX Runtime: cross-platform, high performance ML inferencing
Deep Learning API and Server in C++14 support for Caffe, PyTorch
A GPU-accelerated library containing highly optimized building blocks
High-performance neural network inference framework for mobile
Bolt is a deep learning library with high performance
Fast inference engine for Transformer models
Easy-to-use deep learning framework with 3 key features
The deep learning toolkit for speech-to-text
Guide to deploying deep-learning inference networks
Deep learning inference framework optimized for mobile platforms
Uniform deep learning inference framework for mobile