C++ library for high performance inference on NVIDIA GPUs
OpenVINO™ Toolkit repository
High-performance neural network inference framework for mobile
Set of comprehensive computer vision & machine intelligence libraries
ONNX Runtime: cross-platform, high performance ML inferencing
PArallel Distributed Deep LEarning: Machine Learning Framework
A library for accelerating Transformer models on NVIDIA GPUs
OpenMMLab Model Deployment Framework
Lightweight inference library for ONNX files, written in C++
Guide to deploying deep-learning inference networks
Uniform deep learning inference framework for mobile