PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
C++ library for high performance inference on NVIDIA GPUs
ONNX Runtime: cross-platform, high performance ML inferencing
oneAPI Deep Neural Network Library (oneDNN)
A GPU-accelerated library containing highly optimized building blocks
Guide to deploying deep-learning inference networks
nGraph has moved to OpenVINO
A fast open framework for deep learning