ONNX Runtime: cross-platform, high performance ML inferencing
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
OpenVINO™ Toolkit repository
C++ library for high performance inference on NVIDIA GPUs
OneFlow is a deep learning framework designed to be user-friendly
oneAPI Deep Neural Network Library (oneDNN)
Deep learning inference framework optimized for mobile platforms