MNN is a blazing fast, lightweight deep learning framework
Serving system for machine learning models
Lightweight inference library for ONNX files, written in C++
Deep Learning API and Server in C++14 support for Caffe, PyTorch
Fast inference engine for Transformer models
Set of comprehensive computer vision & machine intelligence libraries
Guide to deploying deep-learning inference networks
Deep learning inference framework optimized for mobile platforms
Uniform deep learning inference framework for mobile