Fast inference engine for Transformer models
Deep Learning API and Server in C++14 support for Caffe, PyTorch
MNN is a blazing fast, lightweight deep learning framework
Set of comprehensive computer vision & machine intelligence libraries
Serving system for machine learning models
Guide to deploying deep-learning inference networks
Deep learning inference framework optimized for mobile platforms
Uniform deep learning inference framework for mobile