ONNX Runtime: cross-platform, high performance ML inferencing
High-performance neural network inference framework for mobile
Run Local LLMs on Any Device. Open-source
OpenMLDB is an open-source machine learning database
PArallel Distributed Deep LEarning: Machine Learning Framework
Deep Learning API and Server in C++14 support for Caffe, PyTorch
MNN is a blazing fast, lightweight deep learning framework
Easy-to-use Speech Toolkit including Self-Supervised Learning model
Easy-to-use deep learning framework with 3 key features
The deep learning toolkit for speech-to-text
Guide to deploying deep-learning inference networks
Uniform deep learning inference framework for mobile