LiteRT-LM is Google's production-ready inference framework
Port of OpenAI's Whisper model in C/C++
MNN is a blazing fast, lightweight deep learning framework
An Easy-to-Use and High-Performance AI Deployment Framework
LiteRT, successor to TensorFlow Lite
High-performance neural network inference framework for mobile
Low-latency AI inference engine optimized for mobile devices
A general, three-party dependency-free, cross-platform
Fast Multimodal LLM on Mobile Devices
Easy-to-use deep learning framework with 3 key features
Deep learning inference framework optimized for mobile platforms
Uniform deep learning inference framework for mobile
OpenCV enhancement library for Android