Connect home devices into a powerful cluster to accelerate LLM
lightweight, standalone C++ inference engine for Google's Gemma models
OpenMLDB is an open-source machine learning database
The deep learning toolkit for speech-to-text
Guide to deploying deep-learning inference networks
Deep learning inference framework optimized for mobile platforms
Uniform deep learning inference framework for mobile
Fast and user-friendly runtime for transformer inference