Run Local LLMs on Any Device. Open-source
ONNX Runtime: cross-platform, high performance ML inferencing
Port of OpenAI's Whisper model in C/C++
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Set of comprehensive computer vision & machine intelligence libraries
Bolt is a deep learning library with high performance
Open standard for machine learning interoperability
OpenVINO™ Toolkit repository
On-device AI across mobile, embedded and edge for PyTorch
lightweight, standalone C++ inference engine for Google's Gemma models
Easy-to-use deep learning framework with 3 key features