OpenVINO™ Toolkit repository
C++ library for high performance inference on NVIDIA GPUs
PArallel Distributed Deep LEarning: Machine Learning Framework
An innovative library for efficient LLM inference
Open standard for machine learning interoperability
lightweight, standalone C++ inference engine for Google's Gemma models
Easy-to-use Speech Toolkit including Self-Supervised Learning model
MNN is a blazing fast, lightweight deep learning framework
Easy-to-use deep learning framework with 3 key features
OpenMLDB is an open-source machine learning database
A scalable inference server for models optimized with OpenVINO
A GPU-accelerated library containing highly optimized building blocks
Serving system for machine learning models
Deep learning inference framework optimized for mobile platforms