LiteRT-LM is Google's production-ready inference framework
Fast, Sharp & Reliable Agentic Intelligence
Open Source Computer Vision Library
A lightweight, lightning-fast, in-process vector database
Infrastructure to enable deployment of ML models
Mooncake is the serving platform for Kimi
Set of comprehensive computer vision & machine intelligence libraries
Serving system for machine learning models
C++ Implementation of PyTorch Tutorials for Everyone
Google Testing and Mocking Framework
Alibaba's high-performance LLM inference engine for diverse apps
A scalable inference server for models optimized with OpenVINO
Gradient boosting framework based on decision tree algorithms
C++ image processing and machine learning library with using of SIMD
A retargetable MLIR-based machine learning compiler runtime toolkit
Fit interpretable models. Explain blackbox machine learning
Speech Note Linux app. Note taking, reading and translating
Tensor library for machine learning
ArrayFire, a general purpose GPU library
FlashMLA: Efficient Multi-head Latent Attention Kernels
Framework for building AI-powered interactive digital humans and agent
C++ behavior tree library for robotics and AI decision systems
Connect home devices into a powerful cluster to accelerate LLM
Official inference framework for 1-bit LLMs
A @ClickHouse fork that supports high-performance vector search