Port of OpenAI's Whisper model in C/C++
Speech-to-text, text-to-speech, and speaker recognition
Powerful Android AI agent with tools, automation, and Linux shell
Awesome multilingual OCR toolkits based on PaddlePaddle
Audio Plugin for Audio to MIDI transcription using deep learning
Confidential Compute Open Network, Decentralized AI Inference on TON
Connect home devices into a powerful cluster to accelerate LLM
A high-performance distributed file system
Toolkit for making machine learning and data analysis applications
kaldi-asr/kaldi is the official location of the Kaldi project
Mooncake is the serving platform for Kimi
ArrayFire, a general purpose GPU library
HeavyDB (formerly MapD/OmniSciDB)
UCCL is an efficient communication library for GPUs
Fast Multimodal LLM on Mobile Devices
A general, three-party dependency-free, cross-platform
An Easy-to-Use and High-Performance AI Deployment Framework
A scalable inference server for models optimized with OpenVINO
Low-latency AI inference engine optimized for mobile devices
Alibaba's high-performance LLM inference engine for diverse apps
Production ready toolkit to run AI locally
The AI-Native Search Database
Instant neural graphics primitives: lightning fast NeRF and more
A @ClickHouse fork that supports high-performance vector search
High-speed Large Language Model Serving for Local Deployment