Open Source OCR Engine
Port of OpenAI's Whisper model in C/C++
Build your own AI friend
Port of Facebook's LLaMA model in C/C++
Run Local LLMs on Any Device. Open-source
Speech-to-text, text-to-speech, and speaker recognition
Awesome multilingual OCR toolkits based on PaddlePaddle
Audio Plugin for Audio to MIDI transcription using deep learning
Distribute and run LLMs with a single file
Clean and efficient FP8 GEMM kernels with fine-grained scaling
Structure-from-Motion and Multi-View Stereo
ONNX Runtime: cross-platform, high performance ML inferencing
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference
Open Source Computer Vision Library
LiteRT is the new name for TensorFlow Lite (TFLite)
TT-NN operator library, and TT-Metalium low level kernel programming
OpenVINO™ Toolkit repository
High-performance neural network inference framework for mobile
C++-based high-performance parallel environment execution engine
CV-CUDA™ is an open-source, GPU accelerated library
Agentic browser; privacy-first alternative to ChatGPT Atlas
Google Testing and Mocking Framework
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
C++ library for high performance inference on NVIDIA GPUs
A retargetable MLIR-based machine learning compiler runtime toolkit