Official inference framework for 1-bit LLMs
Distribute and run LLMs with a single file
Clean and efficient FP8 GEMM kernels with fine-grained scaling
ONNX Runtime: cross-platform, high performance ML inferencing
Toolkit for making machine learning and data analysis applications
MLX: An array framework for Apple silicon
Pure C++ implementation of several models for real-time chatting
MNN is a blazing fast, lightweight deep learning framework
Speech Note Linux app. Note taking, reading and translating
ESP32 Camera motion capture application to record JPEGs to SD card
C++ Implementation of PyTorch Tutorials for Everyone
OpenMLDB is an open-source machine learning database
A Python library for audio
VMZ: Model Zoo for Video Modeling
Fast LLM speculative inference server for consumer hardware
oneAPI Deep Neural Network Library (oneDNN)
kaldi-asr/kaldi is the official location of the Kaldi project
Fit interpretable models. Explain blackbox machine learning
Environments and algorithms for research in general reinforcement
Enabling PyTorch on Google TPU
fast C++ library for linear algebra & scientific computing
Easy-to-use deep learning framework with 3 key features
Run GGUF models easily with a UI or API. One File. Zero Install.
Local AI file organization with categorization and rename suggestions
Scientific Visualisation Made Easy