Collection of various algorithms in mathematics, machine learning
Testing tool for modeling GUI transitions
Port of OpenAI's Whisper model in C/C++
Port of Facebook's LLaMA model in C/C++
CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)
Open Source OCR Engine
Emscripten: An LLVM-to-WebAssembly Compiler
Low-latency machine code generation
Speech-to-text, text-to-speech, and speaker recognition
Fast LLM speculative inference server for consumer hardware
Toolkit for making machine learning and data analysis applications
Open-source simulator for autonomous driving research.
Build your own AI friend
Agentic browser; privacy-first alternative to ChatGPT Atlas
Code for Cicero, an AI agent that plays the game of Diplomacy
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference
Run Local LLMs on Any Device. Open-source
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
C++ DataFrame for statistical, Financial, and ML analysis
Audio Plugin for Audio to MIDI transcription using deep learning
Clean and efficient FP8 GEMM kernels with fine-grained scaling
C++ Implementation of PyTorch Tutorials for Everyone
Distribute and run LLMs with a single file
LLM inference in C/C++
Fast inference engine for Transformer models