Maid is a cross-platform Flutter app for interfacing with GGUF
Port of OpenAI's Whisper model in C/C++
Speech Note Linux app. Note taking, reading and translating
Low-latency machine code generation
Agentic browser; privacy-first alternative to ChatGPT Atlas
Code for Cicero, an AI agent that plays the game of Diplomacy
Emscripten: An LLVM-to-WebAssembly Compiler
MNN is a blazing fast, lightweight deep learning framework
Fast inference engine for Transformer models
Toolkit for making machine learning and data analysis applications
Clean and efficient FP8 GEMM kernels with fine-grained scaling
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
Open-source simulator for autonomous driving research.
ArrayFire, a general purpose GPU library
C++ Implementation of PyTorch Tutorials for Everyone
Testing tool for modeling GUI transitions
Deep Learning API and Server in C++14 support for Caffe, PyTorch
Set of comprehensive computer vision & machine intelligence libraries
Fast LLM speculative inference server for consumer hardware
C++ DataFrame for statistical, Financial, and ML analysis
HeavyDB (formerly MapD/OmniSciDB)
Serving system for machine learning models
CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)
Open Source Computer Vision Library
fast C++ library for linear algebra & scientific computing