Here comes a selection of technology stacks and tool repositories
Port of Facebook's LLaMA model in C/C++
Run Local LLMs on Any Device. Open-source
Audio Plugin for Audio to MIDI transcription using deep learning
Structure-from-Motion and Multi-View Stereo
Implementation of TurboQuant (ICLR 2026)
Fast LLM speculative inference server for consumer hardware
Open source AI model for generating full songs from lyrics prompts
A lightweight, lightning-fast, in-process vector database
A nearly-live implementation of OpenAI's Whisper
Fast Multimodal LLM on Mobile Devices
Tensor library for machine learning
Workflow and speech recognition app
Collection of various algorithms in mathematics, machine learning
TT-NN operator library, and TT-Metalium low level kernel programming
Official inference framework for 1-bit LLMs
The easy-to-use Vue low-code visual AI form designer
HeavyDB (formerly MapD/OmniSciDB)
C++-based high-performance parallel environment execution engine
Open-source large language model family from Tencent Hunyuan
Declarative way to run AI models in React Native on device
3D Computer Vision Framework
Low-latency machine code generation
C++ behavior tree library for robotics and AI decision systems
Confidential Compute Open Network, Decentralized AI Inference on TON