Open Source OCR Engine
Alibaba's high-performance LLM inference engine for diverse apps
The AI-Native Search Database
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference
OCR offline image text recognition command line windows program
Mooncake is the serving platform for Kimi
The open big data serving engine
OpenMLDB is an open-source machine learning database
LLM inference in C/C++
Emscripten: An LLVM-to-WebAssembly Compiler
Low-latency AI inference engine optimized for mobile devices
GPU accelerated decision optimization
HeavyDB (formerly MapD/OmniSciDB)
A @ClickHouse fork that supports high-performance vector search
Fast Multimodal LLM on Mobile Devices
Fast inference engine for Transformer models
LiteRT, successor to TensorFlow Lite
lightweight, standalone C++ inference engine for Google's Gemma models
C++-based high-performance parallel environment execution engine
C++ Implementation of PyTorch Tutorials for Everyone
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
High-speed Large Language Model Serving for Local Deployment
A GPU-accelerated library containing highly optimized building blocks
QVAC Fabric: cross-platform LLM inference and fine-tuning
Doom-based AI research platform for reinforcement learning