PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
Pure C++ implementation of several models for real-time chatting
Open Source Computer Vision Library
Clean and efficient FP8 GEMM kernels with fine-grained scaling
ONNX Runtime: cross-platform, high performance ML inferencing
The AI-Native Search Database
OpenMLDB is an open-source machine learning database
Audio Plugin for Audio to MIDI transcription using deep learning
C++ behavior tree library for robotics and AI decision systems
AWS IoT FleetWise Edge Agent
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
RAPIDS Machine Learning Library
Instant neural graphics primitives: lightning fast NeRF and more
The open big data serving engine
ESP32 Camera motion capture application to record JPEGs to SD card
Confidential Compute Open Network, Decentralized AI Inference on TON
A scalable inference server for models optimized with OpenVINO
Cross-platform, customizable ML solutions
GPU accelerated decision optimization
A retargetable MLIR-based machine learning compiler runtime toolkit
Fast, Sharp & Reliable Agentic Intelligence
Serving system for machine learning models
Low-latency machine code generation
HeavyDB (formerly MapD/OmniSciDB)
FlashMLA: Efficient Multi-head Latent Attention Kernels