AICI: Prompts as (Wasm) Programs
Port of OpenAI's Whisper model in C/C++
Run Local LLMs on Any Device. Open-source
ONNX Runtime: cross-platform, high performance ML inferencing
High-performance neural network inference framework for mobile
Port of Facebook's LLaMA model in C/C++
Ready-to-use OCR with 80+ supported languages
User-friendly AI Interface
OpenVINO™ Toolkit repository
C++ library for high performance inference on NVIDIA GPUs
A high-throughput and memory-efficient inference and serving engine
Self-hosted, community-driven, local OpenAI compatible API
Protect and discover secrets using Gitleaks
MNN is a blazing fast, lightweight deep learning framework
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Library for OCR-related tasks powered by Deep Learning
Open standard for machine learning interoperability
Data manipulation and transformation for audio signal processing
A general-purpose probabilistic programming system
LLMs as Copilots for Theorem Proving in Lean
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Easiest and laziest way for building multi-agent LLMs applications
Deep Learning API and Server in C++14 support for Caffe, PyTorch
A RWKV management and startup tool, full automation, only 8MB
Uncover insights, surface problems, monitor, and fine tune your LLM