Port of OpenAI's Whisper model in C/C++
Port of Facebook's LLaMA model in C/C++
Run Local LLMs on Any Device. Open-source
User-friendly AI Interface
Data manipulation and transformation for audio signal processing
ONNX Runtime: cross-platform, high performance ML inferencing
C++ library for high performance inference on NVIDIA GPUs
High-performance neural network inference framework for mobile
OpenVINOâ„¢ Toolkit repository
The free, Open Source alternative to OpenAI, Claude and others
Everything you need to build state-of-the-art foundation models
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
MNN is a blazing fast, lightweight deep learning framework
A high-throughput and memory-efficient inference and serving engine
Protect and discover secrets using Gitleaks
Pure C++ implementation of several models for real-time chatting
Standardized Serverless ML Inference Platform on Kubernetes
The official Python client for the Huggingface Hub
C#/.NET binding of llama.cpp, including LLaMa/GPT model inference
Training and deploying machine learning models on Amazon SageMaker
Open-Source AI Camera. Empower any camera/CCTV
Fast inference engine for Transformer models
Open standard for machine learning interoperability
Easiest and laziest way for building multi-agent LLMs applications
Replace OpenAI GPT with another LLM in your app