Port of Facebook's LLaMA model in C/C++
A Simple and Universal Swarm Intelligence Engine
The all-in-one Desktop & Docker AI application with full RAG and AI
The Multi-Agent Framework
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Drag & drop UI to build your customized LLM flow
Run models like Kimi-K2.5, GLM-5, DeepSeek, gpt-oss, Gemma, Qwen etc.
Revolutionizing Database Interactions with Private LLM Technology
Desktop app for prototyping and debugging LangGraph applications
A high-throughput and memory-efficient inference and serving engine
From Vibe Coding to Agentic Engineering
Phi-3.5 for Mac: Locally-run Vision and Language Models
157 models, 30 providers, one command to find what runs on hardware
lightweight package to simplify LLM API calls
C#/.NET binding of llama.cpp, including LLaMa/GPT model inference
Run Local LLMs on Any Device. Open-source
An LLM-powered knowledge curation system that researches topics
Official code repo for the O'Reilly Book
Distribute and run LLMs with a single file
One API for plugins and datasets, one interface for prompt engineering
Low-code app builder for RAG and multi-agent AI applications
Integrate cutting-edge LLM technology quickly and easily into your app
BISHENG is an open LLM devops platform for next generation apps
Ongoing research training transformer models at scale
Open source LLM engineering platform: LLM Observability, metrics, etc.