Get up and running with Llama 2 and other large language models
LLM Frontend for Power Users
Port of Facebook's LLaMA model in C/C++
Run Local LLMs on Any Device. Open-source
Powerful AI language model (MoE) optimized for efficiency/performance
Open-source, high-performance AI model with advanced reasoning
The all-in-one Desktop & Docker AI application with full RAG and AI
Low-code app builder for RAG and multi-agent AI applications
Distribute and run LLMs with a single file
Central interface to connect your LLM's with external data
A high-throughput and memory-efficient inference and serving engine
Self-hosted, community-driven, local OpenAI compatible API
Drag & drop UI to build your customized LLM flow
An AI personal assistant for your digital brain
Python bindings for llama.cpp
OpenDAN is an open source Personal AI OS
Revolutionizing Database Interactions with Private LLM Technology
Emscripten: An LLVM-to-WebAssembly Compiler
Open-source observability for your LLM application
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
LLM abstractions that aren't obstructions
One API for plugins and datasets, one interface for prompt engineering
A modular graph-based Retrieval-Augmented Generation (RAG) system
Open-source end-to-end LLM Development Platform
A guidance language for controlling large language models