Python bindings for llama.cpp
Structured outputs for llms
Run Local LLMs on Any Device. Open-source
Powerful AI language model (MoE) optimized for efficiency/performance
Open-source, high-performance AI model with advanced reasoning
Port of Facebook's LLaMA model in C/C++
Low-code app builder for RAG and multi-agent AI applications
A high-throughput and memory-efficient inference and serving engine
Central interface to connect your LLM's with external data
Emscripten: An LLVM-to-WebAssembly Compiler
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Revolutionizing Database Interactions with Private LLM Technology
LLM abstractions that aren't obstructions
A modular graph-based Retrieval-Augmented Generation (RAG) system
Building applications with LLMs through composability
⚡ Building applications with LLMs through composability ⚡
BISHENG is an open LLM devops platform for next generation apps
Open-source end-to-end LLM Development Platform
A guidance language for controlling large language models
Interact with your documents using the power of GPT
Open-source observability for your LLM application
Visual Instruction Tuning: Large Language-and-Vision Assistant
Toolkit for conversational AI
OpenDAN is an open source Personal AI OS
Framework and no-code GUI for fine-tuning LLMs