Python bindings for llama.cpp
Structured outputs for llms
Port of Facebook's LLaMA model in C/C++
Run Local LLMs on Any Device. Open-source
Powerful AI language model (MoE) optimized for efficiency/performance
Open-source, high-performance AI model with advanced reasoning
Low-code app builder for RAG and multi-agent AI applications
Central interface to connect your LLM's with external data
A high-throughput and memory-efficient inference and serving engine
A guidance language for controlling large language models
Open-source observability for your LLM application
OpenDAN is an open source Personal AI OS
Revolutionizing Database Interactions with Private LLM Technology
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
LLM abstractions that aren't obstructions
A modular graph-based Retrieval-Augmented Generation (RAG) system
Tools like web browser, computer access and code runner for LLMs
Interact with your documents using the power of GPT
Open-source end-to-end LLM Development Platform
Low-code framework for building custom LLMs, neural networks
Toolkit for conversational AI
Framework and no-code GUI for fine-tuning LLMs
An elegent pytorch implement of transformers
⚡ Building applications with LLMs through composability ⚡
An AI personal assistant for your digital brain