Python bindings for llama.cpp
Structured outputs for llms
Run Local LLMs on Any Device. Open-source
Powerful AI language model (MoE) optimized for efficiency/performance
Open-source, high-performance AI model with advanced reasoning
A high-throughput and memory-efficient inference and serving engine
Central interface to connect your LLM's with external data
A guidance language for controlling large language models
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Revolutionizing Database Interactions with Private LLM Technology
LLM abstractions that aren't obstructions
A modular graph-based Retrieval-Augmented Generation (RAG) system
Tools like web browser, computer access and code runner for LLMs
⚡ Building applications with LLMs through composability ⚡
Visual Instruction Tuning: Large Language-and-Vision Assistant
BISHENG is an open LLM devops platform for next generation apps
Toolkit for conversational AI
Framework and no-code GUI for fine-tuning LLMs
Interact with your documents using the power of GPT
Open-source observability for your LLM application
OpenDAN is an open source Personal AI OS
PandasAI is a Python library that integrates generative AI
Scalable data pre processing and curation toolkit for LLMs
Replace OpenAI GPT with another LLM in your app
Access large language models from the command-line