Python bindings for llama.cpp
Structured outputs for llms
Run Local LLMs on Any Device. Open-source
Powerful AI language model (MoE) optimized for efficiency/performance
Open-source, high-performance AI model with advanced reasoning
Port of Facebook's LLaMA model in C/C++
Low-code app builder for RAG and multi-agent AI applications
Central interface to connect your LLM's with external data
A high-throughput and memory-efficient inference and serving engine
A guidance language for controlling large language models
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Access large language models from the command-line
⚡ Building applications with LLMs through composability ⚡
Revolutionizing Database Interactions with Private LLM Technology
lightweight package to simplify LLM API calls
Tools like web browser, computer access and code runner for LLMs
LLM abstractions that aren't obstructions
Ongoing research training transformer models at scale
Building applications with LLMs through composability
Framework and no-code GUI for fine-tuning LLMs
A modular graph-based Retrieval-Augmented Generation (RAG) system
Toolkit for conversational AI
Interact with your documents using the power of GPT
Open-source observability for your LLM application
BISHENG is an open LLM devops platform for next generation apps