Python bindings for llama.cpp
Structured outputs for llms
Run Local LLMs on Any Device. Open-source
Port of Facebook's LLaMA model in C/C++
Low-code app builder for RAG and multi-agent AI applications
lightweight package to simplify LLM API calls
A guidance language for controlling large language models
A high-throughput and memory-efficient inference and serving engine
⚡ Building applications with LLMs through composability ⚡
Revolutionizing Database Interactions with Private LLM Technology
A high-performance ML model serving framework, offers dynamic batching
Application that simplifies the installation of AI-related projects
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Tools like web browser, computer access and code runner for LLMs
Data Lake for Deep Learning. Build, manage, and query datasets
Access large language models from the command-line
Database system for building simpler and faster AI-powered application
Swirl queries any number of data sources with APIs
Open source libraries and APIs to build custom preprocessing pipelines
Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon
Visual Instruction Tuning: Large Language-and-Vision Assistant
An elegent pytorch implement of transformers
OpenDAN is an open source Personal AI OS
Integrate cutting-edge LLM technology quickly and easily into your app