Python bindings for llama.cpp
Run Local LLMs on Any Device. Open-source
Structured outputs for llms
Phi-3.5 for Mac: Locally-run Vision and Language Models
A high-throughput and memory-efficient inference and serving engine
Framework and no-code GUI for fine-tuning LLMs
Revolutionizing Database Interactions with Private LLM Technology
Application that simplifies the installation of AI-related projects
⚡ Building applications with LLMs through composability ⚡
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
A high-performance ML model serving framework, offers dynamic batching
Framework to easily create LLM powered bots over any dataset
Central interface to connect your LLM's with external data
MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training
Data Lake for Deep Learning. Build, manage, and query datasets
Open source libraries and APIs to build custom preprocessing pipelines
State-of-the-art Parameter-Efficient Fine-Tuning
Swirl queries any number of data sources with APIs
Replace OpenAI GPT with another LLM in your app
OpenDAN is an open source Personal AI OS
The Multi-Agent Framework
Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon
Adding guardrails to large language models
Operating LLMs in production
PyTorch library of curated Transformer models and their components