Python bindings for llama.cpp
Structured outputs for llms
Build AI WhatsApp Bots with Pure Python
Run models like Kimi-K2.5, GLM-5, DeepSeek, gpt-oss, Gemma, Qwen etc.
Run Local LLMs on Any Device. Open-source
Port of Facebook's LLaMA model in C/C++
Access large language models from the command-line
A Simple and Universal Swarm Intelligence Engine
Fully automatic censorship removal for language models
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon
Powerful AI language model (MoE) optimized for efficiency/performance
Tools like web browser, computer access and code runner for LLMs
A guidance language for controlling large language models
Adding guardrails to large language models
Build a large language model from 0 only with Python foundation
A python module to repair invalid JSON from LLMs
AirLLM 70B inference with single 4GB GPU
A high-throughput and memory-efficient inference and serving engine
Evaluate your LLM's response with Prometheus and GPT4
Text-space optimizer that trains reusable natural-language skills
An LLM-powered knowledge curation system that researches topics
PandasAI is a Python library that integrates generative AI
Uncertainty Quantification for Language Models, is a Python package
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)