Python bindings for llama.cpp
Structured outputs for llms
Build AI WhatsApp Bots with Pure Python
AirLLM 70B inference with single 4GB GPU
A high-throughput and memory-efficient inference and serving engine
Run Local LLMs on Any Device. Open-source
Advanced LLM-powered brute-force tool combining AI intelligence
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Fully automatic censorship removal for language models
Uncertainty Quantification for Language Models, is a Python package
Access large language models from the command-line
Tools like web browser, computer access and code runner for LLMs
lightweight package to simplify LLM API calls
Powerful AI language model (MoE) optimized for efficiency/performance
Build a large language model from 0 only with Python foundation
SQL-Driven RAG Engine
LISA: Reasoning Segmentation via Large Language Model
Gemma open-weight LLM library, from Google DeepMind
An LLM-powered knowledge curation system that researches topics
Large Language Model Principles and Practice Tutorial from Scratch
Phi-3.5 for Mac: Locally-run Vision and Language Models
Adding guardrails to large language models
A guidance language for controlling large language models
Interact with your documents using the power of GPT
Llama Chinese community, real-time aggregation