Python bindings for llama.cpp
Structured outputs for llms
Run models like Kimi-K2.5, GLM-5, DeepSeek, gpt-oss, Gemma, Qwen etc.
Run Local LLMs on Any Device. Open-source
Concatenate a directory full of files into a single prompt
Advanced LLM-powered brute-force tool combining AI intelligence
AirLLM 70B inference with single 4GB GPU
Port of Facebook's LLaMA model in C/C++
A high-throughput and memory-efficient inference and serving engine
Fully automatic censorship removal for language models
Uses Qwen3-ASR, local LLM, Whisper, TEN-VAD
An Agent Designed for Mathematical Modeling
Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon
Open-source, high-performance AI model with advanced reasoning
Powerful AI language model (MoE) optimized for efficiency/performance
Build AI WhatsApp Bots with Pure Python
lightweight package to simplify LLM API calls
Language-model investigation agent with a terminal UI
Interact with your documents using the power of GPT
Scalable data pre processing and curation toolkit for LLMs
The official Meta Llama 3 GitHub site
PandasAI is a Python library that integrates generative AI
An LLM-powered knowledge curation system that researches topics
A modular graph-based Retrieval-Augmented Generation (RAG) system
A list of free LLM inference resources accessible via API