Python bindings for llama.cpp
Structured outputs for llms
Fully automatic censorship removal for language models
AirLLM 70B inference with single 4GB GPU
Run models like Kimi-K2.5, GLM-5, DeepSeek, gpt-oss, Gemma, Qwen etc.
Advanced LLM-powered brute-force tool combining AI intelligence
Run Local LLMs on Any Device. Open-source
An LLM-powered knowledge curation system that researches topics
LightLLM is a Python-based LLM (Large Language Model) inference
A high-throughput and memory-efficient inference and serving engine
An Agent Designed for Mathematical Modeling
Port of Facebook's LLaMA model in C/C++
Access large language models from the command-line
PandasAI is a Python library that integrates generative AI
AI-Powered Data Processing: Use LOTUS to process all of your datasets
Powerful AI language model (MoE) optimized for efficiency/performance
Language-model investigation agent with a terminal UI
I Agent designed to interact with ROS1- and ROS2-based robotics system
Toolkit for conversational AI
High-performance Inference and Deployment Toolkit for LLMs and VLMs
Take control of your AI agents
Adding guardrails to large language models
A Gym environment for web task automation
Tools like web browser, computer access and code runner for LLMs
E2B Desktop Sandbox for LLMs. E2B Sandbox