Structured outputs for llms
Python bindings for llama.cpp
Fully automatic censorship removal for language models
Compress tool outputs, logs, files, and RAG chunks
Run Local LLMs on Any Device. Open-source
AirLLM 70B inference with single 4GB GPU
Play ChatGPT and other LLM with Xiaomi AI Speaker
LLM inference server with continuous batching & SSD caching
A high-throughput and memory-efficient inference and serving engine
Uses Qwen3-ASR, local LLM, Whisper, TEN-VAD
Find the local LLM that actually runs and performs best
Advanced LLM-powered brute-force tool combining AI intelligence
A Simple and Universal Swarm Intelligence Engine
PandasAI is a Python library that integrates generative AI
lightweight package to simplify LLM API calls
Korea Investment & Securities Open API Github
Uncertainty Quantification for Language Models, is a Python package
Claude + Obsidian knowledge companion
A list of free LLM inference resources accessible via API
Scalable data pre processing and curation toolkit for LLMs
Open-source AI hackers to find and fix your app’s vulnerabilities
Powerful AI language model (MoE) optimized for efficiency/performance
Multi-Agents LLM Financial Trading Framework
Open-source, high-performance AI model with advanced reasoning
Interact with your documents using the power of GPT