Open-source observability for your LLM application
Concatenate a directory full of files into a single prompt
Easy token price estimates for 400+ LLMs. TokenOps
Maimaibot, a (more focused) multi-platform intelligent agent
A high-performance ML model serving framework, offers dynamic batching
Schema-Guided Reasoning (SGR) has agentic system design
E2B Desktop Sandbox for LLMs. E2B Sandbox
Your Personal Research Multi-Tool
SDG is a specialized framework
Overcoming Group Chat Scenarios with LLM-based Technical Assistance
A system for agentic LLM-powered data processing and ETL
LightLLM is a Python-based LLM (Large Language Model) inference
Accessible large language models via k-bit quantization for PyTorch
Low-latency REST API for serving text-embeddings
AudioMuse-AI is an Open Source Dockerized environment
Let Claude (or any LLM) actually watch a video
Claude + Obsidian knowledge companion
Bridging LLM and Recommender System
Korea Investment & Securities Open API Github
NeurIPS2025 Spotlight] Quantized Attention
Code for the paper "Evaluating Large Language Models Trained on Code"
Collect, organize, use, and share, all in OmniBox
Data Infrastructure providing an approach to multimodal AI workloads
Multimodal Agents as Smartphone Users, an LLM-based multimodal agent
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step