FlashInfer: Kernel Library for LLM Serving
Implementation of AudioLM audio generation model in Pytorch
Develop software autonomously
A Model Context Protocol server that provides network asset info
A Model Context Protocol (MCP) server implementation
K8s-mcp-server is a Model Context Protocol (MCP) server
Ultra-Efficient LLMs on End Device
Open multimodal web agent built by Ai2
AI framework for automated short video creation and editing tools
AI-powered code assistant for Vim. OpenAI and ChatGPT plugin for Vim
Towards Efficient Self-Evolving Agent System
Unified KV Cache Compression Methods for Auto-Regressive Models
A tension reasoning engine over 131 S-class problems
AI Powered Knowledge Graph Generator
Document (PDF, Word, PPTX ...) extraction and parse API
DepGraph: Towards Any Structural Pruning
slime is an LLM post-training framework for RL Scaling
In-depth tutorials on LLMs, RAGs and real-world AI agent applications
Official inference framework for 1-bit LLMs
95% token savings. 155x faster queries. 16 languages
Ring is a reasoning MoE LLM provided and open-sourced by InclusionAI
Research code artifacts for Code World Model (CWM)
Deep learning library
DeepCode: Open Agentic Coding
A Unified Library for Parameter-Efficient Learning