FlashInfer Files

FlashInfer: Kernel Library for LLM Serving

This is an exact mirror of the FlashInfer project, hosted at https://github.com/flashinfer-ai/flashinfer. SourceForge is not affiliated with FlashInfer.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	InfoDownloads / Week
v0.6.9	2026-04-24	0
v0.6.9rc1	2026-04-23	0
v0.6.8.post1	2026-04-18	3
v0.6.8	2026-04-16	0
v0.6.8rc1	2026-04-14	0
Totals: 5 Items		3

Other Useful Business Software

Go From AI Idea to AI App Fast

One platform to build, fine-tune, and deploy ML models. No MLOps team required.

Access Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.

Try Free

Forever Free Full-Stack Observability | Grafana Cloud

Our generous forever free tier includes the full platform, including the AI Assistant, for 3 users with 10k metrics, 50GB logs, and 50GB traces.

Built on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.

Create free account

Go From AI Idea to AI App Fast

One platform to build, fine-tune, and deploy ML models. No MLOps team required.

Access Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.

Try Free

Recommended Projects

optillm
Optimizing inference proxy for LLMs
LMDeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
vLLM
A high-throughput and memory-efficient inference and serving engine
gemma.cpp
lightweight, standalone C++ inference engine for Google's Gemma models
Mosec
A high-performance ML model serving framework, offers dynamic batching

FlashInfer Files

FlashInfer: Kernel Library for LLM Serving

Get an email when there's a new version of FlashInfer