FlashAttention Files

Fast and memory-efficient exact attention

This is an exact mirror of the FlashAttention project, hosted at https://github.com/Dao-AILab/flash-attention. SourceForge is not affiliated with FlashAttention.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	InfoDownloads / Week
fa4-v4.0.0.beta4	2026-03-05	7
fa4-v4.0.0.beta2	2026-03-05	0
fa4-v4.0.0.beta1	2026-03-05	0
fa4-v4.0.0.beta0	2026-03-05	0
v2.8.3	2025-12-17	3
Totals: 5 Items		10

Other Useful Business Software

Try Google Cloud Risk-Free With $300 in Credit

No hidden charges. No surprise bills. Cancel anytime.

Use your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.

Start Free

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Featured

Try Google Cloud Risk-Free With $300 in Credit

No hidden charges. No surprise bills. Cancel anytime.

Use your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.

Start Free

Recommended Projects

xFormers
Hackable and optimized Transformers building blocks
SageAttention
NeurIPS2025 Spotlight] Quantized Attention
ChatGLM2-6B
ChatGLM2-6B: An Open Bilingual Chat LLM
MiniMax-M1
Open-weight, large-scale hybrid-attention reasoning model
Attention Residuals (AttnRes)
Drop-in replacement for standard residual connections in Transformers

FlashAttention Files

Fast and memory-efficient exact attention

Get an email when there's a new version of FlashAttention