FlashAttention Files

Fast and memory-efficient exact attention

This is an exact mirror of the FlashAttention project, hosted at https://github.com/Dao-AILab/flash-attention. SourceForge is not affiliated with FlashAttention.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	InfoDownloads / Week
v2.8.3.post1	2026-06-11	26
fa4-v4.0.0.beta4	2026-03-05	0
fa4-v4.0.0.beta2	2026-03-05	0
fa4-v4.0.0.beta1	2026-03-05	0
fa4-v4.0.0.beta0	2026-03-05	0
Totals: 5 Items		26

Other Useful Business Software

$300 Free Credits for Your Google Cloud Projects

Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.

Start Free Trial

Train ML Models With SQL You Already Know

BigQuery automates data prep, analysis, and predictions with built-in AI assistance.

Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.

Try Free

$300 Free Credits for Your Google Cloud Projects

Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

Start Free Trial

Recommended Projects

xFormers
Hackable and optimized Transformers building blocks
SageAttention
NeurIPS2025 Spotlight] Quantized Attention
ChatGLM2-6B
ChatGLM2-6B: An Open Bilingual Chat LLM
Kimi Linear
An expressive, efficient attention architecture
Sparse Attention
"Generating Long Sequences with Sparse Transformers" examples

FlashAttention Files

Fast and memory-efficient exact attention

Get an email when there's a new version of FlashAttention