Attention Residuals (AttnRes) Files

Drop-in replacement for standard residual connections in Transformers

This is an exact mirror of the Attention Residuals (AttnRes) project, hosted at https://github.com/MoonshotAI/Attention-Residuals. SourceForge is not affiliated with Attention Residuals (AttnRes).

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Attention-Residuals source code.tar.gz	2026-03-17	1.7 MB	0
Attention-Residuals source code.zip	2026-03-17	1.7 MB	1
Totals: 2 Items		3.5 MB	1

Other Useful Business Software

Train ML Models With SQL You Already Know

BigQuery automates data prep, analysis, and predictions with built-in AI assistance.

Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.

Try Free

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build generative AI apps with Vertex AI. Switch between models without switching platforms.

Start Free

Train ML Models With SQL You Already Know

BigQuery automates data prep, analysis, and predictions with built-in AI assistance.

Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.

Try Free

Recommended Projects

FlashAttention
Fast and memory-efficient exact attention
DeepSeek-V3.2-Exp
An experimental version of DeepSeek model
Transformers-Interpret
Model explainability that works seamlessly with Hugging Face
Tempo2
Pulsar software for forming timing residuals. Developed mainly by George Hobbs and Russell Edwards at the ATNF.
Apple Neural Engine (ANE) Transformers
Reference implementation of the Transformer architecture optimized

Attention Residuals (AttnRes) Files

Drop-in replacement for standard residual connections in Transformers

Get an email when there's a new version of Attention Residuals (AttnRes)