x-transformers Files

A simple but complete full-attention transformer

This is an exact mirror of the x-transformers project, hosted at https://github.com/lucidrains/x-transformers. SourceForge is not affiliated with x-transformers.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
2.16.1 source code.tar.gz	2026-02-12	39.4 MB	0
2.16.1 source code.zip	2026-02-12	39.4 MB	0
README.md	2026-02-12	377 Bytes	0
Totals: 3 Items		78.7 MB	0

What's Changed

Support efficient flash attention for packed sequences using flash-attn-2.0 by @muthissar in https://github.com/lucidrains/x-transformers/pull/350

New Contributors

@muthissar made their first contribution in https://github.com/lucidrains/x-transformers/pull/350

Full Changelog: https://github.com/lucidrains/x-transformers/compare/2.16.0...2.16.1

Source: README.md, updated 2026-02-12

Other Useful Business Software

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Go from Code to Production URL in Seconds

Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.

Try it free

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

Start Free

Recommended Projects

Pasang Emas
Pasang is a traditional two-player board game of Brunei. The game starts with a board-full of tokens. The players take turn capturing these tokens. The player with the most tokens wins.
FlashAttention
Fast and memory-efficient exact attention
SQL Parser for Delphi
Develope a string parser that is capable to parse SQL statements into tokens, allows changing theese tokens and rebuilding (modified) SQL statement
Laravel Sanctum
Laravel Sanctum provides a featherweight authentication system
QBIC - Play smart!
QBIC is bascially a "four in a row" board game, except that you can place your tokens on 16 sticks. This way you can connect four tokens in 3D space and no longer on a 2D plane.

x-transformers Files

A simple but complete full-attention transformer

Get an email when there's a new version of x-transformers

What's Changed

New Contributors