MoBA Files

MoBA: Mixture of Block Attention for Long-Context LLMs

This is an exact mirror of the MoBA project, hosted at https://github.com/MoonshotAI/MoBA. SourceForge is not affiliated with MoBA.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size
MoBA source code.tar.gz	2025-04-03	2.3 MB
MoBA source code.zip	2025-04-03	2.3 MB
Totals: 2 Items		4.6 MB

Other Useful Business Software

Full-stack observability with actually useful AI | Grafana Cloud

Our generous forever free tier includes the full platform, including the AI Assistant, for 3 users with 10k metrics, 50GB logs, and 50GB traces.

Built on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.

Create free account

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Full-stack observability with actually useful AI | Grafana Cloud

Our generous forever free tier includes the full platform, including the AI Assistant, for 3 users with 10k metrics, 50GB logs, and 50GB traces.

Create free account

Recommended Projects

SageAttention
NeurIPS2025 Spotlight] Quantized Attention
FlashAttention
Fast and memory-efficient exact attention
TimeSformer
The official pytorch implementation of our paper
Attention Residuals (AttnRes)
Drop-in replacement for standard residual connections in Transformers
SeedVR
Repo for SeedVR2 & SeedVR

MoBA Files

MoBA: Mixture of Block Attention for Long-Context LLMs

Get an email when there's a new version of MoBA