ModernBERT Files

Bringing BERT into modernity via both architecture changes and scaling

This is an exact mirror of the ModernBERT project, hosted at https://github.com/AnswerDotAI/ModernBERT. SourceForge is not affiliated with ModernBERT.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size
ModernBERT source code.tar.gz	2026-03-01	189.8 kB
ModernBERT source code.zip	2026-03-01	271.3 kB
Totals: 2 Items		461.1 kB

Other Useful Business Software

AI-generated apps that pass security review

Stop waiting on engineering. Build production-ready internal tools with AI—on your company data, in your cloud.

Retool lets you generate dashboards, admin panels, and workflows directly on your data. Type something like “Build me a revenue dashboard on my Stripe data” and get a working app with security, permissions, and compliance built in from day one. Whether on our cloud or self-hosted, create the internal software your team needs without compromising enterprise standards or control.

Try Retool free

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build generative AI apps with Vertex AI. Switch between models without switching platforms.

Start Free

Featured

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build generative AI apps with Vertex AI. Switch between models without switching platforms.

Start Free

Recommended Projects

SentenceTransformers
Multilingual sentence & image embeddings with BERT
FasterTransformer
Transformer related optimization, including BERT, GPT
Bert-VITS2
VITS2 backbone with multilingual-bert
StyleTTS 2
Towards Human-Level Text-to-Speech through Style Diffusion
ViMax
Director, Screenwriter, Producer, and Video Generator All-in-One

ModernBERT Files

Bringing BERT into modernity via both architecture changes and scaling

Get an email when there's a new version of ModernBERT