1D Visual Tokenization and Generation Files

This repo contains the code for 1D tokenizer and generator

This is an exact mirror of the 1D Visual Tokenization and Generation project, hosted at https://github.com/bytedance/1d-tokenizer. SourceForge is not affiliated with 1D Visual Tokenization and Generation. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size
1d-tokenizer source code.tar.gz	2025-03-20	30.6 MB
1d-tokenizer source code.zip	2025-03-20	30.7 MB
Totals: 2 Items		61.3 MB

Other Useful Business Software

Cloud-based help desk software with ServoDesk

Full access to Enterprise features. No credit card required.

What if You Could Automate 90% of Your Repetitive Tasks in Under 30 Days? At ServoDesk, we help businesses like yours automate operations with AI, allowing you to cut service times in half and increase productivity by 25% - without hiring more staff.

Try ServoDesk for free

Gen AI apps are built with MongoDB Atlas

The database for AI-powered applications.

MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.

Start Free

Recommended Projects

DeSmuME
DeSmuME is a Nintendo DS emulator
Apache OpenOffice
The free and Open Source productivity suite
Clonezilla
A partition and disk imaging/cloning program
KeePass
A lightweight and easy-to-use password manager
7-Zip
A free file archiver for extremely high compression

1D Visual Tokenization and Generation Files

This repo contains the code for 1D tokenizer and generator

Get an email when there's a new version of 1D Visual Tokenization and Generation