Tiktoken Files

tiktoken is a fast BPE tokeniser for use with OpenAI's models

This is an exact mirror of the Tiktoken project, hosted at https://github.com/openai/tiktoken. SourceForge is not affiliated with Tiktoken. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
0.7.0 source code.tar.gz	2024-05-13	30.0 kB	0
0.7.0 source code.zip	2024-05-13	38.6 kB	0
Totals: 2 Items		68.6 kB	0

Other Useful Business Software

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Secure remote access solution to your private network, in the cloud or on-prem.

Deliver secure remote access with OpenVPN.

OpenVPN is here to bring simple, flexible, and cost-effective secure remote access to companies of all sizes, regardless of where their resources are located.

Get started — no credit card required.

Recommended Projects

Activepieces
Open Source AI Automation
DeSmuME: Nintendo DS emulator
DeSmuME is a Nintendo DS emulator
KeePass
A lightweight and easy-to-use password manager
Clonezilla
A partition and disk imaging/cloning program
Apache OpenOffice
The free and Open Source productivity suite

Tiktoken Files

tiktoken is a fast BPE tokeniser for use with OpenAI's models

Get an email when there's a new version of Tiktoken