Legacy Tokenizer Files

Status: Pre-Alpha

Brought to you by: bhandy

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
legacy-tokenizer-alpha.jar	2006-11-20	43.6 kB	0
legacy-tokenizer.jar	2006-11-20	43.6 kB	0
legacy-tokenizer-alpha-1.0.jar	2006-11-15	39.0 kB	0
Totals: 3 Items		126.1 kB	0

Other Useful Business Software

$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.

Start Free

Build Agents and Models on One Platform

Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.

Start Free

$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.

Start Free

Recommended Projects

IPTC Metadata Library
libiptcdata is a standalone C-library for reading and writing the International Press Telecommunications Council (IPTC) metadata contained in various data files such as images.
PiggViewer
PiggViewer is an application that allows the viewing of pigg format files such as those found in the City of Heroes(TM) MMORPG. It allows for the viewing and extraction of the meta-data contained within the pigg format archive.
pdf2xml
pdf2xml convertor based on Xpdf library (http://www.foolabs.com/xpdf/home.html). It converts information contained in a PDF file into XML. First, you need to install xpdf and libxml2 (see documentation). Hervé Déjean Xerox Research Centre Europe http://www.xrce.xerox.com/About-XRCE/People/Herve-Dejean
Game File Editor
A customizable and scalable file editor. It provides a parsing and tokenizing engine. User configurable and GUI customizable. Focused on editing text based configuration files for games, can be xml config files too.
Tokenizer
A small library for converting tokenized PHP source code into XML