EWBTokenFactory for PHP

Status: Beta

Brought to you by: ericburns

Downloads: 0 This Week

Last Update: 2013-04-03

Get an email when there's a new version of EWBTokenFactory for PHP

EWBTokenFactory for PHP is a whitespace inclusive tokenizer. Most tokenizers will grab each word as a token and drop the whitespace. This tokenizer will also tokenize the spaces in between into their own tokens. Also supports associated token data.

Project Activity

See All Activity >

License

GNU Library or Lesser General Public License version 2.0 (LGPLv2)

Follow EWBTokenFactory for PHP

EWBTokenFactory for PHP Web Site

Other Useful Business Software

Go from Code to Production URL in Seconds Icon

Go from Code to Production URL in Seconds

Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.

Try it free

Rate This Project

Login To Rate This Project

User Reviews

Be the first to post a review of EWBTokenFactory for PHP!

Additional Project Details

Languages

English

Intended Audience

Developers

Programming Language

Registered

2009-12-12

Report inappropriate content

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Recommended Projects

GPoSTTL: Enhanced Brill's Tagger
Enhanced version of Brill's Parts-of-Speech Tagger with built-in Tokenizer and Lemmatizer.
Step-Audio-EditX
LLM-based Reinforcement Learning audio edit model
NiliBasic PIC24
BASIC interpreter for the 16bit PIC microcontroller 24FJ64GA002. The interpreter runs on the chip only, no compiler/tokenizer is needed. Communication with PC is done by USB-to-serial converter cable.
NQXML
NQXML is a pure Ruby implementation of a non-validating XML processor. It includes an XML tokenizer, a SAX-style streaming XML parser, a DOM-style tree parser, an XML writer, and a context-sensitive callback mechanism.
Gin JWT Middleware
JWT Middleware for Gin framework