EWBTokenFactory for PHP

Status: Beta

Brought to you by: ericburns

Add a Review

Downloads: 0 This Week

Last Update: 2013-04-03

Download

Get an email when there's a new version of EWBTokenFactory for PHP

EWBTokenFactory for PHP is a whitespace inclusive tokenizer. Most tokenizers will grab each word as a token and drop the whitespace. This tokenizer will also tokenize the spaces in between into their own tokens. Also supports associated token data.

Project Activity

See All Activity >

License

GNU Library or Lesser General Public License version 2.0 (LGPLv2)

Follow EWBTokenFactory for PHP

EWBTokenFactory for PHP Web Site

Other Useful Business Software

Stop vibe-debugging.

Plug Claude into your app's actual errors.

AppSignal's MCP server hands Claude, Cursor, or Zed your real errors, traces, and the deploy that shipped them. AI writes the fix; you review the diff.

Free 30 days.

Rate This Project

User Reviews

Be the first to post a review of EWBTokenFactory for PHP!

Additional Project Details

Languages

English

Intended Audience

Developers

Programming Language

PHP

Registered

2009-12-12

Report inappropriate content

$300 Free Credits to Build on Google Cloud

New to Google Cloud? Get $300 in credits to explore Compute Engine, BigQuery, Cloud Run, Gemini Enterprise Agent Platform, and more.

Start your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.

Claim $300 Free

Recommended Projects

GPoSTTL: Enhanced Brill's Tagger
Enhanced version of Brill's Parts-of-Speech Tagger with built-in Tokenizer and Lemmatizer.
Step-Audio-EditX
LLM-based Reinforcement Learning audio edit model
NiliBasic PIC24
BASIC interpreter for the 16bit PIC microcontroller 24FJ64GA002. The interpreter runs on the chip only, no compiler/tokenizer is needed. Communication with PC is done by USB-to-serial converter cable.
NQXML
NQXML is a pure Ruby implementation of a non-validating XML processor. It includes an XML tokenizer, a SAX-style streaming XML parser, a DOM-style tree parser, an XML writer, and a context-sensitive callback mechanism.
Gin JWT Middleware
JWT Middleware for Gin framework