a tokenizer that is general purpose, and multilanguage. it will provide consistent usage across the languages, and be tied into that language's unique common usage types.
Release Date:
Topics:
Licenses:
Intended Audience:
User Interface:
Programming Language:
Registered:
Ratings and Reviews
Be the first to post a text review of fms string tokenizer. Rate and review a project by clicking thumbs up or thumbs down in the right column.
Project Feed
-
first release
this is our first release, it is no where near complete, and it has some minor bugs. however, most of it works at this time. I currently believe that the benefits of working with a consistent string tokenizer across multiple languages out weigh the drawbacks of working with this project as it is at this time. In worst case, it will at least provide a building block upon which your own system may work.
-
fmstokenizer pre-alpha file released: fmstokenizerv0.5alpha1.zip
-
File released: /fmstokenizer/pre-alpha/fmstokenizerv0.5alpha1.zip
Rate and Review
Be the first person to add a text review.
Related Projects
fms string tokenizer Actions
About SourceForge
Develop Software
Copyright © 2009 Geeknet, Inc. All rights reserved. Terms of Use
