This project is derived from the dk.brics.automaton DFA library, version 1.11-8. The most significant change is the addition of a 'info' field to automaton states, allowing them to be associated with a token type. A few automaton operations were modified to preserve the value of this field. I have not given much thought to whether it would even make sense to preserve the 'info' field through some of the other operations.

This project also includes an extension of RunAutomaton, called TokenAutomaton, that can be used as a lexer, as well as its support classes and examples of its use.

Lexers generated by JPlex depend on this library. I separated it from JPlex so that projects using JPlex would not depend on GPL code. Revision 1 of this project is dual-licensed, as it is the same code that was formerly part of JPlex. All code in this library was either originally published under the BSD license or was exclusively authored by me.

Project Activity

See All Activity >

Categories

Compilers

License

BSD License

Follow Automaton Lexer

Automaton Lexer Web Site

nel_h2
Gen AI apps are built with MongoDB Atlas Icon
Gen AI apps are built with MongoDB Atlas

The database for AI-powered applications.

MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Automaton Lexer!

Additional Project Details

Intended Audience

Developers

Programming Language

Java

Related Categories

Java Compilers

Registered

2012-07-23