Search Results for "lexer"

...In addition, MLton provides a feature rich Standard ML programming environment, with full support for SML97 as given in The Definition of Standard ML (Revised), a number of useful language extensions, a complete implementation of the Standard ML Basis Library, various useful libraries, a simple and fast C foreign function interface, the ML Basis system for programming with source libraries, and tools such as a lexer generator, a parser generator, and a profiler.

JFlex is a flex-like lexer generator for Java with emphasis on speed and full Unicode support. It has some not so usual features like negation in regexps and nested input streams. Also reads JLex specifications unchanged.

Coco/S is a compiler generator that takes plain EBNF grammar files and features a SAX style call back API. It is written in Java and produces a Java Scanner (Lexer) and Parser for the language described by the input grammar. Coco/S is a branch of the 2010/11 release of Coco/R for Java. While Coco/R takes an attributed grammar file, Coco/S has a callback API. This has the advantage of a clean separation between grammar (EBNF) and Compiler/Interpreter.

...I have not given much thought to whether it would even make sense to preserve the 'info' field through some of the other operations. This project also includes an extension of RunAutomaton, called TokenAutomaton, that can be used as a lexer, as well as its support classes and examples of its use. Lexers generated by JPlex depend on this library. I separated it from JPlex so that projects using JPlex would not depend on GPL code. Revision 1 of this project is dual-licensed, as it is the same code that was formerly part of JPlex. All code in this library was either originally published under the BSD license or was exclusively authored by me.

Java Cobol Lexer take a cobol source program and return it as a list of lexical tokens. Library takes source code in fixed, free and mixed formats. It recognizes standard Cobol 85.

Annotation based lexer and parser generator suitable for processing wide range of languages, from small domain specific languages to big ones like Java. Actions may be written directly as annotated java methods. Examples of expression language and Java5.

CSP Canonical LR(1) Parser Generator. Includes lexer and parser generator. Supports all OS. Produces code as standard ANSI C++ w/ minimal STL and usable in commercial or non-commercial purposes.

A portable and retargetable lexer/parser generator.

Generic Lexer which along with a language definition (.slx) file, constitutes Yacc/Bison compatible, custom lexical parser. It is ~1/3 the size of an equivalent Flex Lexer, resulting in a smaller compiler, and simpler yet more powerful lexical definition.

A run-time configurable character stream tokenizer that allows the user to define token classes via regular expressions. The developer is not limited to predefined notions of whitespace, commenting, or word modalities.

YooParse stands for Yet-another Object-Oriented Parser code generator. It is the complement of YooLex, a lexer code generator. The purpose of YooParse is to generate a parser that integrates tightly with the scanner generated by YooLex.