Search Results for "lexer" - Page 2

...I have not given much thought to whether it would even make sense to preserve the 'info' field through some of the other operations. This project also includes an extension of RunAutomaton, called TokenAutomaton, that can be used as a lexer, as well as its support classes and examples of its use. Lexers generated by JPlex depend on this library. I separated it from JPlex so that projects using JPlex would not depend on GPL code. Revision 1 of this project is dual-licensed, as it is the same code that was formerly part of JPlex. All code in this library was either originally published under the BSD license or was exclusively authored by me.

...Their state machines are precompiled and serialized, so run time initialization is fast no matter how large the rule set. JPlex is not a parser generator; it only generates an interface for its parsers, and it does not build a parse tree. When the lexer identifies a token that has a named event associated with it, it passes the token to the parser method associated with that event. A lexer can dispatch token events to any number of parsers. JPlex is steadily being improved, and the Subversion repo will almost always be newer and better than the binary download.

cparser is a library containing a parser, lexer and semantic analysis for the ISO C99 language. It should be used as a compiler frontend, a base for source-source transformation, or source-checker tools.

KFlex is an extension to JFlex that makes it easy to generate lexers whose actions call methods of a listener interface. This simplifies parser development and makes the lexer a reusable drop-in component.

Simple lexical analyzer for ANSI C (C-88-090) language.

fntrace is a powerfull shell used for hack and automate many hardless tasks. It permite to manipulate easily binary files like elf and some else. It based on modules for extending functionalities; you can write it on perl python or C.

Simple header-only library written in C++, for lexical analysis of files in PDF format

Java Cobol Lexer take a cobol source program and return it as a list of lexical tokens. Library takes source code in fixed, free and mixed formats. It recognizes standard Cobol 85.

QPG is a lexer and parser generator tailored for modern C++. The syntax of its grammer is designed to be more flexible and easily read than those of traditional tools like flex and bison. It's build on Qt4 but can produce output independent of it.

Annotation based lexer and parser generator suitable for processing wide range of languages, from small domain specific languages to big ones like Java. Actions may be written directly as annotated java methods. Examples of expression language and Java5.

CSP Canonical LR(1) Parser Generator. Includes lexer and parser generator. Supports all OS. Produces code as standard ANSI C++ w/ minimal STL and usable in commercial or non-commercial purposes.

The fluffy language is a toy language designed around the libfirm intermediate representation library. It supports the typical low-level constructions known from C combined with generic programming constructs. Lexer and parser are extensible with plugins

A portable and retargetable lexer/parser generator.

Generic Lexer which along with a language definition (.slx) file, constitutes Yacc/Bison compatible, custom lexical parser. It is ~1/3 the size of an equivalent Flex Lexer, resulting in a smaller compiler, and simpler yet more powerful lexical definition.

A run-time configurable character stream tokenizer that allows the user to define token classes via regular expressions. The developer is not limited to predefined notions of whitespace, commenting, or word modalities.

Php Lexer - converts .lex files into .php files (so you can tokenize files) used to be: a PHP compiler for the .NET CIL (but that's pretty dead now)

YooParse stands for Yet-another Object-Oriented Parser code generator. It is the complement of YooLex, a lexer code generator. The purpose of YooParse is to generate a parser that integrates tightly with the scanner generated by YooLex.

Python4C is a lexer, parser, and analyzer for C written in Python

This is (going to be) a simple interpreter of a simple weakly typed language. The code, now, contains only the token class along with some subclasses, a lexer and some other titbits.

Top-down parser with dynamically modified grammar. May be a bit slower than tool-generated parsers, but grammar may change in runtime. That lets you create languages with dynamically changing grammar, is perfect for embedded scripting languages and allows easier compiler creation process.