Search Results for "lexer" - Page 2

pylangparser - Simple language parsing from Python. Project provides classes for parsing formal languages in an easy way. Without using any external libraries, only unittest, re and pprint. There is a Lexer and a Parser class. The lexer produces list of tokens that the Parser then uses to build the AST. The lexer can also be used as a stand alone component. There is support for building customized AST's. The grammars are defined directly into the Python code. In the examples folder you will find both simple example scripts demonstrating basic usage of the parser and some more useful and complex ones. ...

JFlex is a flex-like lexer generator for Java with emphasis on speed and full Unicode support. It has some not so usual features like negation in regexps and nested input streams. Also reads JLex specifications unchanged.

...Now I build this c# project which is based on JSqlParser project .Notably,the JSqlParser is based on javacc, but the NSqlParser is based on another semantic analyzer whoes name is 'MinosseCC'(see http://www.codeproject.com/Articles/11632/MinosseCC-a-lexer-parser-generator-for-C), For c# Grammar,I modified the file 'JSqlParserCC.jj', now his name is 'NSqlParserCC.jj', Obvious, the other code files also I have changed. And please remember this, This project is free for you, And including any commercial behavior.

Coco/S is a compiler generator that takes plain EBNF grammar files and features a SAX style call back API. It is written in Java and produces a Java Scanner (Lexer) and Parser for the language described by the input grammar. Coco/S is a branch of the 2010/11 release of Coco/R for Java. While Coco/R takes an attributed grammar file, Coco/S has a callback API. This has the advantage of a clean separation between grammar (EBNF) and Compiler/Interpreter.

LALR(1) lexer and parser generator Java library.

PHParser 1.2 generates a pure Java parser for PHP programs. Invoking this parser yields an explicit parse tree (AST) and a tree walker suitable for further analysis. This tool package is based upon: - ANTLR 3.2 or higher (www.antlr.org). - JDK 1.6 or higher (java.sun.com). - Grammar specifications of PHP 5.3.

...I have not given much thought to whether it would even make sense to preserve the 'info' field through some of the other operations. This project also includes an extension of RunAutomaton, called TokenAutomaton, that can be used as a lexer, as well as its support classes and examples of its use. Lexers generated by JPlex depend on this library. I separated it from JPlex so that projects using JPlex would not depend on GPL code. Revision 1 of this project is dual-licensed, as it is the same code that was formerly part of JPlex. All code in this library was either originally published under the BSD license or was exclusively authored by me.

AleSimpleLexer is a C# class that tokenizes given text. Can process lists, numbers, text constants, parentheses and comments. Supports unicode.

...Their state machines are precompiled and serialized, so run time initialization is fast no matter how large the rule set. JPlex is not a parser generator; it only generates an interface for its parsers, and it does not build a parse tree. When the lexer identifies a token that has a named event associated with it, it passes the token to the parser method associated with that event. A lexer can dispatch token events to any number of parsers. JPlex is steadily being improved, and the Subversion repo will almost always be newer and better than the binary download.

cparser is a library containing a parser, lexer and semantic analysis for the ISO C99 language. It should be used as a compiler frontend, a base for source-source transformation, or source-checker tools.

KFlex is an extension to JFlex that makes it easy to generate lexers whose actions call methods of a listener interface. This simplifies parser development and makes the lexer a reusable drop-in component.

Simple lexical analyzer for ANSI C (C-88-090) language.

fntrace is a powerfull shell used for hack and automate many hardless tasks. It permite to manipulate easily binary files like elf and some else. It based on modules for extending functionalities; you can write it on perl python or C.

Simple header-only library written in C++, for lexical analysis of files in PDF format

Sparroh Lexer is a flexible lexical analyser written in C. Given a regular expression script, it will take an input file, tokenise it and place the result into an output file.

Java Cobol Lexer take a cobol source program and return it as a list of lexical tokens. Library takes source code in fixed, free and mixed formats. It recognizes standard Cobol 85.

QPG is a lexer and parser generator tailored for modern C++. The syntax of its grammer is designed to be more flexible and easily read than those of traditional tools like flex and bison. It's build on Qt4 but can produce output independent of it.

Annotation based lexer and parser generator suitable for processing wide range of languages, from small domain specific languages to big ones like Java. Actions may be written directly as annotated java methods. Examples of expression language and Java5.

CSP Canonical LR(1) Parser Generator. Includes lexer and parser generator. Supports all OS. Produces code as standard ANSI C++ w/ minimal STL and usable in commercial or non-commercial purposes.

The fluffy language is a toy language designed around the libfirm intermediate representation library. It supports the typical low-level constructions known from C combined with generic programming constructs. Lexer and parser are extensible with plugins

A portable and retargetable lexer/parser generator.

Generic Lexer which along with a language definition (.slx) file, constitutes Yacc/Bison compatible, custom lexical parser. It is ~1/3 the size of an equivalent Flex Lexer, resulting in a smaller compiler, and simpler yet more powerful lexical definition.

A run-time configurable character stream tokenizer that allows the user to define token classes via regular expressions. The developer is not limited to predefined notions of whitespace, commenting, or word modalities.

Php Lexer - converts .lex files into .php files (so you can tokenize files) used to be: a PHP compiler for the .NET CIL (but that's pretty dead now)

YooParse stands for Yet-another Object-Oriented Parser code generator. It is the complement of YooLex, a lexer code generator. The purpose of YooParse is to generate a parser that integrates tightly with the scanner generated by YooLex.