Search Results for "lexer"
Sort By:
Showing 24 open source projects for "lexer"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
1
CCC
Claude Opus 4.6 wrote a dependency-free C compiler in Rust
Claude’s C Compiler is a remarkable experiment in automated software generation: a full C compiler written from scratch in Rust entirely by an AI model (Claude Opus 4.6) with minimal human intervention, capable of targeting multiple architectures like x86-64, i686, ARM, and RISC-V. The project implements every part of a traditional compiler — the lexer, parser, intermediate representation, optimizer, code generator, assembler, linker, and debug info emitter — without relying on any external toolchain, producing standalone executables in the ELF format. While still early and not fully validated for correctness, it demonstrates the frontier of what sophisticated AI can build in complex, systems-level software domains, including the potential to compile real operating systems and large software projects. -
2
RE/flex lexical analyzer generator
The regex-centric, fast lexical analyzer generator for C++
A C++ high-performance regex library and Flex-compatible lexical analyzer generator with full Unicode support, new indentation anchors, lazy quantifiers, and many other modern features. Accepts Flex lexer specification syntax and is compatible with Bison/Yacc parsers. Generates reusable source code that is easy to understand. Supports fast scanning of UTF-8/16/32 files, strings, and streams. The reflex scanner generator generates clean C++ lexer class code that is thread-safe. Generates Graphviz files to visualize state machine DFAs. ... -
3
MLton
A whole-program optimizing compiler for Standard ML
...In addition, MLton provides a feature rich Standard ML programming environment, with full support for SML97 as given in The Definition of Standard ML (Revised), a number of useful language extensions, a complete implementation of the Standard ML Basis Library, various useful libraries, a simple and fast C foreign function interface, the ML Basis system for programming with source libraries, and tools such as a lexer generator, a parser generator, and a profiler. -
4
ARTCOMParser
Parser library that uses an EBNF like grammar to generate a parse tree
Parser library that uses an EBNF like grammar to generate a parse tree You can use it to create a quick parser It uses backtracking so it may be slow for some grammar rules -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
5
8cc C Compiler
Compiler for the C programming language
...It was created as a hobby project with the goal of demonstrating how a compiler works internally, making it a valuable resource for learning compiler design. The project includes core components such as a lexer, parser, and preprocessor, allowing users to explore each stage of the compilation process. One of its notable features is its ability to compile itself, showcasing its completeness and serving as a practical example of bootstrapping in compiler development. The code is intentionally written to be concise and readable, making it accessible to developers who want to study compiler internals. ... -
6
9cc C compiler
A Small C Compiler
9cc is a small and educational C compiler designed to demonstrate the internal workings of a compiler while still being capable of compiling meaningful programs. It serves as a continuation of Rui Ueyama’s series of compiler projects, focusing on clarity and incremental development rather than production-level optimization. The compiler implements essential stages such as lexical analysis, parsing, semantic analysis, and code generation, providing a complete pipeline from source code to... -
7
NaiveLanguageTools
C# lexer and parser
NLT is free, open-source C# lexer and GLR parser suite -- which translates to ability to parse ambiguous grammars. Grammar can be defined directly in code or (preferably) in separate file (lex/yacc-like) for included generator. If you understand/guess the meaning of grammar in C#: // scanning lexer.AddStringRule(")", match => SymbolEnum.RPAREN); // parsing prod_builder.AddProduction(SymbolEnum.exp, SymbolEnum.LPAREN, SymbolEnum.exp, SymbolEnum.RPAREN, (_1, e, _3) => (AstNode)e); or grammar in NLT format: // scanning /[A-Za-z_][A-Za-z_0-9]*/ -> IDENTIFIER, IdentifierSymbol.Create($text); // parsing program -> list:namespace_list { new Program(currCoords(), (Namespaces)list) }; you should be able to use it :-). ... -
8
JFlex
The fast lexer generator for Java
JFlex is a flex-like lexer generator for Java with emphasis on speed and full Unicode support. It has some not so usual features like negation in regexps and nested input streams. Also reads JLex specifications unchanged. -
9
Coco/S Parser Generator
Parser Generator based on Coco/R
Coco/S is a compiler generator that takes plain EBNF grammar files and features a SAX style call back API. It is written in Java and produces a Java Scanner (Lexer) and Parser for the language described by the input grammar. Coco/S is a branch of the 2010/11 release of Coco/R for Java. While Coco/R takes an attributed grammar file, Coco/S has a callback API. This has the advantage of a clean separation between grammar (EBNF) and Compiler/Interpreter. -
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
10
Automaton Lexer
A Java library for creating DFA-powered lexical analyzers
...I have not given much thought to whether it would even make sense to preserve the 'info' field through some of the other operations. This project also includes an extension of RunAutomaton, called TokenAutomaton, that can be used as a lexer, as well as its support classes and examples of its use. Lexers generated by JPlex depend on this library. I separated it from JPlex so that projects using JPlex would not depend on GPL code. Revision 1 of this project is dual-licensed, as it is the same code that was formerly part of JPlex. All code in this library was either originally published under the BSD license or was exclusively authored by me. -
11
cparser is a library containing a parser, lexer and semantic analysis for the ISO C99 language. It should be used as a compiler frontend, a base for source-source transformation, or source-checker tools.
-
12
KFlex is an extension to JFlex that makes it easy to generate lexers whose actions call methods of a listener interface. This simplifies parser development and makes the lexer a reusable drop-in component.
-
13
-
14
Java Cobol Lexer take a cobol source program and return it as a list of lexical tokens. Library takes source code in fixed, free and mixed formats. It recognizes standard Cobol 85.
-
15
Annotation based lexer and parser generator suitable for processing wide range of languages, from small domain specific languages to big ones like Java. Actions may be written directly as annotated java methods. Examples of expression language and Java5.
-
16
CSP Canonical LR(1) Parser Generator. Includes lexer and parser generator. Supports all OS. Produces code as standard ANSI C++ w/ minimal STL and usable in commercial or non-commercial purposes.
-
17
The fluffy language is a toy language designed around the libfirm intermediate representation library. It supports the typical low-level constructions known from C combined with generic programming constructs. Lexer and parser are extensible with plugins
-
18
-
19
Generic Lexer which along with a language definition (.slx) file, constitutes Yacc/Bison compatible, custom lexical parser. It is ~1/3 the size of an equivalent Flex Lexer, resulting in a smaller compiler, and simpler yet more powerful lexical definition.
-
20
A run-time configurable character stream tokenizer that allows the user to define token classes via regular expressions. The developer is not limited to predefined notions of whitespace, commenting, or word modalities.
-
21
Php Lexer - converts .lex files into .php files (so you can tokenize files) used to be: a PHP compiler for the .NET CIL (but that's pretty dead now)
-
22
YooParse stands for Yet-another Object-Oriented Parser code generator. It is the complement of YooLex, a lexer code generator. The purpose of YooParse is to generate a parser that integrates tightly with the scanner generated by YooLex.
-
23
-
24
CPyrol
an alternative interpreter for the Python programming language
...I am working on this project mainly to gather experience with the current C++ standart (C++ 11) and with compiler development, it is not (yet) intended for practical usage. This project is at an early stage of development. Currently implemented is a Lexer, Parser and Code Generator for compiling Python code into CPython-compatible bytecode.
- Previous
- You're on page 1
- Next