Search Results for "lexer"

This is an experimental Javascript lexer, parser and interpreter written in Rust. Currently, it has support for some of the language.

...The crate serves as a back-end for the HTML rewriting functionality of Cloudflare Workers, but can be used as a standalone library with a convenient API for a wide variety of HTML rewriting/analysis tasks. The parser switches back to the tag scanner as soon as input leaves the scope of all selector matches. The tag scanner may also sometimes switch the parser to the Lexer - if it requires additional tag information for the parsing feedback simulation. Having two different parser implementations for the same grammar will increase development costs and is error-prone due to implementation inconsistencies. We minimize these risks by implementing a small Rust macro-based DSL which is similar in spirit to Ragel.

Logos is a lexer generator for Rust, designed to create fast and efficient lexers with minimal code. It leverages Rust's procedural macros to define token patterns, streamlining the process of lexical analysis.​

Claude’s C Compiler is a remarkable experiment in automated software generation: a full C compiler written from scratch in Rust entirely by an AI model (Claude Opus 4.6) with minimal human intervention, capable of targeting multiple architectures like x86-64, i686, ARM, and RISC-V. The project implements every part of a traditional compiler — the lexer, parser, intermediate representation, optimizer, code generator, assembler, linker, and debug info emitter — without relying on any external toolchain, producing standalone executables in the ELF format. While still early and not fully validated for correctness, it demonstrates the frontier of what sophisticated AI can build in complex, systems-level software domains, including the potential to compile real operating systems and large software projects.