CTokenizer accepts C++ syntax as input and outputs a vector of CToken objects, which contain a token string and a(n enumerated) token type, which can then be used to parse the input.

Project Activity

See All Activity >

License

Artistic License

Follow CTokenizer

CTokenizer Web Site

Other Useful Business Software
Level Up Your Cyber Defense with External Threat Management Icon
Level Up Your Cyber Defense with External Threat Management

See every risk before it hits. From exposed data to dark web chatter. All in one unified view.

Move beyond alerts. Gain full visibility, context, and control over your external attack surface to stay ahead of every threat.
Try for Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of CTokenizer!

Additional Project Details

Intended Audience

Developers

Programming Language

C++

Related Categories

C++ Compilers, C++ Source Code Analysis Tool, C++ Libraries

Registered

2009-05-21