CTokenizer accepts C++ syntax as input and outputs a vector of CToken objects, which contain a token string and a(n enumerated) token type, which can then be used to parse the input.

Project Activity

See All Activity >

License

Artistic License

Follow CTokenizer

CTokenizer Web Site

Other Useful Business Software
Try Google Cloud Risk-Free With $300 in Credit Icon
Try Google Cloud Risk-Free With $300 in Credit

No hidden charges. No surprise bills. Cancel anytime.

Use your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of CTokenizer!

Additional Project Details

Intended Audience

Developers

Programming Language

C++

Related Categories

C++ Compilers, C++ Source Code Analysis Tool, C++ Libraries

Registered

2009-05-21