CTokenizer accepts C++ syntax as input and outputs a vector of CToken objects, which contain a token string and a(n enumerated) token type, which can then be used to parse the input.
License
Artistic LicenseFollow CTokenizer
Other Useful Business Software
Cut Data Warehouse Costs by 54%
BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of CTokenizer!