This release introduces two improvements:
CppScanner.py was completely rewritten, and now correctly identifies numbers beginning with "."
Created CppTokenizer.py which shows how compiler's lexical analyzer breaks a program into pieces (tokens)
I hope you enjoy.
Eduardo Aguiar