#10 Possible bug in the CSC4 Tokenizer

[SealedSun]

Yesterday I noticed that the compiler would ignore
certain statements if they were followed by a comment
like in:

var a = 6 #thats an assignment
var b = 5+7 #same here

Note that only the assignment was ignored, the variable
declaration worked...

I wasn't able to isolate the bug yet, if there is one.