minor change to the tokenizing, seems to work for test purpose
Authored by: gmaniac 2001-08-02
Parent: [r67]
Child: [r69]
