Wanted to enable 16-bit character support as to enable
construction of unicode scanners.
We didn't find a simple way to support the EBCDIC
stuff, so we removed it. Further, for some reason the
use of bit vectors failed in test, so we disabled them as
We added a -w option to enable the Unicode processing
as to keep backward compatibility with 8-bit use (the
stuff mentioned above still disabled though).
Thomas Rask Thomsen