another update to the .NET version. This removes the java support class created by the MS Java to C# converted. I have added in a new TokenUtilities class to provide the required functionality. There are also new tokenisers for qgram2, 3 and s as well as 2, 3 and s extended.
SGrams allow for errors in the words using a cci index.